Methods › Computer Vision › Vision and Language Pre-Trained Models › CLIP
Contrastive Language-Image Pre-training
CLIP
Introduced by Alec Radford et al. in Learning Transferable Visual Models From Natural Language Supervision
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning from natural language supervision. , CLIP jointly trains an image encoder and a text encoder to predict the correct pairings of a batch of (image, text) training examples. At test time the learned text encoder synthesizes a zero-shot linear classifier by embedding the names or descriptions of the target dataset’s classes.
For pre-training, CLIP is trained to predict which of the N X N possible (image, text) pairings across a batch actually occurred. CLIP learns a multi-modal embedding space by jointly training an image encoder and text encoder to maximize the cosine similarity of the image and text embeddings of the N real pairs in the batch while minimizing the cosine similarity of the embeddings of the N² - N incorrect pairings. A symmetric cross entropy loss is optimized over these similarity scores.
Image credit: Learning Transferable Visual Models From Natural Language Supervision
In Syntology about another paper, arXiv:2106.02524: repository known, no verified implementation (declared_code; repositories: 1 listed of 1 in the graph, strongest link: listed only). The lookup matched a paper by its title, arXiv:2106.02524, not a method entry. About another paper: this answer is about arXiv:2106.02524, while the archive credits arXiv:2103.00020.
Origin paper of this answer, arXiv:2106.02524 (its page on this site · its page on Syntology).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 3,094 · with a code link: 1,617 · where Syntology ran a sample: 649 (525 with a run with no instrument failure, 124 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (649 of 3,094 tagged: 525 with a run with no instrument failure, 124 where every run was a failure of Syntology's instrument)
Page 1 of 31: papers 1 to 100 of 3,094, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Bridge Feature Matching and Cross-Modal Alignment with Mutual-filtering for Zero-shot Anomaly Detection 15 Jul 2025 · 0 repositories · arXiv:2507.11003
-
CATVis: Context-Aware Thought Visualization 15 Jul 2025 · 0 repositories · arXiv:2507.11522
-
DEARLi: Decoupled Enhancement of Recognition and Localization for Semi-supervised Panoptic Segmentation 14 Jul 2025 · 1 repository · arXiv:2507.10118
-
Test-Time Canonicalization by Foundation Models for Robust Perception 14 Jul 2025 · 1 repository · arXiv:2507.10375Syntology official (archive's flag): 5 ran · 5 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Text-Visual Semantic Constrained AI-Generated Image Quality Assessment 14 Jul 2025 · 1 repository · arXiv:2507.10432
-
Calibrated and Robust Foundation Models for Vision-Language and Medical Image Tasks Under Distribution Shift 12 Jul 2025 · 0 repositories · arXiv:2507.09222
-
A Neural Representation Framework with LLM-Driven Spatial Reasoning for Open-Vocabulary 3D Visual Grounding 9 Jul 2025 · 0 repositories · arXiv:2507.06719
-
CultureCLIP: Empowering CLIP with Cultural Awareness through Synthetic Images and Contextualized Captions 8 Jul 2025 · 1 repository · arXiv:2507.06210Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
Integrated Structural Prompt Learning for Vision-Language Models 8 Jul 2025 · 0 repositories · arXiv:2507.05677
-
RSRefSeg 2: Decoupling Referring Remote Sensing Image Segmentation with Foundation Models 8 Jul 2025 · 1 repository · arXiv:2507.06231
-
Semi-Supervised Defect Detection via Conditional Diffusion and CLIP-Guided Noise Filtering 8 Jul 2025 · 1 repository · arXiv:2507.05588
-
An analysis of vision-language models for fabric retrieval 7 Jul 2025 · 0 repositories · arXiv:2507.04735
-
CLIP-Guided Backdoor Defense through Entropy-Based Poisoned Dataset Separation 7 Jul 2025 · 1 repository · arXiv:2507.05113
-
pFedMMA: Personalized Federated Fine-Tuning with Multi-Modal Adapter for Vision-Language Models 7 Jul 2025 · 1 repository · arXiv:2507.05394Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
Beyond Accuracy: Metrics that Uncover What Makes a 'Good' Visual Descriptor 4 Jul 2025 · 1 repository · arXiv:2507.03542
-
Helping CLIP See Both the Forest and the Trees: A Decomposition and Description Approach 4 Jul 2025 · 0 repositories · arXiv:2507.03458
-
Prompt Disentanglement via Language Guidance and Representation Alignment for Domain Generalization 3 Jul 2025 · 0 repositories · arXiv:2507.02288
-
VoteSplat: Hough Voting Gaussian Splatting for 3D Scene Understanding 28 Jun 2025 · 0 repositories · arXiv:2506.22799
-
Q-Frame: Query-aware Frame Selection and Multi-Resolution Adaptation for Video-LLMs 27 Jun 2025 · 0 repositories · arXiv:2506.22139
-
Little By Little: Continual Learning via Self-Activated Sparse Mixture-of-Rank Adaptive Learning 26 Jun 2025 · 0 repositories · arXiv:2506.21035
-
Mitigating Hallucination of Large Vision-Language Models via Dynamic Logits Calibration 26 Jun 2025 · 1 repository · arXiv:2506.21509
-
Multimodal Prompt Alignment for Facial Expression Recognition 26 Jun 2025 · 0 repositories · arXiv:2506.21017
-
ReME: A Data-Centric Framework for Training-Free Open-Vocabulary Segmentation 26 Jun 2025 · 1 repository · arXiv:2506.21233
-
SharpZO: Hybrid Sharpness-Aware Vision Language Model Prompt Tuning via Forward-Only Passes 26 Jun 2025 · 1 repository · arXiv:2506.20990Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 4 pointer-only (licence)
-
Leveraging Vision-Language Models to Select Trustworthy Super-Resolution Samples Generated by Diffusion Models 25 Jun 2025 · 0 repositories · arXiv:2506.20832
-
Unfolding the Past: A Comprehensive Deep Learning Approach to Analyzing Incunabula Pages 22 Jun 2025 · 0 repositories · arXiv:2506.18069
-
Multimodal Political Bias Identification and Neutralization 20 Jun 2025 · 0 repositories · arXiv:2506.17372
-
Prmpt2Adpt: Prompt-Based Zero-Shot Domain Adaptation for Resource-Constrained Environments 20 Jun 2025 · 0 repositories · arXiv:2506.16994
-
Can Common VLMs Rival Medical VLMs? Evaluation and Strategic Insights 19 Jun 2025 · 0 repositories · arXiv:2506.17337
-
Evolutionary Caching to Accelerate Your Off-the-Shelf Diffusion Model 18 Jun 2025 · 1 repository · arXiv:2506.15682Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
EVA02-AT: Egocentric Video-Language Understanding with Spatial-Temporal Rotary Positional Embeddings and Symmetric Optimization 17 Jun 2025 · 1 repository · arXiv:2506.14356
-
Unified Representation Space for 3D Visual Grounding 17 Jun 2025 · 0 repositories · arXiv:2506.14238
-
What's in the Box? Reasoning about Unseen Objects from Multimodal Cues 17 Jun 2025 · 0 repositories · arXiv:2506.14212
-
FreeQ-Graph: Free-form Querying with Semantic Consistent Scene Graph for 3D Scene Understanding 16 Jun 2025 · 0 repositories · arXiv:2506.13629
-
OTFusion: Bridging Vision-only and Vision-Language Models via Optimal Transport for Transductive Zero-Shot Learning 16 Jun 2025 · 0 repositories · arXiv:2506.13723
-
Quantifying Structure in CLIP Embeddings: A Statistical Framework for Concept Interpretation 16 Jun 2025 · 0 repositories · arXiv:2506.13831
-
Quantitative Comparison of Fine-Tuning Techniques for Pretrained Latent Diffusion Models in the Generation of Unseen SAR Image Concepts 16 Jun 2025 · 0 repositories · arXiv:2506.13307
-
NAP-Tuning: Neural Augmented Prompt Tuning for Adversarially Robust Vision-Language Models 15 Jun 2025 · 0 repositories · arXiv:2506.12706
-
InverTune: Removing Backdoors from Multimodal Contrastive Learning Models via Trigger Inversion and Activation Tuning 14 Jun 2025 · 0 repositories · arXiv:2506.12411
-
CLIP the Landscape: Automated Tagging of Crowdsourced Landscape Images 13 Jun 2025 · 1 repository · arXiv:2506.12214
-
ViSAGe: Video-to-Spatial Audio Generation 13 Jun 2025 · 0 repositories · arXiv:2506.12199
-
AniMaker: Automated Multi-Agent Animated Storytelling with MCTS-Driven Clip Generation 12 Jun 2025 · 1 repository · arXiv:2506.10540
-
AIR: Zero-shot Generative Model Adaptation with Iterative Refinement 12 Jun 2025 · 1 repository · arXiv:2506.10895
-
IQE-CLIP: Instance-aware Query Embedding for Zero-/Few-shot Anomaly Detection in Medical Domain 12 Jun 2025 · 1 repository · arXiv:2506.10730
-
Text to Image for Multi-Label Image Recognition with Joint Prompt-Adapter Learning 12 Jun 2025 · 0 repositories · arXiv:2506.10575
-
The Sample Complexity of Parameter-Free Stochastic Convex Optimization 12 Jun 2025 · 0 repositories · arXiv:2506.11336
-
Uncertainty-Aware Deep Learning for Automated Skin Cancer Classification: A Comprehensive Evaluation 12 Jun 2025 · 0 repositories · arXiv:2506.10302
-
A Navigation Framework Utilizing Vision-Language Models 11 Jun 2025 · 1 repository · arXiv:2506.10172
-
Adding simple structure at inference improves Vision-Language Compositionality 11 Jun 2025 · 1 repository · arXiv:2506.09691
-
Harmonizing and Merging Source Models for CLIP-based Domain Generalization 11 Jun 2025 · 0 repositories · arXiv:2506.09446
-
ADAM: Autonomous Discovery and Annotation Model using LLMs for Context-Aware Annotations 10 Jun 2025 · 0 repositories · arXiv:2506.08968
-
ATAS: Any-to-Any Self-Distillation for Enhanced Open-Vocabulary Dense Prediction 10 Jun 2025 · 0 repositories · arXiv:2506.08678
-
DiscoVLA: Discrepancy Reduction in Vision, Language, and Alignment for Parameter-Efficient Video-Text Retrieval 10 Jun 2025 · 1 repository · arXiv:2506.08887Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Fusing Cross-modal and Uni-modal Representations: A Kronecker Product Approach 10 Jun 2025 · 0 repositories · arXiv:2506.08645
-
A Comprehensive Study of Decoder-Only LLMs for Text-to-Image Generation 9 Jun 2025 · 0 repositories · arXiv:2506.08210
-
A Good CREPE needs more than just Sugar: Investigating Biases in Compositional Vision-Language Benchmarks 9 Jun 2025 · 0 repositories · arXiv:2506.08227
-
Circumventing Backdoor Space via Weight Symmetry 9 Jun 2025 · 1 repository · arXiv:2506.07467
-
Highly Compressed Tokenizer Can Generate Without Training 9 Jun 2025 · 1 repository · arXiv:2506.08257
-
Vision Transformers Don't Need Trained Registers 9 Jun 2025 · 1 repository · arXiv:2506.08010Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
VIVAT: Virtuous Improving VAE Training through Artifact Mitigation 9 Jun 2025 · 0 repositories · arXiv:2506.07863
-
A Narrative Review on Large AI Models in Lung Cancer Screening, Diagnosis, and Treatment Planning 8 Jun 2025 · 0 repositories · arXiv:2506.07236
-
Experimental Evaluation of Static Image Sub-Region-Based Search Models Using CLIP 7 Jun 2025 · 0 repositories · arXiv:2506.06938
-
The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-24 7 Jun 2025 · 0 repositories · arXiv:2506.06743
-
Noise Consistency Regularization for Improved Subject-Driven Image Synthesis 6 Jun 2025 · 0 repositories · arXiv:2506.06483
-
Beyond Cropped Regions: New Benchmark and Corresponding Baseline for Chinese Scene Text Retrieval in Diverse Layouts 5 Jun 2025 · 0 repositories · arXiv:2506.04999
-
Handle-based Mesh Deformation Guided By Vision Language Model 5 Jun 2025 · 0 repositories · arXiv:2506.04562
-
Scaling Laws for Robust Comparison of Open Foundation Language-Vision Models and Datasets 5 Jun 2025 · 2 repositories · arXiv:2506.04598
-
Tuning the Right Foundation Models is What you Need for Partial Label Learning 5 Jun 2025 · 1 repository · arXiv:2506.05027
-
Normalize Filters! Classical Wisdom for Deep Vision 4 Jun 2025 · 0 repositories · arXiv:2506.04401
-
Attacking Attention of Foundation Models Disrupts Downstream Tasks 3 Jun 2025 · 1 repository · arXiv:2506.05394
-
Flexiffusion: Training-Free Segment-Wise Neural Architecture Search for Efficient Diffusion Models 3 Jun 2025 · 0 repositories · arXiv:2506.02488
-
Robustness in Both Domains: CLIP Needs a Robust Text Encoder 3 Jun 2025 · 0 repositories · arXiv:2506.03355Syntology 9 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Advancing Compositional Awareness in CLIP with Efficient Fine-Tuning 30 May 2025 · 0 repositories · arXiv:2505.24424
-
Conformal Prediction for Zero-Shot Models 30 May 2025 · 1 repository · arXiv:2505.24693Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
SiLVR: A Simple Language-based Video Reasoning Framework 30 May 2025 · 1 repository · arXiv:2505.24869
-
un²CLIP: Improving CLIP's Visual Detail Capturing Ability via Inverting unCLIP 30 May 2025 · 1 repository · arXiv:2505.24517
-
Adversarial Semantic and Label Perturbation Attack for Pedestrian Attribute Recognition 29 May 2025 · 2 repositories · arXiv:2505.23313
-
CLDTracker: A Comprehensive Language Description for Visual Tracking 29 May 2025 · 1 repository · arXiv:2505.23704
-
CURVE: CLIP-Utilized Reinforcement Learning for Visual Image Enhancement via Simple Image Processing 29 May 2025 · 0 repositories · arXiv:2505.23102
-
Deep Modeling and Optimization of Medical Image Classification 29 May 2025 · 1 repository · arXiv:2505.23040
-
Fine-Tuning Next-Scale Visual Autoregressive Models with Group Relative Policy Optimization 29 May 2025 · 0 repositories · arXiv:2505.23331
-
Implicit Inversion turns CLIP into a Decoder 29 May 2025 · 1 repository · arXiv:2505.23161
-
LADA: Scalable Label-Specific CLIP Adapter for Continual Learning 29 May 2025 · 1 repository · arXiv:2505.23271Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
QLIP: A Dynamic Quadtree Vision Prior Enhances MLLM Performance Without Retraining 29 May 2025 · 1 repository · arXiv:2505.23004
-
ScaleLong: A Multi-Timescale Benchmark for Long Video Understanding 29 May 2025 · 1 repository · arXiv:2505.23922
-
The Entropy Mechanism of Reinforcement Learning for Reasoning Language Models 28 May 2025 · 0 repositories · arXiv:2505.22617
-
Can Visual Encoder Learn to See Arrows? 26 May 2025 · 0 repositories · arXiv:2505.19944
-
CCL-LGS: Contrastive Codebook Learning for 3D Language Gaussian Splatting 26 May 2025 · 0 repositories · arXiv:2505.20469
-
Correlating instruction-tuning (in multimodal models) with vision-language processing (in the brain) 26 May 2025 · 1 repository · arXiv:2505.20029Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
DiSa: Directional Saliency-Aware Prompt Learning for Generalizable Vision-Language Models 26 May 2025 · 0 repositories · arXiv:2505.19373
-
From What to How: Attributing CLIP's Latent Components Reveals Unexpected Semantic Reliance 26 May 2025 · 1 repository · arXiv:2505.20229
-
Hard Negative Contrastive Learning for Fine-Grained Geometric Understanding in Large Multimodal Models 26 May 2025 · 1 repository · arXiv:2505.20152
-
Locality-Aware Zero-Shot Human-Object Interaction Detection 26 May 2025 · 1 repository · arXiv:2505.19503
-
One Surrogate to Fool Them All: Universal, Transferable, and Targeted Adversarial Attacks with CLIP 26 May 2025 · 1 repository · arXiv:2505.19840
-
StyleAR: Customizing Multimodal Autoregressive Model for Style-Aligned Text-to-Image Generation 26 May 2025 · 0 repositories · arXiv:2505.19874
-
Two Causally Related Needles in a Video Haystack 26 May 2025 · 0 repositories · arXiv:2505.19853
-
AmorLIP: Efficient Language-Image Pretraining via Amortization 25 May 2025 · 1 repository · arXiv:2505.18983
-
Distill CLIP (DCLIP): Enhancing Image-Text Retrieval via Cross-Modal Transformer Distillation 25 May 2025 · 0 repositories · arXiv:2505.21549
-
DocMMIR: A Framework for Document Multi-modal Information Retrieval 25 May 2025 · 0 repositories · arXiv:2505.19312
-
GhostPrompt: Jailbreaking Text-to-image Generative Models based on Dynamic Optimization 25 May 2025 · 0 repositories · arXiv:2505.18979
Tasks archive 2025-07-28
20 shown of 947 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| Retrieval | 336 |
| Language Modelling | 297 |
| Zero-Shot Learning | 253 |
| Image Classification | 250 |
| Image Generation | 245 |
| Contrastive Learning | 228 |
| Semantic Segmentation | 219 |
| image-classification | 218 |
| Language Modeling | 193 |
| Prompt Learning | 162 |
| Segmentation | 161 |
| zero-shot-classification | 158 |
| Representation Learning | 143 |
| Object | 142 |
| Image Captioning | 117 |
| Object Detection | 117 |
| object-detection | 115 |
| Text-to-Image Generation | 109 |
| Transfer Learning | 107 |
| Image Retrieval | 106 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections