{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/simclr","slug":"simclr","name":"SimCLR","full_name":"SimCLR","full_name_withheld":false,"description_markdown":"**SimCLR** is a framework for contrastive learning of visual representations. It learns representations by maximizing agreement between differently augmented views of the same data example via a contrastive loss in the latent space. It consists of:\r\n\r\n- A stochastic data augmentation module that transforms any given data example randomly resulting in two correlated views of the same example, denoted $\\mathbf{\\tilde{x}\\_{i}}$ and $\\mathbf{\\tilde{x}\\_{j}}$, which is considered a positive pair. SimCLR sequentially applies three simple augmentations: random cropping followed by resize back to the original size, random color distortions, and [random Gaussian blur](https://paperswithcode.com/method/random-gaussian-blur). The authors find random crop and color distortion is crucial to achieve good performance.\r\n\r\n- A neural network base encoder $f\\left(·\\right)$ that extracts representation vectors from augmented data examples. The framework allows various choices of the network architecture without any constraints. The authors opt for simplicity and adopt [ResNet](https://paperswithcode.com/method/resnet) to obtain $h\\_{i} = f\\left(\\mathbf{\\tilde{x}}\\_{i}\\right) = \\text{ResNet}\\left(\\mathbf{\\tilde{x}}\\_{i}\\right)$ where $h\\_{i} \\in \\mathbb{R}^{d}$ is the output after the [average pooling](https://paperswithcode.com/method/average-pooling) layer.\r\n\r\n- A small neural network projection head $g\\left(·\\right)$ that maps representations to the space where contrastive loss is applied. Authors use a MLP with one hidden layer to obtain $z\\_{i} = g\\left(h\\_{i}\\right) = W^{(2)}\\sigma\\left(W^{(1)}h\\_{i}\\right)$ where $\\sigma$ is a [ReLU](https://paperswithcode.com/method/relu) nonlinearity. The authors find it beneficial to define the contrastive loss on $z\\_{i}$’s rather than $h\\_{i}$’s.\r\n\r\n- A contrastive loss function defined for a contrastive prediction task. Given a set {$\\mathbf{\\tilde{x}}\\_{k}$} including a positive pair of examples $\\mathbf{\\tilde{x}}\\_{i}$ and $\\mathbf{\\tilde{x}\\_{j}}$ , the contrastive prediction task aims to identify $\\mathbf{\\tilde{x}}\\_{j}$ in {$\\mathbf{\\tilde{x}}\\_{k}$}$\\_{k\\neq{i}}$ for a given $\\mathbf{\\tilde{x}}\\_{i}$.\r\n\r\nA minibatch of $N$ examples is randomly sampled and the contrastive prediction task is defined on pairs of augmented examples derived from the minibatch, resulting in $2N$ data points. Negative examples are not sampled explicitly. Instead, given a positive pair, the other $2(N − 1)$ augmented examples within a minibatch are treated as negative examples. A [NT-Xent](https://paperswithcode.com/method/nt-xent) (the normalized\r\ntemperature-scaled cross entropy loss) loss function is used (see components).","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/2002.05709v3","title":"A Simple Framework for Contrastive Learning of Visual Representations","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/google-research/simclr","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Self-Supervised Learning","url":"/methods/category/self-supervised-learning","pwc_aliases":[]}],"n_papers_tagged":240,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"slug":"probabilistic-variational-contrastive","title":"Probabilistic Variational Contrastive Learning","date":"2025-06-11","arxiv_id":"2506.10159","n_code_links":0,"syntology":null},{"paper":"/paper/2506-10031","slug":"2506-10031","title":"scSSL-Bench: Benchmarking Self-Supervised Learning for Single-Cell Data","date":"2025-06-10","arxiv_id":"2506.10031","n_code_links":1,"syntology":null},{"paper":"/paper/circumventing-backdoor-space-via-weight","slug":"circumventing-backdoor-space-via-weight","title":"Circumventing Backdoor Space via Weight Symmetry","date":"2025-06-09","arxiv_id":"2506.07467","n_code_links":1,"syntology":null},{"paper":"/paper/ssps-self-supervised-positive-sampling-for","slug":"ssps-self-supervised-positive-sampling-for","title":"SSPS: Self-Supervised Positive Sampling for Robust Self-Supervised Speaker Verification","date":"2025-05-20","arxiv_id":"2505.14561","n_code_links":1,"syntology":null},{"paper":null,"slug":"representation-learning-via-non-contrastive","title":"Representation Learning via Non-Contrastive Mutual Information","date":"2025-04-23","arxiv_id":"2504.16667","n_code_links":0,"syntology":null},{"paper":null,"slug":"impact-of-language-guidance-a-reproducibility","title":"Impact of Language Guidance: A Reproducibility Study","date":"2025-04-10","arxiv_id":"2504.08140","n_code_links":0,"syntology":null},{"paper":null,"slug":"unsupervised-detection-of-fraudulent","title":"Unsupervised Detection of Fraudulent Transactions in E-commerce Using Contrastive Learning","date":"2025-03-24","arxiv_id":"2503.18841","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-statistical-theory-of-contrastive-learning","title":"A Statistical Theory of Contrastive Learning via Approximate Sufficient Statistics","date":"2025-03-21","arxiv_id":"2503.17538","n_code_links":0,"syntology":null},{"paper":null,"slug":"sinsim-sinkhorn-regularized-simclr","title":"SinSim: Sinkhorn-Regularized SimCLR","date":"2025-02-13","arxiv_id":"2502.10478","n_code_links":0,"syntology":null},{"paper":"/paper/dataset-ownership-verification-in-contrastive","slug":"dataset-ownership-verification-in-contrastive","title":"Dataset Ownership Verification in Contrastive Pre-trained Models","date":"2025-02-11","arxiv_id":"2502.07276","n_code_links":1,"syntology":null},{"paper":"/paper/self-supervised-frameworks-for-speaker","slug":"self-supervised-frameworks-for-speaker","title":"Self-Supervised Frameworks for Speaker Verification via Bootstrapped Positive Sampling","date":"2025-01-29","arxiv_id":"2501.17772","n_code_links":1,"syntology":null},{"paper":"/paper/enhancing-contrastive-learning-inspired-by","slug":"enhancing-contrastive-learning-inspired-by","title":"Enhancing Contrastive Learning Inspired by the Philosophy of \"The Blind Men and the Elephant\"","date":"2024-12-21","arxiv_id":"2412.16522","n_code_links":1,"syntology":null},{"paper":null,"slug":"self-supervised-radiograph-anatomical-region","title":"Self-Supervised Radiograph Anatomical Region Classification -- How Clean Is Your Real-World Data?","date":"2024-12-20","arxiv_id":"2412.15967","n_code_links":0,"syntology":null},{"paper":null,"slug":"maximising-histopathology-segmentation-using","title":"Maximising Histopathology Segmentation using Minimal Labels via Self-Supervision","date":"2024-12-19","arxiv_id":"2412.15389","n_code_links":0,"syntology":null},{"paper":"/paper/amclr-unified-augmented-learning-for-cross","slug":"amclr-unified-augmented-learning-for-cross","title":"AmCLR: Unified Augmented Learning for Cross-Modal Representations","date":"2024-12-10","arxiv_id":"2412.07979","n_code_links":1,"syntology":null},{"paper":null,"slug":"mitigating-instance-dependent-label-noise","title":"Mitigating Instance-Dependent Label Noise: Integrating Self-Supervised Pretraining with Pseudo-Label Refinement","date":"2024-12-06","arxiv_id":"2412.04898","n_code_links":0,"syntology":null},{"paper":"/paper/tight-pac-bayesian-risk-certificates-for","slug":"tight-pac-bayesian-risk-certificates-for","title":"Tight PAC-Bayesian Risk Certificates for Contrastive Learning","date":"2024-12-04","arxiv_id":"2412.03486","n_code_links":1,"syntology":null},{"paper":null,"slug":"explorations-in-self-supervised-learning","title":"Explorations in Self-Supervised Learning: Dataset Composition Testing for Object Classification","date":"2024-12-01","arxiv_id":"2412.00770","n_code_links":0,"syntology":null},{"paper":"/paper/breccia-and-basalt-classification-of-thin","slug":"breccia-and-basalt-classification-of-thin","title":"Breccia and basalt classification of thin sections of Apollo rocks with deep learning","date":"2024-10-28","arxiv_id":"2410.21024","n_code_links":1,"syntology":null},{"paper":null,"slug":"accelerating-augmentation-invariance","title":"Accelerating Augmentation Invariance Pretraining","date":"2024-10-27","arxiv_id":"2410.22364","n_code_links":0,"syntology":null},{"paper":null,"slug":"rethinking-positive-pairs-in-contrastive","title":"Rethinking Positive Pairs in Contrastive Learning","date":"2024-10-23","arxiv_id":"2410.18200","n_code_links":0,"syntology":null},{"paper":null,"slug":"sigclr-sigmoid-contrastive-learning-of-visual","title":"SigCLR: Sigmoid Contrastive Learning of Visual Representations","date":"2024-10-22","arxiv_id":"2410.17427","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-supervised-anomaly-detection-in-the-wild","title":"Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods","date":"2024-10-05","arxiv_id":"2410.04289","n_code_links":0,"syntology":null},{"paper":null,"slug":"bissl-bilevel-optimization-for-self","title":"BiSSL: Enhancing the Alignment Between Self-Supervised Pretraining and Downstream Fine-Tuning via Bilevel Optimization","date":"2024-10-03","arxiv_id":"2410.02387","n_code_links":0,"syntology":null},{"paper":null,"slug":"understanding-the-benefits-of-simclr-pre","title":"Understanding the Benefits of SimCLR Pre-Training in Two-Layer Convolutional Neural Networks","date":"2024-09-27","arxiv_id":"2409.18685","n_code_links":0,"syntology":null},{"paper":"/paper/self-supervised-pretraining-for-1","slug":"self-supervised-pretraining-for-1","title":"Self-supervised Pretraining for Cardiovascular Magnetic Resonance Cine Segmentation","date":"2024-09-26","arxiv_id":"2409.18100","n_code_links":1,"syntology":null},{"paper":"/paper/cross-model-cross-stream-learning-for-self","slug":"cross-model-cross-stream-learning-for-self","title":"Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition","date":"2024-09-23","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"contrastive-learning-for-character-detection","title":"Contrastive Learning for Character Detection in Ancient Greek Papyri","date":"2024-09-16","arxiv_id":"2409.10156","n_code_links":0,"syntology":null},{"paper":null,"slug":"label-free-monitoring-of-self-supervised","title":"Label-free Monitoring of Self-Supervised Learning Progress","date":"2024-09-10","arxiv_id":"2409.06612","n_code_links":0,"syntology":null},{"paper":"/paper/learning-tree-structured-composition-of-data","slug":"learning-tree-structured-composition-of-data","title":"Learning Tree-Structured Composition of Data Augmentation","date":"2024-08-26","arxiv_id":"2408.14381","n_code_links":1,"syntology":null},{"paper":"/paper/improving-nonlinear-projection-heads-using","slug":"improving-nonlinear-projection-heads-using","title":"Improving Nonlinear Projection Heads using Pretrained Autoencoder Embeddings","date":"2024-08-25","arxiv_id":"2408.14514","n_code_links":1,"syntology":null},{"paper":"/paper/cnn-jepa-self-supervised-pretraining","slug":"cnn-jepa-self-supervised-pretraining","title":"CNN-JEPA: Self-Supervised Pretraining Convolutional Neural Networks Using Joint Embedding Predictive Architecture","date":"2024-08-14","arxiv_id":"2408.07514","n_code_links":1,"syntology":null},{"paper":"/paper/mixing-natural-and-synthetic-images-for","slug":"mixing-natural-and-synthetic-images-for","title":"MixDiff: Mixing Natural and Synthetic Images for Robust Self-Supervised Representations","date":"2024-06-18","arxiv_id":"2406.12368","n_code_links":1,"syntology":null},{"paper":"/paper/scale-translation-equivariant-network-for","slug":"scale-translation-equivariant-network-for","title":"Scale-Translation Equivariant Network for Oceanic Internal Solitary Wave Localization","date":"2024-06-18","arxiv_id":"2406.13060","n_code_links":1,"syntology":null},{"paper":null,"slug":"latent-representation-matters-human-like","title":"Latent Representation Matters: Human-like Sketches in One-shot Drawing Tasks","date":"2024-06-10","arxiv_id":"2406.06079","n_code_links":0,"syntology":null},{"paper":null,"slug":"alignment-calibration-machine-unlearning-for","title":"Alignment Calibration: Machine Unlearning for Contrastive Learning under Auditing","date":"2024-06-05","arxiv_id":"2406.03603","n_code_links":0,"syntology":null},{"paper":null,"slug":"maximum-manifold-capacity-representations-in","title":"Maximum Manifold Capacity Representations in State Representation Learning","date":"2024-05-22","arxiv_id":"2405.13848","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-mutual-information-perspective-on-federated","title":"A Mutual Information Perspective on Federated Contrastive Learning","date":"2024-05-03","arxiv_id":"2405.02081","n_code_links":0,"syntology":null},{"paper":"/paper/self-supervised-learning-for-classifying","slug":"self-supervised-learning-for-classifying","title":"Self-supervised learning for classifying paranasal anomalies in the maxillary sinus","date":"2024-04-29","arxiv_id":"2404.18599","n_code_links":1,"syntology":null},{"paper":"/paper/additive-margin-in-contrastive-self","slug":"additive-margin-in-contrastive-self","title":"Additive Margin in Contrastive Self-Supervised Frameworks to Learn Discriminative Speaker Representations","date":"2024-04-23","arxiv_id":"2404.14913","n_code_links":1,"syntology":null},{"paper":"/paper/comparing-self-supervised-learning-techniques","slug":"comparing-self-supervised-learning-techniques","title":"Comparing Self-Supervised Learning Techniques for Wearable Human Activity Recognition","date":"2024-04-08","arxiv_id":"2404.15331","n_code_links":1,"syntology":null},{"paper":null,"slug":"self-supervised-backbone-framework-for","title":"Self-Supervised Backbone Framework for Diverse Agricultural Vision Tasks","date":"2024-03-22","arxiv_id":"2403.15248","n_code_links":0,"syntology":null},{"paper":"/paper/do-generated-data-always-help-contrastive","slug":"do-generated-data-always-help-contrastive","title":"Do Generated Data Always Help Contrastive Learning?","date":"2024-03-19","arxiv_id":"2403.12448","n_code_links":1,"syntology":{"ran":6,"of":7,"n_ran_checked":3,"n_instrument":3,"unverified":1,"pointer_only":7,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified","official":{"repos":["pku-ml/adainf"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/car-damage-detection-and-patch-to-patch-self","slug":"car-damage-detection-and-patch-to-patch-self","title":"Car Damage Detection and Patch-to-Patch Self-supervised Image Alignment","date":"2024-03-11","arxiv_id":"2403.06674","n_code_links":1,"syntology":{"ran":10,"of":13,"n_ran_checked":5,"n_instrument":5,"unverified":3,"pointer_only":13,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 1 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified","official":{"repos":["2000222/car-damage-detectionv0"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"poly-view-contrastive-learning","title":"Poly-View Contrastive Learning","date":"2024-03-08","arxiv_id":"2403.05490","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-supervised-multiple-instance-learning","title":"Self-Supervised Multiple Instance Learning for Acute Myeloid Leukemia Classification","date":"2024-03-08","arxiv_id":"2403.05379","n_code_links":0,"syntology":null},{"paper":null,"slug":"multimodal-transformer-for-comics-text-cloze","title":"Multimodal Transformer for Comics Text-Cloze","date":"2024-03-06","arxiv_id":"2403.03719","n_code_links":0,"syntology":null},{"paper":"/paper/self-supervised-visualisation-of-medical","slug":"self-supervised-visualisation-of-medical","title":"Self-supervised Visualisation of Medical Image Datasets","date":"2024-02-22","arxiv_id":"2402.14566","n_code_links":1,"syntology":null},{"paper":"/paper/the-common-stability-mechanism-behind-most","slug":"the-common-stability-mechanism-behind-most","title":"The Common Stability Mechanism behind most Self-Supervised Learning Approaches","date":"2024-02-22","arxiv_id":"2402.14957","n_code_links":1,"syntology":null},{"paper":"/paper/avoiding-feature-suppression-in-contrastive","slug":"avoiding-feature-suppression-in-contrastive","title":"Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning","date":"2024-02-19","arxiv_id":"2402.11816","n_code_links":1,"syntology":null},{"paper":null,"slug":"cochceps-augment-a-novel-self-supervised","title":"CochCeps-Augment: A Novel Self-Supervised Contrastive Learning Using Cochlear Cepstrum-based Masking for Speech Emotion Recognition","date":"2024-02-10","arxiv_id":"2402.06923","n_code_links":0,"syntology":null},{"paper":"/paper/a-probabilistic-model-to-explain-self","slug":"a-probabilistic-model-to-explain-self","title":"A Probabilistic Model Behind Self-Supervised Learning","date":"2024-02-02","arxiv_id":"2402.01399","n_code_links":1,"syntology":{"ran":9,"of":10,"n_ran_checked":6,"n_instrument":3,"unverified":1,"pointer_only":10,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified","official":{"repos":["alicebizeul/simvae"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/optimizing-contrastive-learning-for-cortical","slug":"optimizing-contrastive-learning-for-cortical","title":"Optimizing contrastive learning for cortical folding pattern detection","date":"2024-01-31","arxiv_id":"2401.18035","n_code_links":1,"syntology":null},{"paper":null,"slug":"detecting-and-recognizing-characters-in-greek","title":"Detecting and recognizing characters in Greek papyri with YOLOv8, DeiT and SimCLR","date":"2024-01-23","arxiv_id":"2401.12513","n_code_links":0,"syntology":null},{"paper":null,"slug":"enhancing-contrastive-learning-with-efficient","title":"Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing","date":"2024-01-11","arxiv_id":"2401.05730","n_code_links":0,"syntology":null},{"paper":"/paper/automated-detection-of-myopic-maculopathy-in","slug":"automated-detection-of-myopic-maculopathy-in","title":"Automated Detection of Myopic Maculopathy in MMAC 2023: Achievements in Classification, Segmentation, and Spherical Equivalent Prediction","date":"2024-01-08","arxiv_id":"2401.03615","n_code_links":1,"syntology":null},{"paper":"/paper/gps-ssl-guided-positive-sampling-to-inject","slug":"gps-ssl-guided-positive-sampling-to-inject","title":"GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning","date":"2024-01-03","arxiv_id":"2401.01990","n_code_links":1,"syntology":null},{"paper":null,"slug":"time-series-contrastive-learning-against","title":"Time-Series Contrastive Learning against False Negatives and Class Imbalance","date":"2023-12-19","arxiv_id":"2312.11939","n_code_links":0,"syntology":null},{"paper":null,"slug":"sassl-enhancing-self-supervised-learning-via","title":"SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer","date":"2023-12-02","arxiv_id":"2312.01187","n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-left-right-wearable-sensors-imus","title":"Contrastive Left-Right Wearable Sensors (IMUs) Consistency Matching for HAR","date":"2023-11-21","arxiv_id":"2311.12674","n_code_links":0,"syntology":null},{"paper":null,"slug":"lesion-search-with-self-supervised-learning","title":"Lesion Search with Self-supervised Learning","date":"2023-11-18","arxiv_id":"2311.11014","n_code_links":0,"syntology":null},{"paper":null,"slug":"samclr-contrastive-pre-training-on-complex","title":"SAMCLR: Contrastive pre-training on complex scenes using SAM for view sampling","date":"2023-10-23","arxiv_id":"2310.14736","n_code_links":0,"syntology":null},{"paper":"/paper/arniqa-learning-distortion-manifold-for-image","slug":"arniqa-learning-distortion-manifold-for-image","title":"ARNIQA: Learning Distortion Manifold for Image Quality Assessment","date":"2023-10-20","arxiv_id":"2310.14918","n_code_links":1,"syntology":{"ran":5,"of":5,"n_ran_checked":5,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["miccunifi/arniqa"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"an-empirical-study-of-simplicial","title":"An Empirical Study of Self-supervised Learning with Wasserstein Distance","date":"2023-10-16","arxiv_id":"2310.10143","n_code_links":0,"syntology":null},{"paper":"/paper/adaptive-multi-head-contrastive-learning","slug":"adaptive-multi-head-contrastive-learning","title":"Adaptive Multi-head Contrastive Learning","date":"2023-10-09","arxiv_id":"2310.05615","n_code_links":1,"syntology":null},{"paper":null,"slug":"urlost-unsupervised-representation-learning","title":"URLOST: Unsupervised Representation Learning without Stationarity or Topology","date":"2023-10-06","arxiv_id":"2310.04496","n_code_links":0,"syntology":null},{"paper":"/paper/hard-view-selection-for-contrastive-learning","slug":"hard-view-selection-for-contrastive-learning","title":"Beyond Random Augmentations: Pretraining with Hard Views","date":"2023-10-05","arxiv_id":"2310.03940","n_code_links":2,"syntology":null},{"paper":null,"slug":"scalenet-an-unsupervised-representation","title":"ScaleNet: An Unsupervised Representation Learning Method for Limited Information","date":"2023-10-03","arxiv_id":"2310.02386","n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-speaker-embedding-with-sequential","title":"Contrastive Speaker Embedding With Sequential Disentanglement","date":"2023-09-23","arxiv_id":"2309.13253","n_code_links":0,"syntology":null},{"paper":"/paper/flsl-feature-level-self-supervised-learning","slug":"flsl-feature-level-self-supervised-learning","title":"FLSL: Feature-level Self-supervised Learning","date":"2023-09-21","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/identifiable-contrastive-learning-with","slug":"identifiable-contrastive-learning-with","title":"Identifiable Contrastive Learning with Automatic Feature Importance Discovery","date":"2023-09-21","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"optimizing-audio-augmentations-for","title":"Optimizing Audio Augmentations for Contrastive Learning of Health-Related Acoustic Signals","date":"2023-09-11","arxiv_id":"2309.05843","n_code_links":0,"syntology":null},{"paper":null,"slug":"adapting-self-supervised-representations-to","title":"Adapting Self-Supervised Representations to Multi-Domain Setups","date":"2023-09-07","arxiv_id":"2309.03999","n_code_links":0,"syntology":null},{"paper":"/paper/dystress-dynamically-scaled-temperature-in","slug":"dystress-dynamically-scaled-temperature-in","title":"Dynamically Scaled Temperature in Self-Supervised Contrastive Learning","date":"2023-08-02","arxiv_id":"2308.01140","n_code_links":1,"syntology":null},{"paper":null,"slug":"pretrained-deep-models-outperform-gbdts-in","title":"Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcity","date":"2023-07-31","arxiv_id":"2308.00177","n_code_links":0,"syntology":null},{"paper":"/paper/visual-geo-localization-with-self-supervised","slug":"visual-geo-localization-with-self-supervised","title":"VG-SSL: Benchmarking Self-supervised Representation Learning Approaches for Visual Geo-localization","date":"2023-07-31","arxiv_id":"2308.00090","n_code_links":1,"syntology":null},{"paper":null,"slug":"geometry-aware-adaptation-for-pretrained","title":"Geometry-Aware Adaptation for Pretrained Models","date":"2023-07-23","arxiv_id":"2307.12226","n_code_links":0,"syntology":null},{"paper":null,"slug":"hallucination-improves-the-performance-of","title":"Hallucination Improves the Performance of Unsupervised Visual Representation Learning","date":"2023-07-22","arxiv_id":"2307.12168","n_code_links":0,"syntology":null},{"paper":null,"slug":"sequential-multi-dimensional-self-supervised","title":"Sequential Multi-Dimensional Self-Supervised Learning for Clinical Time Series","date":"2023-07-20","arxiv_id":"2307.10923","n_code_links":0,"syntology":null},{"paper":"/paper/accuracy-versus-time-frontiers-of-semi","slug":"accuracy-versus-time-frontiers-of-semi","title":"Systematic comparison of semi-supervised and self-supervised learning for medical image classification","date":"2023-07-18","arxiv_id":"2307.08919","n_code_links":1,"syntology":null},{"paper":"/paper/joint-adversarial-and-collaborative-learning","slug":"joint-adversarial-and-collaborative-learning","title":"Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition","date":"2023-07-15","arxiv_id":"2307.07791","n_code_links":2,"syntology":null},{"paper":null,"slug":"substance-or-style-what-does-your-image","title":"Substance or Style: What Does Your Image Embedding Know?","date":"2023-07-10","arxiv_id":"2307.05610","n_code_links":0,"syntology":null},{"paper":"/paper/duet-2d-structured-and-approximately","slug":"duet-2d-structured-and-approximately","title":"DUET: 2D Structured and Approximately Equivariant Representations","date":"2023-06-28","arxiv_id":"2306.16058","n_code_links":1,"syntology":{"ran":9,"of":15,"n_ran_checked":8,"n_instrument":1,"unverified":6,"pointer_only":15,"phrase":"9 ran (of which 5 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified","official":{"repos":["apple/ml-duet"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":5,"n_ran_no_instrument_failure":8,"n_unverified":6,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"semantic-positive-pairs-for-enhancing","title":"Semantic Positive Pairs for Enhancing Visual Representation Learning of Instance Discrimination methods","date":"2023-06-28","arxiv_id":"2306.16122","n_code_links":0,"syntology":null},{"paper":null,"slug":"scorecl-augmentation-adaptive-contrastive","title":"ScoreCL: Augmentation-Adaptive Contrastive Learning via Score-Matching Function","date":"2023-06-07","arxiv_id":"2306.04175","n_code_links":0,"syntology":null},{"paper":"/paper/batchsampler-sampling-mini-batches-for","slug":"batchsampler-sampling-mini-batches-for","title":"BatchSampler: Sampling Mini-Batches for Contrastive Learning in Vision, Language, and Graphs","date":"2023-06-06","arxiv_id":"2306.03355","n_code_links":1,"syntology":null},{"paper":"/paper/stablerep-synthetic-images-from-text-to-image","slug":"stablerep-synthetic-images-from-text-to-image","title":"StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learners","date":"2023-06-01","arxiv_id":"2306.00984","n_code_links":2,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["google-research/syn-rep-learn"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/augmentation-aware-self-supervised-learning","slug":"augmentation-aware-self-supervised-learning","title":"Augmentation-aware Self-supervised Learning with Conditioned Projector","date":"2023-05-31","arxiv_id":"2306.06082","n_code_links":1,"syntology":{"ran":4,"of":9,"n_ran_checked":0,"n_instrument":4,"unverified":5,"pointer_only":9,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified","official":{"repos":["gmum/cassle"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":5,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"morphological-classification-of-radio-1","title":"Morphological Classification of Radio Galaxies using Semi-Supervised Group Equivariant CNNs","date":"2023-05-31","arxiv_id":"2306.00031","n_code_links":0,"syntology":null},{"paper":"/paper/mt-slvr-multi-task-self-supervised-learning","slug":"mt-slvr-multi-task-self-supervised-learning","title":"MT-SLVR: Multi-Task Self-Supervised Learning for Transformation In(Variant) Representations","date":"2023-05-29","arxiv_id":"2305.17191","n_code_links":1,"syntology":null},{"paper":"/paper/kernel-ssl-kernel-kl-divergence-for-self","slug":"kernel-ssl-kernel-kl-divergence-for-self","title":"Matrix Information Theory for Self-Supervised Learning","date":"2023-05-27","arxiv_id":"2305.17326","n_code_links":3,"syntology":{"ran":5,"of":5,"n_ran_checked":1,"n_instrument":4,"unverified":0,"pointer_only":5,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified","official":{"repos":["yifanzhang-pro/matrix-llm","yifanzhang-pro/matrix-ssl"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official","unlocated"]}}},{"paper":"/paper/not-all-semantics-are-created-equal","slug":"not-all-semantics-are-created-equal","title":"Not All Semantics are Created Equal: Contrastive Self-supervised Learning with Automatic Temperature Individualization","date":"2023-05-19","arxiv_id":"2305.11965","n_code_links":1,"syntology":null},{"paper":null,"slug":"tuned-contrastive-learning","title":"Tuned Contrastive Learning","date":"2023-05-18","arxiv_id":"2305.10675","n_code_links":0,"syntology":null},{"paper":"/paper/state-representation-learning-using-an","slug":"state-representation-learning-using-an","title":"State Representation Learning Using an Unbalanced Atlas","date":"2023-05-17","arxiv_id":"2305.10267","n_code_links":1,"syntology":null},{"paper":"/paper/learning-better-contrastive-view-from","slug":"learning-better-contrastive-view-from","title":"Learning Better Contrastive View from Radiologist's Gaze","date":"2023-05-15","arxiv_id":"2305.08826","n_code_links":1,"syntology":null},{"paper":null,"slug":"objectives-matter-understanding-the-impact-of","title":"Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations","date":"2023-04-25","arxiv_id":"2304.13089","n_code_links":0,"syntology":null},{"paper":null,"slug":"explaining-analyzing-and-probing","title":"Explaining, Analyzing, and Probing Representations of Self-Supervised Learning Models for Sensor-based Human Activity Recognition","date":"2023-04-14","arxiv_id":"2304.07304","n_code_links":0,"syntology":null},{"paper":"/paper/a-contrastive-method-based-on-elevation-data","slug":"a-contrastive-method-based-on-elevation-data","title":"Enhancing Self-Supervised Learning for Remote Sensing with Elevation Data: A Case Study with Scarce And High Level Semantic Labels","date":"2023-04-13","arxiv_id":"2304.06857","n_code_links":1,"syntology":null},{"paper":null,"slug":"constructive-assimilation-boosting","title":"Constructive Assimilation: Boosting Contrastive Learning Performance through View Generation Strategies","date":"2023-04-02","arxiv_id":"2304.00601","n_code_links":0,"syntology":null},{"paper":"/paper/large-scale-pretraining-on-pathological","slug":"large-scale-pretraining-on-pathological","title":"Large-scale pretraining on pathological images for fine-tuning of small pathological benchmarks","date":"2023-03-28","arxiv_id":"2303.15693","n_code_links":1,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":240,"with_a_code_link":127,"where_syntology_ran_a_sample":38,"not_listed_spam_title":0,"listed":240,"listed_where_code_ran":38,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":33,"every_run_a_failure_of_syntologys_instrument":5,"listed_with_a_run_with_no_instrument_failure":33,"listed_every_run_a_failure_of_syntologys_instrument":5,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":38,"papers_where_code_ran_first_page":"/method/simclr/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":3,"url":"/method/simclr/papers/2","json":"/method/simclr/papers/2.json","rows":100},{"order":"archive","page":3,"of":3,"url":"/method/simclr/papers/3","json":"/method/simclr/papers/3.json","rows":40},{"order":"ran","page":1,"of":1,"url":"/method/simclr/papers/ran/1","json":"/method/simclr/papers/ran/1.json","rows":38}],"tasks":[{"task":"/task/self-supervised-learning","name":"Self-Supervised Learning","papers":120},{"task":"/task/contrastive-learning","name":"Contrastive Learning","papers":116},{"task":"/task/representation-learning","name":"Representation Learning","papers":79},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":29},{"task":"/task/image-classification","name":"Image Classification","papers":22},{"task":"/task/image-classification","name":"image-classification","papers":16},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":15},{"task":"/task/linear-evaluation","name":"Linear evaluation","papers":11},{"task":"/task/object-detection","name":"Object Detection","papers":10},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":10},{"task":"/task/object-detection-1","name":"object-detection","papers":10},{"task":"/task/classification-1","name":"Classification","papers":8},{"task":"/task/retrieval","name":"Retrieval","papers":8},{"task":"/task/activity-recognition","name":"Activity Recognition","papers":7},{"task":"/task/clustering","name":"Clustering","papers":7},{"task":"/task/classification","name":"General Classification","papers":7},{"task":"/task/human-activity-recognition","name":"Human Activity Recognition","papers":7},{"task":"/task/segmentation","name":"Segmentation","papers":7},{"task":"/task/benchmarking","name":"Benchmarking","papers":5},{"task":"/task/image-retrieval","name":"Image Retrieval","papers":5}],"tasks_shown":20,"n_tasks":202,"usage_by_year":[{"year":"2020","papers":25},{"year":"2021","papers":51},{"year":"2022","papers":54},{"year":"2023","papers":53},{"year":"2024","papers":46},{"year":"2025","papers":11}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/simclr"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=SimCLR","read_at":"2026-10-05T01:02:01+00:00","query":"SimCLR","kind":"method","have":"verified_code","tier":null,"verified_implementation":true,"level":3,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"SimCLR","origin_arxiv_id":"2002.05709"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"unknown","archive_paper_arxiv_id":null,"repositories":{"listed":null,"in_graph":96,"list_truncated":null,"strongest_link":null},"retrieve_with":"get_reference_implementation(name='SimCLR')","name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"2002.05709","citations":25953},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'SimCLR'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2002.05709","page":"/paper/a-simple-framework-for-contrastive-learning","syntology_url":"https://syntology.ai/paper/2002.05709","in_graph_layer":true,"samples":137,"ran":115,"n_ran_checked":89,"n_instrument":26,"unverified":22,"phrase":"115 ran (of which 33 constructed an object rather than computing a result; 89 with no instrument failure: 1 honoured, 1 violated, 87 with no contract checked; 26 where Syntology's instrument failed) · 22 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"verified reference implementation at level V3. The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2002.05709) is about this method is not checked.","level_legend":{"state":"quoted","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","card_sha256":"479785a84658dd682a11b10237b3620d651d7f87799f5dc7add970aaa83f6d39","note":"Syntology's served verification levels, quoted verbatim from its MCP server card; a row is split where the card separates clauses with a double hyphen, and the separator is not reproduced","levels":[{"level":"V0","quoted":["imports"]},{"level":"V1","quoted":["executes against a synthesized fixture and returns a value of the recorded type"]},{"level":"V2","quoted":["two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs","neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)"]},{"level":"V3","quoted":["paper-derived property tests pass on both of those same two generations."]}],"no_rung":"No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results."}},"syntology_have_state":"loaded","record_sha256":"c58a040ebcd59a91185aac8192dd289ad8ea6a65a12f1736cbb71fae022b9400","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}