Methods › General › Self-Supervised Learning › Barlow Twins
Barlow Twins
Introduced by Jure Zbontar et al. in Barlow Twins: Self-Supervised Learning via Redundancy Reduction
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Barlow Twins is a self-supervised learning method that applies redundancy-reduction — a principle first proposed in neuroscience — to self supervised learning. The objective function measures the cross-correlation matrix between the embeddings of two identical networks fed with distorted versions of a batch of samples, and tries to make this matrix close to the identity. This causes the embedding vectors of distorted version of a sample to be similar, while minimizing the redundancy between the components of these vectors. Barlow Twins does not require large batches nor asymmetry between the network twins such as a predictor network, gradient stopping, or a moving average on the weight updates. Intriguingly it benefits from very high-dimensional output vectors.
In Syntology verified reference implementation at level V3; retrieve with get_reference_implementation(name='BARLOW TWINS'). The lookup matched 'BARLOW TWINS' ignoring case. This answer is about arXiv:2103.03230, the paper the archive credits with this method.
Origin paper of this answer, arXiv:2103.03230 (its page on this site · its page on Syntology): Syntology's run record for its harvested code, 21 ran (of which 6 constructed an object rather than computing a result; 15 with no instrument failure: 2 honoured, 1 violated, 12 with no contract checked; 6 where Syntology's instrument failed) · 5 unverified (of 26 harvested samples) · 10 pointer-only (licence). The instrument figure counts failures of Syntology's instrument, not of the code. Ran means executed on a synthesized input, not that the code is correct.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
What each level means, quoted from Syntology's server card: V0 “imports”; V1 “executes against a synthesized fixture and returns a value of the recorded type”; V2 “two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs” “neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)”; V3 “paper-derived property tests pass on both of those same two generations.” The card adds: “No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results.” A level quoted in two parts is one definition the card writes as two clauses joined by a double hyphen, each clause quoted on its own (how these levels are quoted).
Papers archive 2025-07-28
archive papers tagged: 71 · with a code link: 39 · where Syntology ran a sample: 7 (5 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (7 of 71 tagged: 5 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 71 of 71, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Enhancing User Sequence Modeling through Barlow Twins-based Self-Supervised Learning 2 May 2025 · 0 repositories · arXiv:2505.00953
-
SinSim: Sinkhorn-Regularized SimCLR 13 Feb 2025 · 0 repositories · arXiv:2502.10478
-
Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets? 26 Jan 2025 · 0 repositories · arXiv:2501.15431
-
WARLearn: Weather-Adaptive Representation Learning 21 Nov 2024 · 1 repository · arXiv:2411.14095
-
Unsupervised Homography Estimation on Multimodal Image Pair via Alternating Optimization 20 Nov 2024 · 1 repository · arXiv:2411.13036
-
Infinite Width Limits of Self Supervised Neural Networks 17 Nov 2024 · 0 repositories · arXiv:2411.11176
-
Efficient Self-Supervised Barlow Twins from Limited Tissue Slide Cohorts for Colonic Pathology Diagnostics 8 Nov 2024 · 1 repository · arXiv:2411.05959
-
A Theoretical Characterization of Optimal Data Augmentations in Self-Supervised Learning 4 Nov 2024 · 0 repositories · arXiv:2411.01767
-
Uncovering RL Integration in SSL Loss: Objective-Specific Implications for Data-Efficient RL 22 Oct 2024 · 0 repositories · arXiv:2410.17428
-
Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods 5 Oct 2024 · 0 repositories · arXiv:2410.04289
-
Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensing 20 Sep 2024 · 1 repository
-
Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensing 16 Sep 2024 · 1 repository · arXiv:2410.01825
-
Learning Robust Representations for Communications over Noisy Channels 2 Sep 2024 · 0 repositories · arXiv:2409.01129
-
PreMix: Addressing Label Scarcity in Whole Slide Image Classification with Pre-trained Multiple Instance Learning Aggregators 2 Aug 2024 · 0 repositories · arXiv:2408.01162
-
Barlow Twins Deep Neural Network for Advanced 1D Drug-Target Interaction Prediction 31 Jul 2024 · 2 repositories · arXiv:2408.00040
-
Dense Self-Supervised Learning for Medical Image Segmentation 29 Jul 2024 · 0 repositories · arXiv:2407.20395
-
Enhanced Masked Image Modeling to Avoid Model Collapse on Multi-modal MRI Datasets 15 Jul 2024 · 2 repositories · arXiv:2407.10377
-
Maximum Manifold Capacity Representations in State Representation Learning 22 May 2024 · 0 repositories · arXiv:2405.13848
-
From Barlow Twins to Triplet Training: Differentiating Dementia with Limited Data 9 Apr 2024 · 1 repository · arXiv:2404.06253
-
Towards Better Understanding of Contrastive Sentence Representation Learning: A Unified Paradigm for Gradient 28 Feb 2024 · 1 repository · arXiv:2402.18281
-
The Common Stability Mechanism behind most Self-Supervised Learning Approaches 22 Feb 2024 · 1 repository · arXiv:2402.14957
-
BarlowTwins-CXR : Enhancing Chest X-Ray abnormality localization in heterogeneous data with cross-domain self-supervised learning 9 Feb 2024 · 0 repositories · arXiv:2402.06499
-
TwinBooster: Synergising Large Language Models with Barlow Twins and Gradient Boosting for Enhanced Molecular Property Prediction 9 Jan 2024 · 1 repository · arXiv:2401.04478
-
Enhancing Context Through Contrast 6 Jan 2024 · 0 repositories · arXiv:2401.03314
-
Self-supervised learning for skin cancer diagnosis with limited training data 1 Jan 2024 · 1 repository · arXiv:2401.00692
-
Upper Bounding Barlow Twins: A Novel Filter for Multi-Relational Clustering 21 Dec 2023 · 1 repository · arXiv:2312.14066Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Guarding Barlow Twins Against Overfitting with Mixed Samples 4 Dec 2023 · 1 repository · arXiv:2312.02151
-
Contrastive Learning of View-Invariant Representations for Facial Expressions Recognition 12 Nov 2023 · 0 repositories · arXiv:2311.06852
-
Adaptive Multi-head Contrastive Learning 9 Oct 2023 · 1 repository · arXiv:2310.05615
-
Information Flow in Self-Supervised Learning 29 Sep 2023 · 2 repositories · arXiv:2309.17281
-
Self-supervised learning unveils change in urban housing from street-level images 20 Sep 2023 · 1 repository · arXiv:2309.11354
-
Adapting Self-Supervised Representations to Multi-Domain Setups 7 Sep 2023 · 0 repositories · arXiv:2309.03999
-
Understanding Self-Supervised Learning of Speech Representation via Invariance and Redundancy Reduction 7 Sep 2023 · 0 repositories · arXiv:2309.03619
-
Self-Supervised Pre-Training Boosts Semantic Scene Segmentation on LiDAR Data 5 Sep 2023 · 1 repository · arXiv:2309.02139
-
BTSeg: Barlow Twins Regularization for Domain Adaptation in Semantic Segmentation 31 Aug 2023 · 1 repository · arXiv:2308.16819
-
BarlowRL: Barlow Twins for Data-Efficient Reinforcement Learning 8 Aug 2023 · 1 repository · arXiv:2308.04263
-
VG-SSL: Benchmarking Self-supervised Representation Learning Approaches for Visual Geo-localization 31 Jul 2023 · 1 repository · arXiv:2308.00090
-
RedMotion: Motion Prediction via Redundancy Reduction 19 Jun 2023 · 3 repositories · arXiv:2306.10840Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Matrix Information Theory for Self-Supervised Learning 27 May 2023 · 3 repositories · arXiv:2305.17326Syntology official (archive's flag): 3 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Maximizing Model Generalization for Machine Condition Monitoring with Self-Supervised Learning and Federated Learning 27 Apr 2023 · 0 repositories · arXiv:2304.14398
-
On the Stepwise Nature of Self-Supervised Learning 27 Mar 2023 · 1 repository · arXiv:2303.15438
-
Distortion-Disentangled Contrastive Learning 9 Mar 2023 · 0 repositories · arXiv:2303.05066
-
Self-supervised Learning for Gastrointestinal Pathologies Endoscopy Image Classification with Triplet Loss 3 Mar 2023 · 0 repositories · arXiv:2303.01672
-
Task-Agnostic Graph Neural Network Evaluation via Adversarial Collaboration 27 Jan 2023 · 1 repository · arXiv:2301.11517Syntology official (archive's flag): 4 ran · 4 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Deep Active Learning Using Barlow Twins 30 Dec 2022 · 0 repositories · arXiv:2212.14658
-
A Lightweight Domain Adaptive Absolute Pose Regressor Using Barlow Twins Objective 20 Nov 2022 · 0 repositories · arXiv:2211.10963
-
RegCLR: A Self-Supervised Framework for Tabular Representation Learning in the Wild 2 Nov 2022 · 0 repositories · arXiv:2211.01165
-
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations 29 Sep 2022 · 0 repositories · arXiv:2209.14905
-
Audio Barlow Twins: Self-Supervised Audio Representation Learning 28 Sep 2022 · 1 repository · arXiv:2209.14345Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Non-contrastive representation learning for intervals from well logs 28 Sep 2022 · 0 repositories · arXiv:2209.14750
-
Test-time Training for Data-efficient UCDR 19 Aug 2022 · 1 repository · arXiv:2208.09198
-
Differencing based Self-supervised pretraining for Scene Change Detection 11 Aug 2022 · 1 repository · arXiv:2208.05838
-
TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning 21 Jun 2022 · 2 repositories · arXiv:2206.10698
-
Visualizing and Understanding Contrastive Learning 20 Jun 2022 · 1 repository · arXiv:2206.09753
-
Self-Supervised Representation Learning With MUlti-Segmental Informational Coding (MUSIC) 13 Jun 2022 · 0 repositories · arXiv:2206.06461
-
Pseudo-Data based Self-Supervised Federated Learning for Classification of Histopathological Images 31 May 2022 · 0 repositories · arXiv:2205.15530
-
Continual Barlow Twins: continual self-supervised learning for remote sensing semantic segmentation 23 May 2022 · 0 repositories · arXiv:2205.11319
-
DeLoRes: Decorrelating Latent Spaces for Low-Resource Audio Representation Learning 25 Mar 2022 · 2 repositories · arXiv:2203.13628
-
Investigating Power laws in Deep Representation Learning 11 Feb 2022 · 0 repositories · arXiv:2202.05808
-
Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning 11 Feb 2022 · 0 repositories · arXiv:2202.05460
-
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework 9 Dec 2021 · 1 repository · arXiv:2112.05141
-
BT-Unet: A self-supervised learning framework for biomedical image segmentation using Barlow Twins with U-Net models 7 Dec 2021 · 1 repository · arXiv:2112.03916
-
A Histopathology Study Comparing Contrastive Semi-Supervised and Fully Supervised Learning 10 Nov 2021 · 0 repositories · arXiv:2111.05882
-
Towards the Generalization of Contrastive Self-Supervised Learning 1 Nov 2021 · 1 repository · arXiv:2111.00743Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Barlow Graph Auto-Encoder for Unsupervised Network Embedding 29 Oct 2021 · 0 repositories · arXiv:2110.15742
-
TLDR: Twin Learning for Dimensionality Reduction 18 Oct 2021 · 1 repository · arXiv:2110.09455
-
Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspective 14 Jun 2021 · 1 repository · arXiv:2106.07115Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Graph Barlow Twins: A self-supervised representation learning framework for graphs 4 Jun 2021 · 1 repository · arXiv:2106.02466
-
A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning 28 Apr 2021 · 2 repositories · arXiv:2104.13712Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Self-Supervised Training Enhances Online Continual Learning 25 Mar 2021 · 0 repositories · arXiv:2103.14010
-
Barlow Twins: Self-Supervised Learning via Redundancy Reduction 4 Mar 2021 · 24 repositories · arXiv:2103.03230Syntology official (archive's flag): 1 ran · 21 ran (of which 6 constructed an object rather than computing a result; 15 with no instrument failure: 2 honoured, 1 violated, 12 with no contract checked; 6 where Syntology's instrument failed) · 5 unverified (of 26 harvested samples) · 10 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 105 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections