Methods › General › Self-Supervised Learning › BYOL
Bootstrap Your Own Latent
BYOL
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
BYOL (Bootstrap Your Own Latent) is a new approach to self-supervised learning. BYOL’s goal is to learn a representation y_θ which can then be used for downstream tasks. BYOL uses two neural networks to learn: the online and target networks. The online network is defined by a set of weights θ and is comprised of three stages: an encoder f_θ, a projector g_θ and a predictor q_θ. The target network has the same architecture as the online network, but uses a different set of weights ξ. The target network provides the regression targets to train the online network, and its parameters ξ are an exponential moving average of the online parameters θ.
Given the architecture diagram on the right, BYOL minimizes a similarity loss between q_θ(z_θ) and sg(z′_ξ), where θ are the trained weights, ξ are an exponential moving average of θ and sg means stop-gradient. At the end of training, everything but f_θ is discarded, and y_θ is used as the image representation.
Source: Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning
Image credit: Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning
In Syntology repository known, no verified implementation (declared_code; repositories: 1 listed of 1 in the graph, strongest link: listed only). The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2601.10804) is about this method is not checked.
From the lookup's note on this name: The same name also belongs to “Bootstrap Your Own Latent (BYOL)”, a method in the paper “Bootstrap your own latent: A new approach to self-supervised Learning” (arXiv:2006.07733, 8,979 citations), which the lookup finds cited far more than the paper this answer is about (0 citations), so this answer may be about a different sense of the name. For arXiv:2006.07733: its page on this site · ask the lookup about it.
Origin paper of this answer, arXiv:2601.10804 (its page on this site · its page on Syntology): Syntology's run record for its harvested code, 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples). The instrument figure counts failures of Syntology's instrument, not of the code. Ran means executed on a synthesized input, not that the code is correct.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 123 · with a code link: 63 · where Syntology ran a sample: 24 (20 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (24 of 123 tagged: 20 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 123, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Representation Learning via Non-Contrastive Mutual Information 23 Apr 2025 · 0 repositories · arXiv:2504.16667
-
Variational Self-Supervised Learning 6 Apr 2025 · 0 repositories · arXiv:2504.04318
-
Implicit Contrastive Representation Learning with Guided Stop-gradient 12 Mar 2025 · 1 repository · arXiv:2503.09058Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Adversarial network embedding with bootstrapped representations for sparse networks 3 Mar 2025 · 1 repository
-
Dataset Ownership Verification in Contrastive Pre-trained Models 11 Feb 2025 · 1 repository · arXiv:2502.07276
-
Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant" 21 Dec 2024 · 1 repository · arXiv:2412.16522
-
Self-Supervised Radiograph Anatomical Region Classification -- How Clean Is Your Real-World Data? 20 Dec 2024 · 0 repositories · arXiv:2412.15967
-
Maximising Histopathology Segmentation using Minimal Labels via Self-Supervision 19 Dec 2024 · 0 repositories · arXiv:2412.15389
-
Bridge: A Unified Framework to Knowledge Graph Completion via Language Models and Knowledge Representation 11 Nov 2024 · 0 repositories · arXiv:2411.06660
-
Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods 5 Oct 2024 · 0 repositories · arXiv:2410.04289
-
Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition 23 Sep 2024 · 1 repository
-
Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT 16 Sep 2024 · 1 repository · arXiv:2409.10103
-
Unfolding Videos Dynamics via Taylor Expansion 4 Sep 2024 · 0 repositories · arXiv:2409.02371
-
CNN-JEPA: Self-Supervised Pretraining Convolutional Neural Networks Using Joint Embedding Predictive Architecture 14 Aug 2024 · 1 repository · arXiv:2408.07514
-
Efficiency for Free: Ideal Data Are Transportable Representations 23 May 2024 · 1 repository · arXiv:2405.14669
-
Self-supervised learning for classifying paranasal anomalies in the maxillary sinus 29 Apr 2024 · 1 repository · arXiv:2404.18599
-
Integration of Self-Supervised BYOL in Semi-Supervised Medical Image Recognition 16 Apr 2024 · 0 repositories · arXiv:2404.10405
-
Masked Modeling Duo: Towards a Universal Audio Pre-training Framework 9 Apr 2024 · 2 repositories · arXiv:2404.06095Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Self-supervised Visualisation of Medical Image Datasets 22 Feb 2024 · 1 repository · arXiv:2402.14566
-
The Common Stability Mechanism behind most Self-Supervised Learning Approaches 22 Feb 2024 · 1 repository · arXiv:2402.14957
-
WERank: Towards Rank Degradation Prevention for Self-Supervised Learning Using Weight Regularization 14 Feb 2024 · 0 repositories · arXiv:2402.09586
-
GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning 3 Jan 2024 · 1 repository · arXiv:2401.01990
-
Bootstrap Your Own Variance 6 Dec 2023 · 0 repositories · arXiv:2312.03213
-
SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer 2 Dec 2023 · 0 repositories · arXiv:2312.01187
-
CUCL: Codebook for Unsupervised Continual Learning 25 Nov 2023 · 1 repository · arXiv:2311.14911
-
Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics 28 Sep 2023 · 0 repositories · arXiv:2309.16109
-
Adapting Self-Supervised Representations to Multi-Domain Setups 7 Sep 2023 · 0 repositories · arXiv:2309.03999
-
Feature-Suppressed Contrast for Self-Supervised Food Pre-training 7 Aug 2023 · 1 repository · arXiv:2308.03272
-
VG-SSL: Benchmarking Self-supervised Representation Learning Approaches for Visual Geo-localization 31 Jul 2023 · 1 repository · arXiv:2308.00090
-
Self-Supervised Learning for Improved Synthetic Aperture Sonar Target Recognition 27 Jul 2023 · 0 repositories · arXiv:2307.15098
-
How to Scale Your EMA 25 Jul 2023 · 0 repositories · arXiv:2307.13813
-
The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning 20 Jul 2023 · 1 repository · arXiv:2307.10907Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Systematic comparison of semi-supervised and self-supervised learning for medical image classification 18 Jul 2023 · 1 repository · arXiv:2307.08919
-
Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition 15 Jul 2023 · 2 repositories · arXiv:2307.07791
-
Additional Positive Enables Better Representation Learning for Medical Images 31 May 2023 · 0 repositories · arXiv:2306.00112
-
Morphological Classification of Radio Galaxies using Semi-Supervised Group Equivariant CNNs 31 May 2023 · 0 repositories · arXiv:2306.00031
-
Matrix Information Theory for Self-Supervised Learning 27 May 2023 · 3 repositories · arXiv:2305.17326Syntology official (archive's flag): 3 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Learning Better Contrastive View from Radiologist's Gaze 15 May 2023 · 1 repository · arXiv:2305.08826
-
In-Distribution and Out-of-Distribution Self-supervised ECG Representation Learning for Arrhythmia Detection 13 Apr 2023 · 0 repositories · arXiv:2304.06427
-
Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation 13 Apr 2023 · 0 repositories · arXiv:2304.06600
-
Large-scale pretraining on pathological images for fine-tuning of small pathological benchmarks 28 Mar 2023 · 1 repository · arXiv:2303.15693
-
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism 4 Mar 2023 · 1 repository · arXiv:2303.02387Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
The Edge of Orthogonality: A Simple View of What Makes BYOL Tick 9 Feb 2023 · 0 repositories · arXiv:2302.04817
-
Leveraging the Third Dimension in Contrastive Learning 27 Jan 2023 · 0 repositories · arXiv:2301.11790
-
MoBYv2AL: Self-supervised Active Learning for Image Classification 4 Jan 2023 · 1 repository · arXiv:2301.01531
-
COVID-19 Detection Based on Self-Supervised Transfer Learning Using Chest X-Ray Images 19 Dec 2022 · 0 repositories · arXiv:2212.09276
-
A Unified Framework for Contrastive Learning from a Perspective of Affinity Matrix 26 Nov 2022 · 0 repositories · arXiv:2211.14516
-
Ladder Siamese Network: a Method and Insights for Multi-level Self-Supervised Learning 25 Nov 2022 · 0 repositories · arXiv:2211.13844
-
Improving Pixel-Level Contrastive Learning by Leveraging Exogenous Depth Information 18 Nov 2022 · 0 repositories · arXiv:2211.10177
-
Learning from partially labeled data for multi-organ and tumor segmentation 13 Nov 2022 · 1 repository · arXiv:2211.06894
-
EquiMod: An Equivariance Module to Improve Self-Supervised Learning 2 Nov 2022 · 1 repository · arXiv:2211.01244
-
How Well Do Unsupervised Learning Algorithms Model Human Real-time and Life-long Learning? 1 Nov 2022 · 1 repository
-
RGMIM: Region-Guided Masked Image Modeling for Learning Meaningful Representations from X-Ray Images 1 Nov 2022 · 0 repositories · arXiv:2211.00313
-
Self-Supervised Learning Through Efference Copies 17 Oct 2022 · 1 repository · arXiv:2210.09224
-
Where Should I Spend My FLOPS? Efficiency Evaluations of Visual Pre-training Methods 30 Sep 2022 · 0 repositories · arXiv:2209.15589
-
Understanding Collapse in Non-Contrastive Siamese Representation Learning 29 Sep 2022 · 1 repository · arXiv:2209.15007Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Non-contrastive representation learning for intervals from well logs 28 Sep 2022 · 0 repositories · arXiv:2209.14750
-
HistoPerm: A Permutation-Based View Generation Approach for Improving Histopathologic Feature Representation Learning 13 Sep 2022 · 0 repositories · arXiv:2209.06185
-
Looking For A Match: Self-supervised Clustering For Automatic Doubt Matching In e-learning Platforms 20 Aug 2022 · 0 repositories · arXiv:2208.09600
-
Metadata-enhanced contrastive learning from retinal optical coherence tomography images 4 Aug 2022 · 0 repositories · arXiv:2208.02529
-
BYOLMed3D: Self-Supervised Representation Learning of Medical Videos using Gradient Accumulation Assisted 3D BYOL Framework 31 Jul 2022 · 0 repositories · arXiv:2208.00444
-
Revisiting the Critical Factors of Augmentation-Invariant Representation Learning 30 Jul 2022 · 1 repository · arXiv:2208.00275Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
BYEL : Bootstrap Your Emotion Latent 20 Jul 2022 · 1 repository · arXiv:2207.10003
-
Towards Galaxy Foundation Models with Hybrid Contrastive Learning 23 Jun 2022 · 1 repository · arXiv:2206.11927
-
Extreme Masking for Learning Instance and Distributed Visual Representations 9 Jun 2022 · 1 repository · arXiv:2206.04667Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
MSR: Making Self-supervised learning Robust to Aggressive Augmentations 4 Jun 2022 · 0 repositories · arXiv:2206.01999
-
Self-Supervised Learning for Invariant Representations from Multi-Spectral and SAR Images 4 May 2022 · 0 repositories · arXiv:2205.02049
-
ATST: Audio Representation Learning with Teacher-Student Transformer 26 Apr 2022 · 4 repositories · arXiv:2204.12076
-
Leveraging Unlabeled Data for Sketch-based Understanding 26 Apr 2022 · 0 repositories · arXiv:2204.12522
-
Large Scale Time-Series Representation Learning via Simultaneous Low and High Frequency Feature Bootstrapping 24 Apr 2022 · 0 repositories · arXiv:2204.11291
-
BYOL for Audio: Exploring Pre-trained General-purpose Audio Representations 15 Apr 2022 · 2 repositories · arXiv:2204.07402Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Self-Labeling Refinement for Robust Representation Learning with Bootstrap Your Own Latent 9 Apr 2022 · 0 repositories · arXiv:2204.04545
-
LEAD: Self-Supervised Landmark Estimation by Aligning Distributions of Feature Similarity 6 Apr 2022 · 0 repositories · arXiv:2204.02958
-
An Efficient Anchor-free Universal Lesion Detection in CT-scans 30 Mar 2022 · 0 repositories · arXiv:2203.16074
-
Learning Where to Learn in Cross-View Self-Supervised Learning 28 Mar 2022 · 1 repository · arXiv:2203.14898Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)
-
Partitioning Image Representation in Contrastive Learning 20 Mar 2022 · 0 repositories · arXiv:2203.10454
-
UniVIP: A Unified Framework for Self-Supervised Visual Pre-training 14 Mar 2022 · 0 repositories · arXiv:2203.06965
-
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features 3 Mar 2022 · 0 repositories · arXiv:2203.01881
-
Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learning 22 Feb 2022 · 1 repository · arXiv:2202.11202Syntology official (archive's flag): 13 ran · 13 ran (of which 5 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 18 harvested samples)
-
Crafting Better Contrastive Views for Siamese Representation Learning 7 Feb 2022 · 1 repository · arXiv:2202.03278Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Cross-view Self-Supervised Learning on Heterogeneous Graph Neural Network via Bootstrapping 10 Jan 2022 · 0 repositories · arXiv:2201.03340
-
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework 9 Dec 2021 · 1 repository · arXiv:2112.05141
-
Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning 8 Dec 2021 · 1 repository · arXiv:2112.04607Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Self-Distilled Self-Supervised Representation Learning 25 Nov 2021 · 1 repository · arXiv:2111.12958Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 2 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 3 pointer-only (licence)
-
Learning Representation for Clustering via Prototype Scattering and Positive Sampling 23 Nov 2021 · 1 repository · arXiv:2111.11821
-
Evaluating Contrastive Learning on Wearable Timeseries for Downstream Clinical Outcomes 13 Nov 2021 · 0 repositories · arXiv:2111.07089
-
GenURL: A General Framework for Unsupervised Representation Learning 27 Oct 2021 · 1 repository · arXiv:2110.14553
-
Self-supervised EEG Representation Learning for Automatic Sleep Staging 27 Oct 2021 · 1 repository · arXiv:2110.15278
-
Directional Self-supervised Learning for Heavy Image Augmentations 26 Oct 2021 · 0 repositories · arXiv:2110.13555
-
Towards Demystifying Representation Learning with Non-contrastive Self-supervision 11 Oct 2021 · 2 repositories · arXiv:2110.04947
-
Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework 4 Oct 2021 · 1 repository · arXiv:2110.01253
-
Contrastive Learning is Just Meta-Learning 29 Sep 2021 · 0 repositories
-
Contrastive Quant: Quantization Makes Stronger Contrastive Learning 29 Sep 2021 · 0 repositories
-
Disentangling Properties of Contrastive Methods 29 Sep 2021 · 0 repositories
-
Learning Background Invariance Improves Generalization and Robustness in Self-Supervised Learning on ImageNet and Beyond 28 Sep 2021 · 0 repositories
-
Compressive Visual Representations 27 Sep 2021 · 1 repository · arXiv:2109.12909Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples)
-
Resource and data efficient self supervised learning 3 Sep 2021 · 0 repositories · arXiv:2109.01721
-
MultiSiam: Self-supervised Multi-instance Siamese Representation Learning for Autonomous Driving 27 Aug 2021 · 1 repository · arXiv:2108.12178
-
Trip-ROMA: Self-Supervised Learning with Triplets and Random Mappings 22 Jul 2021 · 1 repository · arXiv:2107.10419
-
Long-Short Temporal Contrastive Learning of Video Transformers 17 Jun 2021 · 0 repositories · arXiv:2106.09212
Tasks archive 2025-07-28
20 shown of 124 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections