{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/byol","slug":"byol","name":"BYOL","full_name":"Bootstrap Your Own Latent","full_name_withheld":false,"description_markdown":"BYOL (Bootstrap Your Own Latent) is a new approach to self-supervised learning. BYOL’s goal is to learn a representation $y_θ$ which can then be used for downstream tasks. BYOL uses two neural networks to learn: the online and target networks. The online network is defined by a set of weights $θ$ and is comprised of three stages: an encoder $f_θ$, a projector $g_θ$ and a predictor $q_θ$. The target network has the same architecture\r\nas the online network, but uses a different set of weights $ξ$. The target network provides the regression\r\ntargets to train the online network, and its parameters $ξ$ are an exponential moving average of the\r\nonline parameters $θ$.\r\n\r\nGiven the architecture diagram on the right, BYOL minimizes a similarity loss between $q_θ(z_θ)$ and $sg(z'{_ξ})$, where $θ$ are the trained weights, $ξ$ are an exponential moving average of $θ$ and $sg$ means stop-gradient. At the end of training, everything but $f_θ$ is discarded, and $y_θ$ is used as the image representation.\r\n\r\nSource: [Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning](https://paperswithcode.com/paper/bootstrap-your-own-latent-a-new-approach-to-1)\r\n\r\nImage credit: [Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning](https://paperswithcode.com/paper/bootstrap-your-own-latent-a-new-approach-to-1)","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"http://proceedings.neurips.cc/paper/2020/hash/f3ada80d5c4ee70142b17b8192b2958e-Abstract.html","title":"Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"General","area_id":"general","collection":"Self-Supervised Learning","url":"/methods/category/self-supervised-learning","pwc_aliases":[]}],"n_papers_tagged":123,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"slug":"representation-learning-via-non-contrastive","title":"Representation Learning via Non-Contrastive Mutual Information","date":"2025-04-23","arxiv_id":"2504.16667","n_code_links":0,"syntology":null},{"paper":null,"slug":"variational-self-supervised-learning","title":"Variational Self-Supervised Learning","date":"2025-04-06","arxiv_id":"2504.04318","n_code_links":0,"syntology":null},{"paper":"/paper/implicit-contrastive-representation-learning-1","slug":"implicit-contrastive-representation-learning-1","title":"Implicit Contrastive Representation Learning with Guided Stop-gradient","date":"2025-03-12","arxiv_id":"2503.09058","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","official":{"repos":["bych-lee/gsg"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/adversarial-network-embedding-with","slug":"adversarial-network-embedding-with","title":"Adversarial network embedding with bootstrapped representations for sparse networks","date":"2025-03-03","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/dataset-ownership-verification-in-contrastive","slug":"dataset-ownership-verification-in-contrastive","title":"Dataset Ownership Verification in Contrastive Pre-trained Models","date":"2025-02-11","arxiv_id":"2502.07276","n_code_links":1,"syntology":null},{"paper":"/paper/enhancing-contrastive-learning-inspired-by","slug":"enhancing-contrastive-learning-inspired-by","title":"Enhancing Contrastive Learning Inspired by the Philosophy of \"The Blind Men and the Elephant\"","date":"2024-12-21","arxiv_id":"2412.16522","n_code_links":1,"syntology":null},{"paper":null,"slug":"self-supervised-radiograph-anatomical-region","title":"Self-Supervised Radiograph Anatomical Region Classification -- How Clean Is Your Real-World Data?","date":"2024-12-20","arxiv_id":"2412.15967","n_code_links":0,"syntology":null},{"paper":null,"slug":"maximising-histopathology-segmentation-using","title":"Maximising Histopathology Segmentation using Minimal Labels via Self-Supervision","date":"2024-12-19","arxiv_id":"2412.15389","n_code_links":0,"syntology":null},{"paper":null,"slug":"bridge-a-unified-framework-to-knowledge-graph","title":"Bridge: A Unified Framework to Knowledge Graph Completion via Language Models and Knowledge Representation","date":"2024-11-11","arxiv_id":"2411.06660","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-supervised-anomaly-detection-in-the-wild","title":"Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods","date":"2024-10-05","arxiv_id":"2410.04289","n_code_links":0,"syntology":null},{"paper":"/paper/cross-model-cross-stream-learning-for-self","slug":"cross-model-cross-stream-learning-for-self","title":"Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition","date":"2024-09-23","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/self-supervised-syllable-discovery-based-on","slug":"self-supervised-syllable-discovery-based-on","title":"Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT","date":"2024-09-16","arxiv_id":"2409.10103","n_code_links":1,"syntology":null},{"paper":null,"slug":"unfolding-videos-dynamics-via-taylor","title":"Unfolding Videos Dynamics via Taylor Expansion","date":"2024-09-04","arxiv_id":"2409.02371","n_code_links":0,"syntology":null},{"paper":"/paper/cnn-jepa-self-supervised-pretraining","slug":"cnn-jepa-self-supervised-pretraining","title":"CNN-JEPA: Self-Supervised Pretraining Convolutional Neural Networks Using Joint Embedding Predictive Architecture","date":"2024-08-14","arxiv_id":"2408.07514","n_code_links":1,"syntology":null},{"paper":"/paper/efficiency-for-free-ideal-data-are","slug":"efficiency-for-free-ideal-data-are","title":"Efficiency for Free: Ideal Data Are Transportable Representations","date":"2024-05-23","arxiv_id":"2405.14669","n_code_links":1,"syntology":null},{"paper":"/paper/self-supervised-learning-for-classifying","slug":"self-supervised-learning-for-classifying","title":"Self-supervised learning for classifying paranasal anomalies in the maxillary sinus","date":"2024-04-29","arxiv_id":"2404.18599","n_code_links":1,"syntology":null},{"paper":null,"slug":"integration-of-self-supervised-byol-in-semi","title":"Integration of Self-Supervised BYOL in Semi-Supervised Medical Image Recognition","date":"2024-04-16","arxiv_id":"2404.10405","n_code_links":0,"syntology":null},{"paper":"/paper/masked-modeling-duo-towards-a-universal-audio","slug":"masked-modeling-duo-towards-a-universal-audio","title":"Masked Modeling Duo: Towards a Universal Audio Pre-training Framework","date":"2024-04-09","arxiv_id":"2404.06095","n_code_links":2,"syntology":{"ran":7,"of":7,"n_ran_checked":4,"n_instrument":3,"unverified":0,"pointer_only":7,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","official":{"repos":["nttcslab/m2d","nttcslab/eval-audio-repr"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/self-supervised-visualisation-of-medical","slug":"self-supervised-visualisation-of-medical","title":"Self-supervised Visualisation of Medical Image Datasets","date":"2024-02-22","arxiv_id":"2402.14566","n_code_links":1,"syntology":null},{"paper":"/paper/the-common-stability-mechanism-behind-most","slug":"the-common-stability-mechanism-behind-most","title":"The Common Stability Mechanism behind most Self-Supervised Learning Approaches","date":"2024-02-22","arxiv_id":"2402.14957","n_code_links":1,"syntology":null},{"paper":null,"slug":"werank-towards-rank-degradation-prevention","title":"WERank: Towards Rank Degradation Prevention for Self-Supervised Learning Using Weight Regularization","date":"2024-02-14","arxiv_id":"2402.09586","n_code_links":0,"syntology":null},{"paper":"/paper/gps-ssl-guided-positive-sampling-to-inject","slug":"gps-ssl-guided-positive-sampling-to-inject","title":"GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning","date":"2024-01-03","arxiv_id":"2401.01990","n_code_links":1,"syntology":null},{"paper":null,"slug":"bootstrap-your-own-variance","title":"Bootstrap Your Own Variance","date":"2023-12-06","arxiv_id":"2312.03213","n_code_links":0,"syntology":null},{"paper":null,"slug":"sassl-enhancing-self-supervised-learning-via","title":"SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer","date":"2023-12-02","arxiv_id":"2312.01187","n_code_links":0,"syntology":null},{"paper":"/paper/cucl-codebook-for-unsupervised-continual","slug":"cucl-codebook-for-unsupervised-continual","title":"CUCL: Codebook for Unsupervised Continual Learning","date":"2023-11-25","arxiv_id":"2311.14911","n_code_links":1,"syntology":null},{"paper":null,"slug":"feature-normalization-prevents-collapse-of","title":"Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics","date":"2023-09-28","arxiv_id":"2309.16109","n_code_links":0,"syntology":null},{"paper":null,"slug":"adapting-self-supervised-representations-to","title":"Adapting Self-Supervised Representations to Multi-Domain Setups","date":"2023-09-07","arxiv_id":"2309.03999","n_code_links":0,"syntology":null},{"paper":"/paper/feature-suppressed-contrast-for-self","slug":"feature-suppressed-contrast-for-self","title":"Feature-Suppressed Contrast for Self-Supervised Food Pre-training","date":"2023-08-07","arxiv_id":"2308.03272","n_code_links":1,"syntology":null},{"paper":"/paper/visual-geo-localization-with-self-supervised","slug":"visual-geo-localization-with-self-supervised","title":"VG-SSL: Benchmarking Self-supervised Representation Learning Approaches for Visual Geo-localization","date":"2023-07-31","arxiv_id":"2308.00090","n_code_links":1,"syntology":null},{"paper":null,"slug":"self-supervised-learning-for-improved","title":"Self-Supervised Learning for Improved Synthetic Aperture Sonar Target Recognition","date":"2023-07-27","arxiv_id":"2307.15098","n_code_links":0,"syntology":null},{"paper":null,"slug":"how-to-scale-your-ema","title":"How to Scale Your EMA","date":"2023-07-25","arxiv_id":"2307.13813","n_code_links":0,"syntology":null},{"paper":"/paper/the-role-of-entropy-and-reconstruction-in","slug":"the-role-of-entropy-and-reconstruction-in","title":"The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning","date":"2023-07-20","arxiv_id":"2307.10907","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":0,"n_instrument":2,"unverified":0,"pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":{"repos":["apple/ml-entropy-reconstruction"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/accuracy-versus-time-frontiers-of-semi","slug":"accuracy-versus-time-frontiers-of-semi","title":"Systematic comparison of semi-supervised and self-supervised learning for medical image classification","date":"2023-07-18","arxiv_id":"2307.08919","n_code_links":1,"syntology":null},{"paper":"/paper/joint-adversarial-and-collaborative-learning","slug":"joint-adversarial-and-collaborative-learning","title":"Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition","date":"2023-07-15","arxiv_id":"2307.07791","n_code_links":2,"syntology":null},{"paper":null,"slug":"additional-positive-enables-better","title":"Additional Positive Enables Better Representation Learning for Medical Images","date":"2023-05-31","arxiv_id":"2306.00112","n_code_links":0,"syntology":null},{"paper":null,"slug":"morphological-classification-of-radio-1","title":"Morphological Classification of Radio Galaxies using Semi-Supervised Group Equivariant CNNs","date":"2023-05-31","arxiv_id":"2306.00031","n_code_links":0,"syntology":null},{"paper":"/paper/kernel-ssl-kernel-kl-divergence-for-self","slug":"kernel-ssl-kernel-kl-divergence-for-self","title":"Matrix Information Theory for Self-Supervised Learning","date":"2023-05-27","arxiv_id":"2305.17326","n_code_links":3,"syntology":{"ran":5,"of":5,"n_ran_checked":1,"n_instrument":4,"unverified":0,"pointer_only":5,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified","official":{"repos":["yifanzhang-pro/matrix-llm","yifanzhang-pro/matrix-ssl"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official","unlocated"]}}},{"paper":"/paper/learning-better-contrastive-view-from","slug":"learning-better-contrastive-view-from","title":"Learning Better Contrastive View from Radiologist's Gaze","date":"2023-05-15","arxiv_id":"2305.08826","n_code_links":1,"syntology":null},{"paper":null,"slug":"in-distribution-and-out-of-distribution-self","title":"In-Distribution and Out-of-Distribution Self-supervised ECG Representation Learning for Arrhythmia Detection","date":"2023-04-13","arxiv_id":"2304.06427","n_code_links":0,"syntology":null},{"paper":null,"slug":"lossless-adaptation-of-pretrained-vision","title":"Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation","date":"2023-04-13","arxiv_id":"2304.06600","n_code_links":0,"syntology":null},{"paper":"/paper/large-scale-pretraining-on-pathological","slug":"large-scale-pretraining-on-pathological","title":"Large-scale pretraining on pathological images for fine-tuning of small pathological benchmarks","date":"2023-03-28","arxiv_id":"2303.15693","n_code_links":1,"syntology":null},{"paper":"/paper/towards-a-unified-theoretical-understanding","slug":"towards-a-unified-theoretical-understanding","title":"Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism","date":"2023-03-04","arxiv_id":"2303.02387","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":0,"n_instrument":2,"unverified":0,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":{"repos":["pku-ml/rank-differential-mechanism"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"the-edge-of-orthogonality-a-simple-view-of","title":"The Edge of Orthogonality: A Simple View of What Makes BYOL Tick","date":"2023-02-09","arxiv_id":"2302.04817","n_code_links":0,"syntology":null},{"paper":null,"slug":"leveraging-the-third-dimension-in-contrastive","title":"Leveraging the Third Dimension in Contrastive Learning","date":"2023-01-27","arxiv_id":"2301.11790","n_code_links":0,"syntology":null},{"paper":"/paper/mobyv2al-self-supervised-active-learning-for","slug":"mobyv2al-self-supervised-active-learning-for","title":"MoBYv2AL: Self-supervised Active Learning for Image Classification","date":"2023-01-04","arxiv_id":"2301.01531","n_code_links":1,"syntology":null},{"paper":null,"slug":"covid-19-detection-based-on-self-supervised","title":"COVID-19 Detection Based on Self-Supervised Transfer Learning Using Chest X-Ray Images","date":"2022-12-19","arxiv_id":"2212.09276","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-unified-framework-for-contrastive-learning","title":"A Unified Framework for Contrastive Learning from a Perspective of Affinity Matrix","date":"2022-11-26","arxiv_id":"2211.14516","n_code_links":0,"syntology":null},{"paper":null,"slug":"ladder-siamese-network-a-method-and-insights","title":"Ladder Siamese Network: a Method and Insights for Multi-level Self-Supervised Learning","date":"2022-11-25","arxiv_id":"2211.13844","n_code_links":0,"syntology":null},{"paper":null,"slug":"improving-pixel-level-contrastive-learning-by","title":"Improving Pixel-Level Contrastive Learning by Leveraging Exogenous Depth Information","date":"2022-11-18","arxiv_id":"2211.10177","n_code_links":0,"syntology":null},{"paper":"/paper/learning-from-partially-labeled-data-for","slug":"learning-from-partially-labeled-data-for","title":"Learning from partially labeled data for multi-organ and tumor segmentation","date":"2022-11-13","arxiv_id":"2211.06894","n_code_links":1,"syntology":null},{"paper":"/paper/equimod-an-equivariance-module-to-improve","slug":"equimod-an-equivariance-module-to-improve","title":"EquiMod: An Equivariance Module to Improve Self-Supervised Learning","date":"2022-11-02","arxiv_id":"2211.01244","n_code_links":1,"syntology":null},{"paper":"/paper/how-well-do-unsupervised-learning-algorithms","slug":"how-well-do-unsupervised-learning-algorithms","title":"How Well Do Unsupervised Learning Algorithms Model Human Real-time and Life-long Learning?","date":"2022-11-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"rgmim-region-guided-masked-image-modeling-for","title":"RGMIM: Region-Guided Masked Image Modeling for Learning Meaningful Representations from X-Ray Images","date":"2022-11-01","arxiv_id":"2211.00313","n_code_links":0,"syntology":null},{"paper":"/paper/self-supervised-learning-through-efference","slug":"self-supervised-learning-through-efference","title":"Self-Supervised Learning Through Efference Copies","date":"2022-10-17","arxiv_id":"2210.09224","n_code_links":1,"syntology":null},{"paper":null,"slug":"where-should-i-spend-my-flops-efficiency","title":"Where Should I Spend My FLOPS? Efficiency Evaluations of Visual Pre-training Methods","date":"2022-09-30","arxiv_id":"2209.15589","n_code_links":0,"syntology":null},{"paper":"/paper/understanding-collapse-in-non-contrastive","slug":"understanding-collapse-in-non-contrastive","title":"Understanding Collapse in Non-Contrastive Siamese Representation Learning","date":"2022-09-29","arxiv_id":"2209.15007","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":1,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["alexlioralexli/noncontrastive-ssl"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"non-contrastive-approaches-to-similarity","title":"Non-contrastive representation learning for intervals from well logs","date":"2022-09-28","arxiv_id":"2209.14750","n_code_links":0,"syntology":null},{"paper":null,"slug":"histoperm-a-permutation-based-view-generation","title":"HistoPerm: A Permutation-Based View Generation Approach for Improving Histopathologic Feature Representation Learning","date":"2022-09-13","arxiv_id":"2209.06185","n_code_links":0,"syntology":null},{"paper":null,"slug":"looking-for-a-match-self-supervised","title":"Looking For A Match: Self-supervised Clustering For Automatic Doubt Matching In e-learning Platforms","date":"2022-08-20","arxiv_id":"2208.09600","n_code_links":0,"syntology":null},{"paper":null,"slug":"metadata-enhanced-contrastive-learning-from","title":"Metadata-enhanced contrastive learning from retinal optical coherence tomography images","date":"2022-08-04","arxiv_id":"2208.02529","n_code_links":0,"syntology":null},{"paper":null,"slug":"byolmed3d-self-supervised-representation","title":"BYOLMed3D: Self-Supervised Representation Learning of Medical Videos using Gradient Accumulation Assisted 3D BYOL Framework","date":"2022-07-31","arxiv_id":"2208.00444","n_code_links":0,"syntology":null},{"paper":"/paper/revisiting-the-critical-factors-of","slug":"revisiting-the-critical-factors-of","title":"Revisiting the Critical Factors of Augmentation-Invariant Representation Learning","date":"2022-07-30","arxiv_id":"2208.00275","n_code_links":1,"syntology":{"ran":4,"of":5,"n_ran_checked":2,"n_instrument":2,"unverified":1,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":{"repos":["megvii-research/revisitairl"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/byel-bootstrap-on-your-emotion-latent","slug":"byel-bootstrap-on-your-emotion-latent","title":"BYEL : Bootstrap Your Emotion Latent","date":"2022-07-20","arxiv_id":"2207.10003","n_code_links":1,"syntology":null},{"paper":"/paper/towards-galaxy-foundation-models-with-hybrid","slug":"towards-galaxy-foundation-models-with-hybrid","title":"Towards Galaxy Foundation Models with Hybrid Contrastive Learning","date":"2022-06-23","arxiv_id":"2206.11927","n_code_links":1,"syntology":null},{"paper":"/paper/extreme-masking-for-learning-instance-and","slug":"extreme-masking-for-learning-instance-and","title":"Extreme Masking for Learning Instance and Distributed Visual Representations","date":"2022-06-09","arxiv_id":"2206.04667","n_code_links":1,"syntology":{"ran":2,"of":3,"n_ran_checked":1,"n_instrument":1,"unverified":1,"pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","official":null}},{"paper":null,"slug":"msr-making-self-supervised-learning-robust-to","title":"MSR: Making Self-supervised learning Robust to Aggressive Augmentations","date":"2022-06-04","arxiv_id":"2206.01999","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-supervised-learning-for-invariant","title":"Self-Supervised Learning for Invariant Representations from Multi-Spectral and SAR Images","date":"2022-05-04","arxiv_id":"2205.02049","n_code_links":0,"syntology":null},{"paper":"/paper/atst-audio-representation-learning-with","slug":"atst-audio-representation-learning-with","title":"ATST: Audio Representation Learning with Teacher-Student Transformer","date":"2022-04-26","arxiv_id":"2204.12076","n_code_links":4,"syntology":null},{"paper":null,"slug":"leveraging-unlabeled-data-for-sketch-based","title":"Leveraging Unlabeled Data for Sketch-based Understanding","date":"2022-04-26","arxiv_id":"2204.12522","n_code_links":0,"syntology":null},{"paper":null,"slug":"large-scale-time-series-representation","title":"Large Scale Time-Series Representation Learning via Simultaneous Low and High Frequency Feature Bootstrapping","date":"2022-04-24","arxiv_id":"2204.11291","n_code_links":0,"syntology":null},{"paper":"/paper/byol-for-audio-exploring-pre-trained-general","slug":"byol-for-audio-exploring-pre-trained-general","title":"BYOL for Audio: Exploring Pre-trained General-purpose Audio Representations","date":"2022-04-15","arxiv_id":"2204.07402","n_code_links":2,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["nttcslab/byol-a"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"self-labeling-refinement-for-robust","title":"Self-Labeling Refinement for Robust Representation Learning with Bootstrap Your Own Latent","date":"2022-04-09","arxiv_id":"2204.04545","n_code_links":0,"syntology":null},{"paper":null,"slug":"lead-self-supervised-landmark-estimation-by","title":"LEAD: Self-Supervised Landmark Estimation by Aligning Distributions of Feature Similarity","date":"2022-04-06","arxiv_id":"2204.02958","n_code_links":0,"syntology":null},{"paper":"/paper/an-efficient-anchor-free-universal-lesion","slug":"an-efficient-anchor-free-universal-lesion","title":"An Efficient Anchor-free Universal Lesion Detection in CT-scans","date":"2022-03-30","arxiv_id":"2203.16074","n_code_links":0,"syntology":null},{"paper":"/paper/learning-where-to-learn-in-cross-view-self","slug":"learning-where-to-learn-in-cross-view-self","title":"Learning Where to Learn in Cross-View Self-Supervised Learning","date":"2022-03-28","arxiv_id":"2203.14898","n_code_links":1,"syntology":{"ran":2,"of":4,"n_ran_checked":2,"n_instrument":0,"unverified":2,"pointer_only":4,"phrase":"2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 2 samples that ran constructed an object rather than computing a result","official":{"repos":["LayneH/LEWEL"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":2,"n_ran_no_instrument_failure":2,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"partitioning-image-representation-in","title":"Partitioning Image Representation in Contrastive Learning","date":"2022-03-20","arxiv_id":"2203.10454","n_code_links":0,"syntology":null},{"paper":null,"slug":"univip-a-unified-framework-for-self","title":"UniVIP: A Unified Framework for Self-Supervised Visual Pre-training","date":"2022-03-14","arxiv_id":"2203.06965","n_code_links":0,"syntology":null},{"paper":null,"slug":"understanding-failure-modes-of-self","title":"Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features","date":"2022-03-03","arxiv_id":"2203.01881","n_code_links":0,"syntology":null},{"paper":"/paper/indiscriminate-poisoning-attacks-on","slug":"indiscriminate-poisoning-attacks-on","title":"Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learning","date":"2022-02-22","arxiv_id":"2202.11202","n_code_links":1,"syntology":{"ran":13,"of":18,"n_ran_checked":9,"n_instrument":4,"unverified":5,"pointer_only":0,"phrase":"13 ran (of which 5 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified","official":{"repos":["kaiwenzha/contrastive-poisoning"],"state":"official (archive's flag): 13 ran","n_ran":13,"n_constructed":5,"n_ran_no_instrument_failure":9,"n_unverified":5,"ran_from_kinds":["official"]}}},{"paper":"/paper/crafting-better-contrastive-views-for-siamese-1","slug":"crafting-better-contrastive-views-for-siamese-1","title":"Crafting Better Contrastive Views for Siamese Representation Learning","date":"2022-02-07","arxiv_id":"2202.03278","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","official":{"repos":["xyupeng/contrastivecrop"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"cross-view-self-supervised-learning-on","title":"Cross-view Self-Supervised Learning on Heterogeneous Graph Neural Network via Bootstrapping","date":"2022-01-10","arxiv_id":"2201.03340","n_code_links":0,"syntology":null},{"paper":"/paper/exploring-the-equivalence-of-siamese-self","slug":"exploring-the-equivalence-of-siamese-self","title":"Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework","date":"2021-12-09","arxiv_id":"2112.05141","n_code_links":1,"syntology":null},{"paper":"/paper/constrained-mean-shift-using-distant-yet","slug":"constrained-mean-shift-using-distant-yet","title":"Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning","date":"2021-12-08","arxiv_id":"2112.04607","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["ucdvision/cmsf"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/self-distilled-self-supervised-representation","slug":"self-distilled-self-supervised-representation","title":"Self-Distilled Self-Supervised Representation Learning","date":"2021-11-25","arxiv_id":"2111.12958","n_code_links":1,"syntology":{"ran":8,"of":11,"n_ran_checked":6,"n_instrument":2,"unverified":3,"pointer_only":3,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 2 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified","official":{"repos":["hagiss/sdssl"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":"/paper/exploring-non-contrastive-representation-1","slug":"exploring-non-contrastive-representation-1","title":"Learning Representation for Clustering via Prototype Scattering and Positive Sampling","date":"2021-11-23","arxiv_id":"2111.11821","n_code_links":1,"syntology":null},{"paper":null,"slug":"evaluating-contrastive-learning-on-wearable","title":"Evaluating Contrastive Learning on Wearable Timeseries for Downstream Clinical Outcomes","date":"2021-11-13","arxiv_id":"2111.07089","n_code_links":0,"syntology":null},{"paper":"/paper/genurl-a-general-framework-for-unsupervised","slug":"genurl-a-general-framework-for-unsupervised","title":"GenURL: A General Framework for Unsupervised Representation Learning","date":"2021-10-27","arxiv_id":"2110.14553","n_code_links":1,"syntology":null},{"paper":"/paper/self-supervised-eeg-representation-learning","slug":"self-supervised-eeg-representation-learning","title":"Self-supervised EEG Representation Learning for Automatic Sleep Staging","date":"2021-10-27","arxiv_id":"2110.15278","n_code_links":1,"syntology":null},{"paper":null,"slug":"directional-self-supervised-learning-for","title":"Directional Self-supervised Learning for Heavy Image Augmentations","date":"2021-10-26","arxiv_id":"2110.13555","n_code_links":0,"syntology":null},{"paper":"/paper/towards-demystifying-representation-learning-1","slug":"towards-demystifying-representation-learning-1","title":"Towards Demystifying Representation Learning with Non-contrastive Self-supervision","date":"2021-10-11","arxiv_id":"2110.04947","n_code_links":2,"syntology":null},{"paper":"/paper/spatial-ensemble-a-novel-model-smoothing","slug":"spatial-ensemble-a-novel-model-smoothing","title":"Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework","date":"2021-10-04","arxiv_id":"2110.01253","n_code_links":1,"syntology":null},{"paper":null,"slug":"contrastive-learning-is-just-meta-learning","title":"Contrastive Learning is Just Meta-Learning","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-quant-quantization-makes-stronger","title":"Contrastive Quant: Quantization Makes Stronger Contrastive Learning","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"disentangling-properties-of-contrastive","title":"Disentangling Properties of Contrastive Methods","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"learning-background-invariance-improves","title":"Learning Background Invariance Improves Generalization and Robustness in Self-Supervised Learning on ImageNet and Beyond","date":"2021-09-28","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/compressive-visual-representations","slug":"compressive-visual-representations","title":"Compressive Visual Representations","date":"2021-09-27","arxiv_id":"2109.12909","n_code_links":1,"syntology":{"ran":7,"of":12,"n_ran_checked":7,"n_instrument":0,"unverified":5,"pointer_only":0,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified","official":{"repos":["google-research/compressive-visual-representations"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":7,"n_unverified":5,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"resource-and-data-efficient-self-supervised","title":"Resource and data efficient self supervised learning","date":"2021-09-03","arxiv_id":"2109.01721","n_code_links":0,"syntology":null},{"paper":"/paper/multisiam-self-supervised-multi-instance","slug":"multisiam-self-supervised-multi-instance","title":"MultiSiam: Self-supervised Multi-instance Siamese Representation Learning for Autonomous Driving","date":"2021-08-27","arxiv_id":"2108.12178","n_code_links":1,"syntology":null},{"paper":"/paper/triplet-is-all-you-need-with-random-mappings","slug":"triplet-is-all-you-need-with-random-mappings","title":"Trip-ROMA: Self-Supervised Learning with Triplets and Random Mappings","date":"2021-07-22","arxiv_id":"2107.10419","n_code_links":1,"syntology":null},{"paper":null,"slug":"long-short-temporal-contrastive-learning-of","title":"Long-Short Temporal Contrastive Learning of Video Transformers","date":"2021-06-17","arxiv_id":"2106.09212","n_code_links":0,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":123,"with_a_code_link":63,"where_syntology_ran_a_sample":24,"not_listed_spam_title":0,"listed":123,"listed_where_code_ran":24,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":20,"every_run_a_failure_of_syntologys_instrument":4,"listed_with_a_run_with_no_instrument_failure":20,"listed_every_run_a_failure_of_syntologys_instrument":4,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":24,"papers_where_code_ran_first_page":"/method/byol/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":2,"url":"/method/byol/papers/2","json":"/method/byol/papers/2.json","rows":23},{"order":"ran","page":1,"of":1,"url":"/method/byol/papers/ran/1","json":"/method/byol/papers/ran/1.json","rows":24}],"tasks":[{"task":"/task/self-supervised-learning","name":"Self-Supervised Learning","papers":79},{"task":"/task/representation-learning","name":"Representation Learning","papers":53},{"task":"/task/contrastive-learning","name":"Contrastive Learning","papers":36},{"task":"/task/linear-evaluation","name":"Linear evaluation","papers":15},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":14},{"task":"/task/image-classification","name":"Image Classification","papers":11},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":7},{"task":"/task/object-detection","name":"Object Detection","papers":6},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":6},{"task":"/task/image-classification","name":"image-classification","papers":6},{"task":"/task/object-detection-1","name":"object-detection","papers":6},{"task":"/task/diversity","name":"Diversity","papers":5},{"task":"/task/action-recognition-in-videos","name":"Action Recognition","papers":4},{"task":"/task/clustering","name":"Clustering","papers":4},{"task":"/task/pseudo-label","name":"Pseudo Label","papers":4},{"task":"/task/time-series","name":"Time Series Analysis","papers":4},{"task":"/task/depth-estimation","name":"Depth Estimation","papers":3},{"task":"/task/disentanglement","name":"Disentanglement","papers":3},{"task":"/task/few-shot-learning","name":"Few-Shot Learning","papers":3},{"task":"/task/segmentation","name":"Segmentation","papers":3}],"tasks_shown":20,"n_tasks":124,"usage_by_year":[{"year":"2020","papers":3},{"year":"2021","papers":39},{"year":"2022","papers":36},{"year":"2023","papers":23},{"year":"2024","papers":17},{"year":"2025","papers":5}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/byol"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=BYOL","read_at":"2026-10-05T00:53:18+00:00","query":"BYOL","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"BYOL","origin_arxiv_id":"2601.10804"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"unknown","archive_paper_arxiv_id":null,"repositories":{"listed":1,"in_graph":1,"list_truncated":false,"strongest_link":"listed_only"},"retrieve_with":null,"name_competition":{"verdict":"outranked","may_be_wrong_sense":true,"bearers_found":2,"served":{"arxiv_id":"2601.10804","citations":0},"leading_other_bearer":{"arxiv_id":"2006.07733","title":"Bootstrap your own latent: A new approach to self-supervised Learning","citations":8979,"named_by":["acronym_expansion"],"bearer_name":"Bootstrap Your Own Latent (BYOL)","ask_with":"have('2006.07733')"},"n_other_bearers_listed":1,"note":"'BYOL' is ALSO the name of 'Bootstrap Your Own Latent (BYOL)', a method in 'Bootstrap your own latent: A new approach to self-supervised Learning' (arXiv:2006.07733, 8,979 citations), which is cited FAR more than the paper this answer is about (0). This answer may be about the wrong BYOL. If you meant the better-known one, ask again with that entry of `also_named`."},"name_competition_text":"The same name also belongs to “Bootstrap Your Own Latent (BYOL)”, a method in the paper “Bootstrap your own latent: A new approach to self-supervised Learning” (arXiv:2006.07733, 8,979 citations), which the lookup finds cited far more than the paper this answer is about (0 citations), so this answer may be about a different sense of the name.","near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2601.10804","page":"/paper/arxiv-2601-10804","syntology_url":"https://syntology.ai/paper/2601.10804","in_graph_layer":true,"samples":6,"ran":3,"n_ran_checked":1,"n_instrument":2,"unverified":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"repository known, no verified implementation (declared_code; repositories: 1 listed of 1 in the graph, strongest link: listed only). The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2601.10804) is about this method is not checked.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"6007bcc339873423100579ff738b1d5f3caa415157ada8e71fbbbe0d1f077049","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}