Methods › General › Self-Supervised Learning › MoCo
Momentum Contrast
MoCo
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
MoCo, or Momentum Contrast, is a self-supervised learning algorithm with a contrastive loss.
Contrastive loss methods can be thought of as building dynamic dictionaries. The "keys" (tokens) in the dictionary are sampled from data (e.g., images or patches) and are represented by an encoder network. Unsupervised learning trains encoders to perform dictionary look-up: an encoded “query” should be similar to its matching key and dissimilar to others. Learning is formulated as minimizing a contrastive loss.
MoCo can be viewed as a way to build large and consistent dictionaries for unsupervised learning with a contrastive loss. In MoCo, we maintain the dictionary as a queue of data samples: the encoded representations of the current mini-batch are enqueued, and the oldest are dequeued. The queue decouples the dictionary size from the mini-batch size, allowing it to be large. Moreover, as the dictionary keys come from the preceding several mini-batches, a slowly progressing key encoder, implemented as a momentum-based moving average of the query encoder, is proposed to maintain consistency.
In Syntology matched a conference, 'MOCO', not a method (venue_papers). A venue has no implementation, so this does not say whether this method has code.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 148 · with a code link: 87 · where Syntology ran a sample: 36 (29 with a run with no instrument failure, 7 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (36 of 148 tagged: 29 with a run with no instrument failure, 7 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 148, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Graph-Supported Dynamic Algorithm Configuration for Multi-Objective Combinatorial Optimization 22 May 2025 · 1 repository · arXiv:2505.16471Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Variational Self-Supervised Learning 6 Apr 2025 · 0 repositories · arXiv:2504.04318
-
Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation 10 Mar 2025 · 0 repositories · arXiv:2503.06976
-
Dataset Ownership Verification in Contrastive Pre-trained Models 11 Feb 2025 · 1 repository · arXiv:2502.07276
-
Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets? 26 Jan 2025 · 0 repositories · arXiv:2501.15431
-
Language modulates vision: Evidence from neural networks and human brain-lesion models 23 Jan 2025 · 0 repositories · arXiv:2501.13628
-
Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant" 21 Dec 2024 · 1 repository · arXiv:2412.16522
-
SCAN: Bootstrapping Contrastive Pre-training for Data Efficiency 14 Nov 2024 · 1 repository · arXiv:2411.09126
-
Accelerating Augmentation Invariance Pretraining 27 Oct 2024 · 0 repositories · arXiv:2410.22364
-
SRA: A Novel Method to Improve Feature Embedding in Self-supervised Learning for Histopathological Images 23 Oct 2024 · 0 repositories · arXiv:2410.17514
-
SynCo: Synthetic Hard Negatives in Contrastive Learning for Better Unsupervised Visual Representations 3 Oct 2024 · 1 repository · arXiv:2410.02401
-
Moner: Motion Correction in Undersampled Radial MRI with Unsupervised Neural Representation 25 Sep 2024 · 1 repository · arXiv:2409.16921Syntology official (archive's flag): 3 ran · 4 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 5 pointer-only (licence)
-
Upper-body free-breathing Magnetic Resonance Fingerprinting applied to the quantification of water T1 and fat fraction 24 Sep 2024 · 1 repository · arXiv:2409.16200
-
Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition 23 Sep 2024 · 1 repository
-
DRL-Based Resource Allocation for Motion Blur Resistant Federated Self-Supervised Learning in IoV 17 Aug 2024 · 1 repository · arXiv:2408.09194
-
Boosting Adverse Weather Crowd Counting via Multi-queue Contrastive Learning 12 Aug 2024 · 0 repositories · arXiv:2408.05956
-
Contrastive Learning for Image Complexity Representation 6 Aug 2024 · 0 repositories · arXiv:2408.03230
-
Alignment Calibration: Machine Unlearning for Contrastive Learning under Auditing 5 Jun 2024 · 0 repositories · arXiv:2406.03603
-
WIDIn: Wording Image for Domain-Invariant Representation in Single-Source Domain Generalization 28 May 2024 · 0 repositories · arXiv:2405.18405
-
Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization 14 May 2024 · 0 repositories · arXiv:2405.08604
-
Additive Margin in Contrastive Self-Supervised Frameworks to Learn Discriminative Speaker Representations 23 Apr 2024 · 1 repository · arXiv:2404.14913
-
Overcoming Dimensional Collapse in Self-supervised Contrastive Learning for Medical Image Segmentation 22 Feb 2024 · 0 repositories · arXiv:2402.14611
-
f-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning 15 Feb 2024 · 0 repositories · arXiv:2402.10150
-
Moco: A Learnable Meta Optimizer for Combinatorial Optimization 7 Feb 2024 · 1 repository · arXiv:2402.04915Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)
-
DiffClone: Enhanced Behaviour Cloning in Robotics with Diffusion-Driven Policy Learning 17 Jan 2024 · 1 repository · arXiv:2401.09243Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
A Beam-Segmenting Polar Format Algorithm Based on Double PCS for Video SAR Persistent Imaging 19 Dec 2023 · 0 repositories · arXiv:2401.10252
-
SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer 2 Dec 2023 · 0 repositories · arXiv:2312.01187
-
Maximum Entropy Model Correction in Reinforcement Learning 29 Nov 2023 · 0 repositories · arXiv:2311.17855
-
MoCo-Transfer: Investigating out-of-distribution contrastive learning for limited-data domains 15 Nov 2023 · 0 repositories · arXiv:2311.09401
-
SAMCLR: Contrastive pre-training on complex scenes using SAM for view sampling 23 Oct 2023 · 0 repositories · arXiv:2310.14736
-
Neural Multi-Objective Combinatorial Optimization with Diversity Enhancement 22 Oct 2023 · 1 repository · arXiv:2310.15195Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 8 harvested samples)
-
Adaptive Multi-head Contrastive Learning 9 Oct 2023 · 1 repository · arXiv:2310.05615
-
Adapting Self-Supervised Representations to Multi-Domain Setups 7 Sep 2023 · 0 repositories · arXiv:2309.03999
-
Conic Descent Redux for Memory-Efficient Optimization 13 Aug 2023 · 0 repositories · arXiv:2308.07343
-
Dynamically Scaled Temperature in Self-Supervised Contrastive Learning 2 Aug 2023 · 1 repository · arXiv:2308.01140
-
Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition 15 Jul 2023 · 2 repositories · arXiv:2307.07791
-
Semantic Positive Pairs for Enhancing Visual Representation Learning of Instance Discrimination methods 28 Jun 2023 · 0 repositories · arXiv:2306.16122
-
Improving Visual Prompt Tuning for Self-supervised Vision Transformers 8 Jun 2023 · 1 repository · arXiv:2306.05067Syntology official (archive's flag): 4 ran · 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Augmentation-aware Self-supervised Learning with Conditioned Projector 31 May 2023 · 1 repository · arXiv:2306.06082Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Matrix Information Theory for Self-Supervised Learning 27 May 2023 · 3 repositories · arXiv:2305.17326Syntology official (archive's flag): 3 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Learning Better Contrastive View from Radiologist's Gaze 15 May 2023 · 1 repository · arXiv:2305.08826
-
Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations 25 Apr 2023 · 0 repositories · arXiv:2304.13089
-
Adaptive Data Augmentation for Contrastive Learning 5 Apr 2023 · 0 repositories · arXiv:2304.02451
-
Multi-Level Contrastive Learning for Dense Prediction Task 4 Apr 2023 · 1 repository · arXiv:2304.02010
-
MOMA:Distill from Self-Supervised Teachers 4 Feb 2023 · 0 repositories · arXiv:2302.02089
-
USER: Unified Semantic Enhancement with Momentum Contrast for Image-Text Retrieval 17 Jan 2023 · 1 repository · arXiv:2301.06844
-
A Unified Framework for Contrastive Learning from a Perspective of Affinity Matrix 26 Nov 2022 · 0 repositories · arXiv:2211.14516
-
Improving Pixel-Level Contrastive Learning by Leveraging Exogenous Depth Information 18 Nov 2022 · 0 repositories · arXiv:2211.10177
-
Unsupervised Face Recognition using Unlabeled Synthetic Data 14 Nov 2022 · 1 repository · arXiv:2211.07371
-
Rare Wildlife Recognition with Self-Supervised Representation Learning 29 Oct 2022 · 1 repository · arXiv:2211.05636
-
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification 23 Oct 2022 · 1 repository · arXiv:2210.12843Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Improving Molecular Pretraining with Complementary Featurizations 29 Sep 2022 · 1 repository · arXiv:2209.15101Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Effective Adaptation in Multi-Task Co-Training for Unified Autonomous Driving 19 Sep 2022 · 0 repositories · arXiv:2209.08953
-
Multimodal contrastive learning for remote sensing tasks 6 Sep 2022 · 0 repositories · arXiv:2209.02329
-
On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning 11 Aug 2022 · 0 repositories · arXiv:2208.05744
-
Revisiting the Critical Factors of Augmentation-Invariant Representation Learning 30 Jul 2022 · 1 repository · arXiv:2208.00275Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentation 28 Jul 2022 · 1 repository · arXiv:2207.14315Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Fast-MoCo: Boost Momentum-based Contrastive Learning with Combinatorial Patches 17 Jul 2022 · 1 repository · arXiv:2207.08220Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning 21 Jun 2022 · 2 repositories · arXiv:2206.10698
-
Evaluation of Contrastive Learning with Various Code Representations for Code Clone Detection 17 Jun 2022 · 0 repositories · arXiv:2206.08726
-
Extending Momentum Contrast with Cross Similarity Consistency Regularization 7 Jun 2022 · 0 repositories · arXiv:2206.04676
-
New Core-Guided and Hitting Set Algorithms for Multi-Objective Combinatorial Optimization 22 Apr 2022 · 0 repositories · arXiv:2204.10856
-
Contrastive Test-Time Adaptation 21 Apr 2022 · 1 repository · arXiv:2204.10377Syntology official (archive's flag): 23 ran · 23 ran (of which 6 constructed an object rather than computing a result; 12 with no instrument failure: 4 honoured, 2 violated, 6 with no contract checked; 11 where Syntology's instrument failed) · 9 unverified (of 32 harvested samples) · 32 pointer-only (licence)
-
Representation Learning by Detecting Incorrect Location Embeddings 10 Apr 2022 · 1 repository · arXiv:2204.04788
-
POS-BERT: Point Cloud One-Stage BERT Pre-Training 3 Apr 2022 · 1 repository · arXiv:2204.00989
-
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo 30 Mar 2022 · 2 repositories · arXiv:2203.17248Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Pareto Set Learning for Neural Multi-objective Combinatorial Optimization 29 Mar 2022 · 1 repository · arXiv:2203.15386Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)
-
R3M: A Universal Visual Representation for Robot Manipulation 23 Mar 2022 · 1 repository · arXiv:2203.12601Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
DATA: Domain-Aware and Task-Aware Self-supervised Learning 17 Mar 2022 · 1 repository · arXiv:2203.09041Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
InsCon:Instance Consistency Feature Representation via Self-Supervised Learning 15 Mar 2022 · 0 repositories · arXiv:2203.07688
-
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features 3 Mar 2022 · 0 repositories · arXiv:2203.01881
-
Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learning 22 Feb 2022 · 1 repository · arXiv:2202.11202Syntology official (archive's flag): 13 ran · 13 ran (of which 5 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 18 harvested samples)
-
S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification 21 Feb 2022 · 1 repository · arXiv:2202.10139
-
Energy-Based Contrastive Learning of Visual Representations 10 Feb 2022 · 1 repository · arXiv:2202.04933Syntology official (archive's flag): 12 ran · 12 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples) · 14 pointer-only (licence)
-
Crafting Better Contrastive Views for Siamese Representation Learning 7 Feb 2022 · 1 repository · arXiv:2202.03278Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework 7 Feb 2022 · 4 repositories · arXiv:2202.03052Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Lung Swapping Autoencoder: Learning a Disentangled Structure-texture Representation of Chest Radiographs 18 Jan 2022 · 1 repository · arXiv:2201.07344
-
Self-Supervision and Multi-Task Learning: Challenges in Fine-Grained COVID-19 Multi-Class Classification from Chest X-rays 16 Jan 2022 · 0 repositories · arXiv:2201.06052
-
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework 9 Dec 2021 · 1 repository · arXiv:2112.05141
-
InsCLR: Improving Instance Retrieval with Self-Supervision 2 Dec 2021 · 1 repository · arXiv:2112.01390
-
PreViTS: Contrastive Pretraining with Video Tracking Supervision 1 Dec 2021 · 0 repositories · arXiv:2112.00804
-
Boosting Discriminative Visual Representation Learning with Scenario-Agnostic Mixup 30 Nov 2021 · 1 repository · arXiv:2111.15454
-
Contrastive Object-level Pre-training with Spatial Noise Curriculum Learning 26 Nov 2021 · 1 repository · arXiv:2111.13651
-
Self-Distilled Self-Supervised Representation Learning 25 Nov 2021 · 1 repository · arXiv:2111.12958Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 2 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 3 pointer-only (licence)
-
RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning? 24 Nov 2021 · 2 repositories · arXiv:2111.12309
-
Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning 27 Oct 2021 · 1 repository · arXiv:2110.14805Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Self-supervised EEG Representation Learning for Automatic Sleep Staging 27 Oct 2021 · 1 repository · arXiv:2110.15278
-
Decoupled Contrastive Learning 13 Oct 2021 · 4 repositories · arXiv:2110.06848Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 2 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 3 pointer-only (licence)
-
8-bit Optimizers via Block-wise Quantization 6 Oct 2021 · 3 repositories · arXiv:2110.02861
-
Motion-aware Contrastive Video Representation Learning via Foreground-background Merging 30 Sep 2021 · 1 repository · arXiv:2109.15130
-
Disentangling Properties of Contrastive Methods 29 Sep 2021 · 0 repositories
-
ESCo: Towards Provably Effective and Scalable Contrastive Representation Learning 29 Sep 2021 · 0 repositories
-
Piecing and Chipping: An effective solution for the information-erasing view generation in Self-supervised Learning 29 Sep 2021 · 0 repositories
-
Preference Conditioned Neural Multi-objective Combinatorial Optimization 29 Sep 2021 · 0 repositories
-
Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancers 13 Sep 2021 · 0 repositories · arXiv:2109.05819
-
Contrastive Learning with Temporal Correlated Medical Images: A Case Study using Lung Segmentation in Chest X-Rays 7 Sep 2021 · 1 repository · arXiv:2109.03233
-
Sensor Data Augmentation by Resampling for Contrastive Learning in Human Activity Recognition 5 Sep 2021 · 0 repositories · arXiv:2109.02054
-
Cross-token Modeling with Conditional Computation 5 Sep 2021 · 0 repositories · arXiv:2109.02008
-
Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast 1 Sep 2021 · 0 repositories · arXiv:2109.00253
-
MultiSiam: Self-supervised Multi-instance Siamese Representation Learning for Autonomous Driving 27 Aug 2021 · 1 repository · arXiv:2108.12178
Tasks archive 2025-07-28
20 shown of 165 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections