{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/moco","slug":"moco","name":"MoCo","full_name":"Momentum Contrast","full_name_withheld":false,"description_markdown":"**MoCo**, or **Momentum Contrast**, is a self-supervised learning algorithm with a contrastive loss. \r\n\r\nContrastive loss methods can be thought of as building dynamic dictionaries. The \"keys\" (tokens) in the dictionary are sampled from data (e.g., images or patches) and are represented by an encoder network. Unsupervised learning trains encoders to perform dictionary look-up: an encoded “query” should be similar to its matching key and dissimilar to others. Learning is formulated as minimizing a contrastive loss. \r\n\r\nMoCo can be viewed as a way to build large and consistent dictionaries for unsupervised learning with a contrastive loss. In MoCo, we maintain the dictionary as a queue of data samples: the encoded representations of the current mini-batch are enqueued, and the oldest are dequeued. The queue decouples the dictionary size from the mini-batch size, allowing it to be large. Moreover, as the dictionary keys come from the preceding several mini-batches, a slowly progressing key encoder, implemented as a momentum-based moving average of the query encoder, is proposed to maintain consistency.","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/1911.05722v3","title":"Momentum Contrast for Unsupervised Visual Representation Learning","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/facebookresearch/moco/blob/3631be074a0a14ab85c206631729fe035e54b525/moco/builder.py#L6","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Self-Supervised Learning","url":"/methods/category/self-supervised-learning","pwc_aliases":[]}],"n_papers_tagged":148,"archive_num_papers":null,"papers_newest_first":[{"paper":"/paper/graph-supported-dynamic-algorithm","slug":"graph-supported-dynamic-algorithm","title":"Graph-Supported Dynamic Algorithm Configuration for Multi-Objective Combinatorial Optimization","date":"2025-05-22","arxiv_id":"2505.16471","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","official":{"repos":["robbertreijnen/gs-modac"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"variational-self-supervised-learning","title":"Variational Self-Supervised Learning","date":"2025-04-06","arxiv_id":"2504.04318","n_code_links":0,"syntology":null},{"paper":null,"slug":"task-specific-knowledge-distillation-from-the","title":"Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation","date":"2025-03-10","arxiv_id":"2503.06976","n_code_links":0,"syntology":null},{"paper":"/paper/dataset-ownership-verification-in-contrastive","slug":"dataset-ownership-verification-in-contrastive","title":"Dataset Ownership Verification in Contrastive Pre-trained Models","date":"2025-02-11","arxiv_id":"2502.07276","n_code_links":1,"syntology":null},{"paper":null,"slug":"self-supervised-benchmark-lottery-on-imagenet","title":"Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets?","date":"2025-01-26","arxiv_id":"2501.15431","n_code_links":0,"syntology":null},{"paper":null,"slug":"language-modulates-vision-evidence-from","title":"Language modulates vision: Evidence from neural networks and human brain-lesion models","date":"2025-01-23","arxiv_id":"2501.13628","n_code_links":0,"syntology":null},{"paper":"/paper/enhancing-contrastive-learning-inspired-by","slug":"enhancing-contrastive-learning-inspired-by","title":"Enhancing Contrastive Learning Inspired by the Philosophy of \"The Blind Men and the Elephant\"","date":"2024-12-21","arxiv_id":"2412.16522","n_code_links":1,"syntology":null},{"paper":"/paper/scan-bootstrapping-contrastive-pre-training","slug":"scan-bootstrapping-contrastive-pre-training","title":"SCAN: Bootstrapping Contrastive Pre-training for Data Efficiency","date":"2024-11-14","arxiv_id":"2411.09126","n_code_links":1,"syntology":null},{"paper":null,"slug":"accelerating-augmentation-invariance","title":"Accelerating Augmentation Invariance Pretraining","date":"2024-10-27","arxiv_id":"2410.22364","n_code_links":0,"syntology":null},{"paper":null,"slug":"pathmoco-a-novel-framework-to-improve-feature","title":"SRA: A Novel Method to Improve Feature Embedding in Self-supervised Learning for Histopathological Images","date":"2024-10-23","arxiv_id":"2410.17514","n_code_links":0,"syntology":null},{"paper":"/paper/synco-synthetic-hard-negatives-in-contrastive","slug":"synco-synthetic-hard-negatives-in-contrastive","title":"SynCo: Synthetic Hard Negatives in Contrastive Learning for Better Unsupervised Visual Representations","date":"2024-10-03","arxiv_id":"2410.02401","n_code_links":1,"syntology":null},{"paper":"/paper/moner-motion-correction-in-undersampled","slug":"moner-motion-correction-in-undersampled","title":"Moner: Motion Correction in Undersampled Radial MRI with Unsupervised Neural Representation","date":"2024-09-25","arxiv_id":"2409.16921","n_code_links":1,"syntology":{"ran":4,"of":6,"n_ran_checked":2,"n_instrument":2,"unverified":2,"pointer_only":5,"phrase":"4 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","official":{"repos":["iwuqing/moner"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":1,"n_ran_no_instrument_failure":2,"n_unverified":2,"ran_from_kinds":["found_in_text","official"]}}},{"paper":"/paper/upper-body-free-breathing-magnetic-resonance","slug":"upper-body-free-breathing-magnetic-resonance","title":"Upper-body free-breathing Magnetic Resonance Fingerprinting applied to the quantification of water T1 and fat fraction","date":"2024-09-24","arxiv_id":"2409.16200","n_code_links":1,"syntology":null},{"paper":"/paper/cross-model-cross-stream-learning-for-self","slug":"cross-model-cross-stream-learning-for-self","title":"Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition","date":"2024-09-23","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/drl-based-resource-allocation-for-motion-blur","slug":"drl-based-resource-allocation-for-motion-blur","title":"DRL-Based Resource Allocation for Motion Blur Resistant Federated Self-Supervised Learning in IoV","date":"2024-08-17","arxiv_id":"2408.09194","n_code_links":1,"syntology":null},{"paper":null,"slug":"boosting-adverse-weather-crowd-counting-via","title":"Boosting Adverse Weather Crowd Counting via Multi-queue Contrastive Learning","date":"2024-08-12","arxiv_id":"2408.05956","n_code_links":0,"syntology":null},{"paper":null,"slug":"2408-03230","title":"Contrastive Learning for Image Complexity Representation","date":"2024-08-06","arxiv_id":"2408.03230","n_code_links":0,"syntology":null},{"paper":null,"slug":"alignment-calibration-machine-unlearning-for","title":"Alignment Calibration: Machine Unlearning for Contrastive Learning under Auditing","date":"2024-06-05","arxiv_id":"2406.03603","n_code_links":0,"syntology":null},{"paper":null,"slug":"widin-wording-image-for-domain-invariant","title":"WIDIn: Wording Image for Domain-Invariant Representation in Single-Source Domain Generalization","date":"2024-05-28","arxiv_id":"2405.18405","n_code_links":0,"syntology":null},{"paper":null,"slug":"towards-geometry-aware-pareto-set-learning","title":"Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization","date":"2024-05-14","arxiv_id":"2405.08604","n_code_links":0,"syntology":null},{"paper":"/paper/additive-margin-in-contrastive-self","slug":"additive-margin-in-contrastive-self","title":"Additive Margin in Contrastive Self-Supervised Frameworks to Learn Discriminative Speaker Representations","date":"2024-04-23","arxiv_id":"2404.14913","n_code_links":1,"syntology":null},{"paper":null,"slug":"overcoming-dimensional-collapse-in-self","title":"Overcoming Dimensional Collapse in Self-supervised Contrastive Learning for Medical Image Segmentation","date":"2024-02-22","arxiv_id":"2402.14611","n_code_links":0,"syntology":null},{"paper":null,"slug":"f-micl-understanding-and-generalizing-infonce","title":"$f$-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning","date":"2024-02-15","arxiv_id":"2402.10150","n_code_links":0,"syntology":null},{"paper":"/paper/moco-a-learnable-meta-optimizer-for","slug":"moco-a-learnable-meta-optimizer-for","title":"Moco: A Learnable Meta Optimizer for Combinatorial Optimization","date":"2024-02-07","arxiv_id":"2402.04915","n_code_links":1,"syntology":{"ran":9,"of":10,"n_ran_checked":7,"n_instrument":2,"unverified":1,"pointer_only":0,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":{"repos":["timd3/moco"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":7,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/diffclone-enhanced-behaviour-cloning-in","slug":"diffclone-enhanced-behaviour-cloning-in","title":"DiffClone: Enhanced Behaviour Cloning in Robotics with Diffusion-Driven Policy Learning","date":"2024-01-17","arxiv_id":"2401.09243","n_code_links":1,"syntology":{"ran":3,"of":3,"n_ran_checked":2,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["sirabas369/diffclone"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"a-beam-segmenting-polar-format-algorithm","title":"A Beam-Segmenting Polar Format Algorithm Based on Double PCS for Video SAR Persistent Imaging","date":"2023-12-19","arxiv_id":"2401.10252","n_code_links":0,"syntology":null},{"paper":null,"slug":"sassl-enhancing-self-supervised-learning-via","title":"SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer","date":"2023-12-02","arxiv_id":"2312.01187","n_code_links":0,"syntology":null},{"paper":null,"slug":"maximum-entropy-model-correction-in","title":"Maximum Entropy Model Correction in Reinforcement Learning","date":"2023-11-29","arxiv_id":"2311.17855","n_code_links":0,"syntology":null},{"paper":null,"slug":"moco-transfer-investigating-out-of","title":"MoCo-Transfer: Investigating out-of-distribution contrastive learning for limited-data domains","date":"2023-11-15","arxiv_id":"2311.09401","n_code_links":0,"syntology":null},{"paper":null,"slug":"samclr-contrastive-pre-training-on-complex","title":"SAMCLR: Contrastive pre-training on complex scenes using SAM for view sampling","date":"2023-10-23","arxiv_id":"2310.14736","n_code_links":0,"syntology":null},{"paper":"/paper/neural-multi-objective-combinatorial","slug":"neural-multi-objective-combinatorial","title":"Neural Multi-Objective Combinatorial Optimization with Diversity Enhancement","date":"2023-10-22","arxiv_id":"2310.15195","n_code_links":1,"syntology":{"ran":1,"of":8,"n_ran_checked":0,"n_instrument":1,"unverified":7,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified","official":{"repos":["bill-cjb/nhde"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":7,"ran_from_kinds":["official"]}}},{"paper":"/paper/adaptive-multi-head-contrastive-learning","slug":"adaptive-multi-head-contrastive-learning","title":"Adaptive Multi-head Contrastive Learning","date":"2023-10-09","arxiv_id":"2310.05615","n_code_links":1,"syntology":null},{"paper":null,"slug":"adapting-self-supervised-representations-to","title":"Adapting Self-Supervised Representations to Multi-Domain Setups","date":"2023-09-07","arxiv_id":"2309.03999","n_code_links":0,"syntology":null},{"paper":null,"slug":"conic-descent-redux-for-memory-efficient","title":"Conic Descent Redux for Memory-Efficient Optimization","date":"2023-08-13","arxiv_id":"2308.07343","n_code_links":0,"syntology":null},{"paper":"/paper/dystress-dynamically-scaled-temperature-in","slug":"dystress-dynamically-scaled-temperature-in","title":"Dynamically Scaled Temperature in Self-Supervised Contrastive Learning","date":"2023-08-02","arxiv_id":"2308.01140","n_code_links":1,"syntology":null},{"paper":"/paper/joint-adversarial-and-collaborative-learning","slug":"joint-adversarial-and-collaborative-learning","title":"Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition","date":"2023-07-15","arxiv_id":"2307.07791","n_code_links":2,"syntology":null},{"paper":null,"slug":"semantic-positive-pairs-for-enhancing","title":"Semantic Positive Pairs for Enhancing Visual Representation Learning of Instance Discrimination methods","date":"2023-06-28","arxiv_id":"2306.16122","n_code_links":0,"syntology":null},{"paper":"/paper/improving-visual-prompt-tuning-for-self","slug":"improving-visual-prompt-tuning-for-self","title":"Improving Visual Prompt Tuning for Self-supervised Vision Transformers","date":"2023-06-08","arxiv_id":"2306.05067","n_code_links":1,"syntology":{"ran":4,"of":4,"n_ran_checked":4,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["ryongithub/gatedprompttuning"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":3,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/augmentation-aware-self-supervised-learning","slug":"augmentation-aware-self-supervised-learning","title":"Augmentation-aware Self-supervised Learning with Conditioned Projector","date":"2023-05-31","arxiv_id":"2306.06082","n_code_links":1,"syntology":{"ran":4,"of":9,"n_ran_checked":0,"n_instrument":4,"unverified":5,"pointer_only":9,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified","official":{"repos":["gmum/cassle"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":5,"ran_from_kinds":["official"]}}},{"paper":"/paper/kernel-ssl-kernel-kl-divergence-for-self","slug":"kernel-ssl-kernel-kl-divergence-for-self","title":"Matrix Information Theory for Self-Supervised Learning","date":"2023-05-27","arxiv_id":"2305.17326","n_code_links":3,"syntology":{"ran":5,"of":5,"n_ran_checked":1,"n_instrument":4,"unverified":0,"pointer_only":5,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified","official":{"repos":["yifanzhang-pro/matrix-llm","yifanzhang-pro/matrix-ssl"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official","unlocated"]}}},{"paper":"/paper/learning-better-contrastive-view-from","slug":"learning-better-contrastive-view-from","title":"Learning Better Contrastive View from Radiologist's Gaze","date":"2023-05-15","arxiv_id":"2305.08826","n_code_links":1,"syntology":null},{"paper":null,"slug":"objectives-matter-understanding-the-impact-of","title":"Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations","date":"2023-04-25","arxiv_id":"2304.13089","n_code_links":0,"syntology":null},{"paper":null,"slug":"adaptive-data-augmentation-for-contrastive","title":"Adaptive Data Augmentation for Contrastive Learning","date":"2023-04-05","arxiv_id":"2304.02451","n_code_links":0,"syntology":null},{"paper":"/paper/multi-level-contrastive-learning-for-dense","slug":"multi-level-contrastive-learning-for-dense","title":"Multi-Level Contrastive Learning for Dense Prediction Task","date":"2023-04-04","arxiv_id":"2304.02010","n_code_links":1,"syntology":null},{"paper":null,"slug":"moma-distill-from-self-supervised-teachers","title":"MOMA:Distill from Self-Supervised Teachers","date":"2023-02-04","arxiv_id":"2302.02089","n_code_links":0,"syntology":null},{"paper":"/paper/user-unified-semantic-enhancement-with","slug":"user-unified-semantic-enhancement-with","title":"USER: Unified Semantic Enhancement with Momentum Contrast for Image-Text Retrieval","date":"2023-01-17","arxiv_id":"2301.06844","n_code_links":1,"syntology":null},{"paper":null,"slug":"a-unified-framework-for-contrastive-learning","title":"A Unified Framework for Contrastive Learning from a Perspective of Affinity Matrix","date":"2022-11-26","arxiv_id":"2211.14516","n_code_links":0,"syntology":null},{"paper":null,"slug":"improving-pixel-level-contrastive-learning-by","title":"Improving Pixel-Level Contrastive Learning by Leveraging Exogenous Depth Information","date":"2022-11-18","arxiv_id":"2211.10177","n_code_links":0,"syntology":null},{"paper":"/paper/unsupervised-face-recognition-using-unlabeled","slug":"unsupervised-face-recognition-using-unlabeled","title":"Unsupervised Face Recognition using Unlabeled Synthetic Data","date":"2022-11-14","arxiv_id":"2211.07371","n_code_links":1,"syntology":null},{"paper":"/paper/rare-wildlife-recognition-with-self","slug":"rare-wildlife-recognition-with-self","title":"Rare Wildlife Recognition with Self-Supervised Representation Learning","date":"2022-10-29","arxiv_id":"2211.05636","n_code_links":1,"syntology":null},{"paper":"/paper/delving-into-masked-autoencoders-for-multi","slug":"delving-into-masked-autoencoders-for-multi","title":"Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification","date":"2022-10-23","arxiv_id":"2210.12843","n_code_links":1,"syntology":{"ran":1,"of":2,"n_ran_checked":1,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["lambert-x/medical_mae"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/improving-molecular-pretraining-with","slug":"improving-molecular-pretraining-with","title":"Improving Molecular Pretraining with Complementary Featurizations","date":"2022-09-29","arxiv_id":"2209.15101","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["Data-reindeer/MOCO"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"effective-adaptation-in-multi-task-co","title":"Effective Adaptation in Multi-Task Co-Training for Unified Autonomous Driving","date":"2022-09-19","arxiv_id":"2209.08953","n_code_links":0,"syntology":null},{"paper":null,"slug":"multimodal-contrastive-learning-for-remote","title":"Multimodal contrastive learning for remote sensing tasks","date":"2022-09-06","arxiv_id":"2209.02329","n_code_links":0,"syntology":null},{"paper":null,"slug":"on-the-pros-and-cons-of-momentum-encoder-in","title":"On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning","date":"2022-08-11","arxiv_id":"2208.05744","n_code_links":0,"syntology":null},{"paper":"/paper/revisiting-the-critical-factors-of","slug":"revisiting-the-critical-factors-of","title":"Revisiting the Critical Factors of Augmentation-Invariant Representation Learning","date":"2022-07-30","arxiv_id":"2208.00275","n_code_links":1,"syntology":{"ran":4,"of":5,"n_ran_checked":2,"n_instrument":2,"unverified":1,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":{"repos":["megvii-research/revisitairl"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/spot-the-difference-self-supervised-pre","slug":"spot-the-difference-self-supervised-pre","title":"SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentation","date":"2022-07-28","arxiv_id":"2207.14315","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":2,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":null}},{"paper":"/paper/fast-moco-boost-momentum-based-contrastive","slug":"fast-moco-boost-momentum-based-contrastive","title":"Fast-MoCo: Boost Momentum-based Contrastive Learning with Combinatorial Patches","date":"2022-07-17","arxiv_id":"2207.08220","n_code_links":1,"syntology":{"ran":1,"of":4,"n_ran_checked":0,"n_instrument":1,"unverified":3,"pointer_only":4,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","official":{"repos":["orashi/fast-moco"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":"/paper/tico-transformation-invariance-and-covariance","slug":"tico-transformation-invariance-and-covariance","title":"TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning","date":"2022-06-21","arxiv_id":"2206.10698","n_code_links":2,"syntology":null},{"paper":null,"slug":"evaluation-of-contrastive-learning-with","title":"Evaluation of Contrastive Learning with Various Code Representations for Code Clone Detection","date":"2022-06-17","arxiv_id":"2206.08726","n_code_links":0,"syntology":null},{"paper":null,"slug":"extending-momentum-contrast-with-cross","title":"Extending Momentum Contrast with Cross Similarity Consistency Regularization","date":"2022-06-07","arxiv_id":"2206.04676","n_code_links":0,"syntology":null},{"paper":null,"slug":"new-core-guided-and-hitting-set-algorithms","title":"New Core-Guided and Hitting Set Algorithms for Multi-Objective Combinatorial Optimization","date":"2022-04-22","arxiv_id":"2204.10856","n_code_links":0,"syntology":null},{"paper":"/paper/contrastive-test-time-adaptation","slug":"contrastive-test-time-adaptation","title":"Contrastive Test-Time Adaptation","date":"2022-04-21","arxiv_id":"2204.10377","n_code_links":1,"syntology":{"ran":23,"of":32,"n_ran_checked":12,"n_instrument":11,"unverified":9,"pointer_only":32,"phrase":"23 ran (of which 6 constructed an object rather than computing a result; 12 with no instrument failure: 4 honoured, 2 violated, 6 with no contract checked; 11 where Syntology's instrument failed) · 9 unverified","official":{"repos":["DianCh/AdaContrast"],"state":"official (archive's flag): 23 ran","n_ran":23,"n_constructed":6,"n_ran_no_instrument_failure":12,"n_unverified":8,"ran_from_kinds":["official"]}}},{"paper":"/paper/dilemma-self-supervised-shape-and-texture","slug":"dilemma-self-supervised-shape-and-texture","title":"Representation Learning by Detecting Incorrect Location Embeddings","date":"2022-04-10","arxiv_id":"2204.04788","n_code_links":1,"syntology":null},{"paper":"/paper/pos-bert-point-cloud-one-stage-bert-pre","slug":"pos-bert-point-cloud-one-stage-bert-pre","title":"POS-BERT: Point Cloud One-Stage BERT Pre-Training","date":"2022-04-03","arxiv_id":"2204.00989","n_code_links":1,"syntology":null},{"paper":"/paper/dual-temperature-helps-contrastive-learning","slug":"dual-temperature-helps-contrastive-learning","title":"Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo","date":"2022-03-30","arxiv_id":"2203.17248","n_code_links":2,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["ChaoningZhang/Dual-temperature"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"paper":"/paper/pareto-set-learning-for-neural-multi","slug":"pareto-set-learning-for-neural-multi","title":"Pareto Set Learning for Neural Multi-objective Combinatorial Optimization","date":"2022-03-29","arxiv_id":"2203.15386","n_code_links":1,"syntology":{"ran":0,"of":2,"n_ran_checked":0,"n_instrument":0,"unverified":2,"pointer_only":0,"phrase":"0 ran · 2 unverified","official":{"repos":["xi-l/pmoco"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":2,"ran_from_kinds":[]}}},{"paper":"/paper/r3m-a-universal-visual-representation-for","slug":"r3m-a-universal-visual-representation-for","title":"R3M: A Universal Visual Representation for Robot Manipulation","date":"2022-03-23","arxiv_id":"2203.12601","n_code_links":1,"syntology":{"ran":5,"of":6,"n_ran_checked":4,"n_instrument":1,"unverified":1,"pointer_only":6,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","official":{"repos":["facebookresearch/r3m"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/data-domain-aware-and-task-aware-pre-training","slug":"data-domain-aware-and-task-aware-pre-training","title":"DATA: Domain-Aware and Task-Aware Self-supervised Learning","date":"2022-03-17","arxiv_id":"2203.09041","n_code_links":1,"syntology":{"ran":1,"of":2,"n_ran_checked":1,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["gaia-vision/gaia-ssl"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"inscon-instance-consistency-feature","title":"InsCon:Instance Consistency Feature Representation via Self-Supervised Learning","date":"2022-03-15","arxiv_id":"2203.07688","n_code_links":0,"syntology":null},{"paper":null,"slug":"understanding-failure-modes-of-self","title":"Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features","date":"2022-03-03","arxiv_id":"2203.01881","n_code_links":0,"syntology":null},{"paper":"/paper/indiscriminate-poisoning-attacks-on","slug":"indiscriminate-poisoning-attacks-on","title":"Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learning","date":"2022-02-22","arxiv_id":"2202.11202","n_code_links":1,"syntology":{"ran":13,"of":18,"n_ran_checked":9,"n_instrument":4,"unverified":5,"pointer_only":0,"phrase":"13 ran (of which 5 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified","official":{"repos":["kaiwenzha/contrastive-poisoning"],"state":"official (archive's flag): 13 ran","n_ran":13,"n_constructed":5,"n_ran_no_instrument_failure":9,"n_unverified":5,"ran_from_kinds":["official"]}}},{"paper":"/paper/s3t-self-supervised-pre-training-with-swin","slug":"s3t-self-supervised-pre-training-with-swin","title":"S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification","date":"2022-02-21","arxiv_id":"2202.10139","n_code_links":1,"syntology":null},{"paper":"/paper/energy-based-contrastive-learning-of-visual","slug":"energy-based-contrastive-learning-of-visual","title":"Energy-Based Contrastive Learning of Visual Representations","date":"2022-02-10","arxiv_id":"2202.04933","n_code_links":1,"syntology":{"ran":12,"of":14,"n_ran_checked":5,"n_instrument":7,"unverified":2,"pointer_only":14,"phrase":"12 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified","official":{"repos":["1202kbs/ebclr"],"state":"official (archive's flag): 12 ran","n_ran":12,"n_constructed":2,"n_ran_no_instrument_failure":5,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":"/paper/crafting-better-contrastive-views-for-siamese-1","slug":"crafting-better-contrastive-views-for-siamese-1","title":"Crafting Better Contrastive Views for Siamese Representation Learning","date":"2022-02-07","arxiv_id":"2202.03278","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","official":{"repos":["xyupeng/contrastivecrop"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/unifying-architectures-tasks-and-modalities","slug":"unifying-architectures-tasks-and-modalities","title":"OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework","date":"2022-02-07","arxiv_id":"2202.03052","n_code_links":4,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["ofa-sys/ofa"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/lung-swapping-autoencoder-learning-a","slug":"lung-swapping-autoencoder-learning-a","title":"Lung Swapping Autoencoder: Learning a Disentangled Structure-texture Representation of Chest Radiographs","date":"2022-01-18","arxiv_id":"2201.07344","n_code_links":1,"syntology":null},{"paper":null,"slug":"challenges-in-covid-19-chest-x-ray","title":"Self-Supervision and Multi-Task Learning: Challenges in Fine-Grained COVID-19 Multi-Class Classification from Chest X-rays","date":"2022-01-16","arxiv_id":"2201.06052","n_code_links":0,"syntology":null},{"paper":"/paper/exploring-the-equivalence-of-siamese-self","slug":"exploring-the-equivalence-of-siamese-self","title":"Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework","date":"2021-12-09","arxiv_id":"2112.05141","n_code_links":1,"syntology":null},{"paper":"/paper/insclr-improving-instance-retrieval-with-self","slug":"insclr-improving-instance-retrieval-with-self","title":"InsCLR: Improving Instance Retrieval with Self-Supervision","date":"2021-12-02","arxiv_id":"2112.01390","n_code_links":1,"syntology":null},{"paper":null,"slug":"previts-contrastive-pretraining-with-video","title":"PreViTS: Contrastive Pretraining with Video Tracking Supervision","date":"2021-12-01","arxiv_id":"2112.00804","n_code_links":0,"syntology":null},{"paper":"/paper/boosting-discriminative-visual-representation","slug":"boosting-discriminative-visual-representation","title":"Boosting Discriminative Visual Representation Learning with Scenario-Agnostic Mixup","date":"2021-11-30","arxiv_id":"2111.15454","n_code_links":1,"syntology":null},{"paper":"/paper/contrastive-object-level-pre-training-with","slug":"contrastive-object-level-pre-training-with","title":"Contrastive Object-level Pre-training with Spatial Noise Curriculum Learning","date":"2021-11-26","arxiv_id":"2111.13651","n_code_links":1,"syntology":null},{"paper":"/paper/self-distilled-self-supervised-representation","slug":"self-distilled-self-supervised-representation","title":"Self-Distilled Self-Supervised Representation Learning","date":"2021-11-25","arxiv_id":"2111.12958","n_code_links":1,"syntology":{"ran":8,"of":11,"n_ran_checked":6,"n_instrument":2,"unverified":3,"pointer_only":3,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 2 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified","official":{"repos":["hagiss/sdssl"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":"/paper/regioncl-can-simple-region-swapping","slug":"regioncl-can-simple-region-swapping","title":"RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning?","date":"2021-11-24","arxiv_id":"2111.12309","n_code_links":2,"syntology":null},{"paper":"/paper/intermediate-layers-matter-in-momentum","slug":"intermediate-layers-matter-in-momentum","title":"Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning","date":"2021-10-27","arxiv_id":"2110.14805","n_code_links":1,"syntology":{"ran":3,"of":3,"n_ran_checked":3,"n_instrument":0,"unverified":0,"pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["aakashrkaku/intermdiate_layer_matter_ssl"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/self-supervised-eeg-representation-learning","slug":"self-supervised-eeg-representation-learning","title":"Self-supervised EEG Representation Learning for Automatic Sleep Staging","date":"2021-10-27","arxiv_id":"2110.15278","n_code_links":1,"syntology":null},{"paper":"/paper/decoupled-contrastive-learning-1","slug":"decoupled-contrastive-learning-1","title":"Decoupled Contrastive Learning","date":"2021-10-13","arxiv_id":"2110.06848","n_code_links":4,"syntology":{"ran":6,"of":6,"n_ran_checked":6,"n_instrument":0,"unverified":0,"pointer_only":3,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 2 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":null}},{"paper":"/paper/8-bit-optimizers-via-block-wise-quantization","slug":"8-bit-optimizers-via-block-wise-quantization","title":"8-bit Optimizers via Block-wise Quantization","date":"2021-10-06","arxiv_id":"2110.02861","n_code_links":3,"syntology":null},{"paper":"/paper/motion-aware-self-supervised-video","slug":"motion-aware-self-supervised-video","title":"Motion-aware Contrastive Video Representation Learning via Foreground-background Merging","date":"2021-09-30","arxiv_id":"2109.15130","n_code_links":1,"syntology":null},{"paper":null,"slug":"disentangling-properties-of-contrastive","title":"Disentangling Properties of Contrastive Methods","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"esco-towards-provably-effective-and-scalable","title":"ESCo: Towards Provably Effective and Scalable Contrastive Representation Learning","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"piecing-and-chipping-an-effective-solution","title":"Piecing and Chipping: An effective solution for the information-erasing view generation in Self-supervised Learning","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"preference-conditioned-neural-multi-objective","title":"Preference Conditioned Neural Multi-objective Combinatorial Optimization","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"self-supervised-learning-improves-dmmr-msi","title":"Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancers","date":"2021-09-13","arxiv_id":"2109.05819","n_code_links":0,"syntology":null},{"paper":"/paper/contrastive-learning-with-temporal-correlated","slug":"contrastive-learning-with-temporal-correlated","title":"Contrastive Learning with Temporal Correlated Medical Images: A Case Study using Lung Segmentation in Chest X-Rays","date":"2021-09-07","arxiv_id":"2109.03233","n_code_links":1,"syntology":null},{"paper":null,"slug":"sensor-data-augmentation-with-resampling-for","title":"Sensor Data Augmentation by Resampling for Contrastive Learning in Human Activity Recognition","date":"2021-09-05","arxiv_id":"2109.02054","n_code_links":0,"syntology":null},{"paper":null,"slug":"sparse-mlp-a-fully-mlp-architecture-with","title":"Cross-token Modeling with Conditional Computation","date":"2021-09-05","arxiv_id":"2109.02008","n_code_links":0,"syntology":null},{"paper":null,"slug":"aligning-cross-lingual-sentence","title":"Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast","date":"2021-09-01","arxiv_id":"2109.00253","n_code_links":0,"syntology":null},{"paper":"/paper/multisiam-self-supervised-multi-instance","slug":"multisiam-self-supervised-multi-instance","title":"MultiSiam: Self-supervised Multi-instance Siamese Representation Learning for Autonomous Driving","date":"2021-08-27","arxiv_id":"2108.12178","n_code_links":1,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":148,"with_a_code_link":87,"where_syntology_ran_a_sample":36,"not_listed_spam_title":0,"listed":148,"listed_where_code_ran":36,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":29,"every_run_a_failure_of_syntologys_instrument":7,"listed_with_a_run_with_no_instrument_failure":29,"listed_every_run_a_failure_of_syntologys_instrument":7,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":36,"papers_where_code_ran_first_page":"/method/moco/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":2,"url":"/method/moco/papers/2","json":"/method/moco/papers/2.json","rows":48},{"order":"ran","page":1,"of":1,"url":"/method/moco/papers/ran/1","json":"/method/moco/papers/ran/1.json","rows":36}],"tasks":[{"task":"/task/contrastive-learning","name":"Contrastive Learning","papers":62},{"task":"/task/self-supervised-learning","name":"Self-Supervised Learning","papers":61},{"task":"/task/representation-learning","name":"Representation Learning","papers":49},{"task":"/task/image-classification","name":"Image Classification","papers":20},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":16},{"task":"/task/object-detection","name":"Object Detection","papers":14},{"task":"/task/linear-evaluation","name":"Linear evaluation","papers":13},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":13},{"task":"/task/object-detection-1","name":"object-detection","papers":13},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":12},{"task":"/task/image-classification","name":"image-classification","papers":11},{"task":"/task/self-supervised-image-classification","name":"Self-Supervised Image Classification","papers":8},{"task":"/task/combinatorial-optimization","name":"Combinatorial Optimization","papers":7},{"task":"/task/action-recognition-in-videos","name":"Action Recognition","papers":6},{"task":"/task/classification-1","name":"Classification","papers":6},{"task":"/task/classification","name":"General Classification","papers":5},{"task":"/task/retrieval","name":"Retrieval","papers":5},{"task":"/task/image-segmentation","name":"Image Segmentation","papers":4},{"task":"/task/instance-segmentation","name":"Instance Segmentation","papers":4},{"task":"/task/language-modeling","name":"Language Modeling","papers":4}],"tasks_shown":20,"n_tasks":165,"usage_by_year":[{"year":"2019","papers":1},{"year":"2020","papers":24},{"year":"2021","papers":45},{"year":"2022","papers":32},{"year":"2023","papers":21},{"year":"2024","papers":19},{"year":"2025","papers":6}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/moco"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=MoCo","read_at":"2026-10-05T00:59:14+00:00","query":"MoCo","kind":"venue","have":"venue_papers","tier":null,"verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"venue":"MOCO"},"resolution":"venue","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":null,"repositories":null,"retrieve_with":null,"name_competition":null,"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"matched a conference, 'MOCO', not a method (venue_papers). A venue has no implementation, so this does not say whether this method has code.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"cd489bd47302c1a87b7d94ff7eda23b49eb6f4e63d3da43bc0a4b7eac71bfadd","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}