{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/contrastive-predictive-coding","slug":"contrastive-predictive-coding","name":"Contrastive Predictive Coding","full_name":"Contrastive Predictive Coding","full_name_withheld":false,"description_markdown":"**Contrastive Predictive Coding (CPC)** learns self-supervised representations by predicting the future in latent space by using powerful autoregressive models. The model uses a probabilistic contrastive loss which induces the latent space to capture information that is maximally useful\r\nto predict future samples.\r\n\r\nFirst, a non-linear encoder $g\\_{enc}$ maps the input sequence of observations $x\\_{t}$ to a sequence of latent representations $z\\_{t} = g\\_{enc}\\left(x\\_{t}\\right)$, potentially with a lower temporal resolution. Next, an autoregressive model $g\\_{ar}$ summarizes all $z\\leq{t}$ in the latent space and produces a context latent representation $c\\_{t} = g\\_{ar}\\left(z\\leq{t}\\right)$.\r\n\r\nA density ratio is modelled which preserves the mutual information between $x\\_{t+k}$ and $c\\_{t}$ as follows:\r\n\r\n$$ f\\_{k}\\left(x\\_{t+k}, c\\_{t}\\right) \\propto \\frac{p\\left(x\\_{t+k}|c\\_{t}\\right)}{p\\left(x\\_{t+k}\\right)} $$\r\n\r\nwhere $\\propto$ stands for ’proportional to’ (i.e. up to a multiplicative constant). Note that the density ratio $f$ can be unnormalized (does not have to integrate to 1). The authors use a simple log-bilinear model:\r\n\r\n$$ f\\_{k}\\left(x\\_{t+k}, c\\_{t}\\right) = \\exp\\left(z^{T}\\_{t+k}W\\_{k}c\\_{t}\\right) $$\r\n\r\nAny type of autoencoder and autoregressive can be used. An example the authors opt for is strided convolutional layers with residual blocks and GRUs.\r\n\r\nThe autoencoder and autoregressive models are trained to minimize an [InfoNCE](https://paperswithcode.com/method/infonce) loss (see components).","description_state":"present","introduced_year":null,"introduced_by":{"title":"Representation Learning with Contrastive Predictive Coding","paper":"/paper/representation-learning-with-contrastive","first_author":"Aaron van den Oord","n_authors":3,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/representation-learning-with-contrastive"},"source":{"url":"http://arxiv.org/abs/1807.03748v2","title":"Representation Learning with Contrastive Predictive Coding","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/jefflai108/Contrastive-Predictive-Coding-PyTorch","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Semi-Supervised Learning Methods","url":"/methods/category/semi-supervised-learning-methods","pwc_aliases":[]},{"area":"General","area_id":"general","collection":"Self-Supervised Learning","url":"/methods/category/self-supervised-learning","pwc_aliases":[]}],"n_papers_tagged":113,"archive_num_papers":113,"papers_newest_first":[{"paper":null,"slug":"two-player-zero-sum-games-with-bandit","title":"Two-Player Zero-Sum Games with Bandit Feedback","date":"2025-06-17","arxiv_id":"2506.14518","n_code_links":0,"syntology":null},{"paper":"/paper/integration-of-contrastive-predictive-coding","slug":"integration-of-contrastive-predictive-coding","title":"Integration of Contrastive Predictive Coding and Spiking Neural Networks","date":"2025-06-10","arxiv_id":"2506.09194","n_code_links":1,"syntology":null},{"paper":null,"slug":"koopman-based-event-triggered-control-from","title":"Koopman-Based Event-Triggered Control from Data","date":"2025-04-19","arxiv_id":"2504.14334","n_code_links":0,"syntology":null},{"paper":null,"slug":"learning-transformer-based-world-models-with","title":"Learning Transformer-based World Models with Contrastive Predictive Coding","date":"2025-03-06","arxiv_id":"2503.04416","n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-representation-learning-helps","title":"Contrastive Representation Learning Helps Cross-institutional Knowledge Transfer: A Study in Pediatric Ventilation Management","date":"2025-01-23","arxiv_id":"2501.13587","n_code_links":0,"syntology":null},{"paper":null,"slug":"performance-barrier-event-triggered-pde","title":"Performance-Barrier Event-Triggered PDE Control of Traffic Flow","date":"2025-01-01","arxiv_id":"2501.00722","n_code_links":0,"syntology":null},{"paper":null,"slug":"automated-toll-management-system-using-rfid","title":"Automated Toll Management System Using RFID and Image Processing","date":"2024-12-02","arxiv_id":"2412.01728","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-contrastive-self-supervised-learning-scheme","title":"A Contrastive Self-Supervised Learning scheme for beat tracking amenable to few-shot learning","date":"2024-11-06","arxiv_id":"2411.04152","n_code_links":0,"syntology":null},{"paper":null,"slug":"trading-through-earnings-seasons-using-self","title":"Trading through Earnings Seasons using Self-Supervised Contrastive Representation Learning","date":"2024-09-25","arxiv_id":"2409.17392","n_code_links":0,"syntology":null},{"paper":"/paper/context-aware-predictive-coding-a","slug":"context-aware-predictive-coding-a","title":"Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensing","date":"2024-09-20","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/context-aware-predictive-coding-a-1","slug":"context-aware-predictive-coding-a-1","title":"Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensing","date":"2024-09-16","arxiv_id":"2410.01825","n_code_links":1,"syntology":null},{"paper":null,"slug":"hierarchical-event-triggered-systems-safe","title":"Hierarchical Event-Triggered Systems: Safe Learning of Quasi-Optimal Deadline Policies","date":"2024-09-15","arxiv_id":"2409.09812","n_code_links":0,"syntology":null},{"paper":null,"slug":"speaker-and-style-disentanglement-of-speech","title":"Speaker and Style Disentanglement of Speech Based on Contrastive Predictive Coding Supported Factorized Variational Autoencoder","date":"2024-09-05","arxiv_id":"2409.03520","n_code_links":0,"syntology":null},{"paper":"/paper/contrastive-representation-learning-for-3","slug":"contrastive-representation-learning-for-3","title":"Contrastive Representation Learning for Dynamic Link Prediction in Temporal Networks","date":"2024-08-22","arxiv_id":"2408.12753","n_code_links":1,"syntology":null},{"paper":null,"slug":"performance-barrier-event-triggered-control","title":"Performance-Barrier Event-Triggered Control of a Class of Reaction-Diffusion PDEs","date":"2024-07-11","arxiv_id":"2407.08178","n_code_links":0,"syntology":null},{"paper":null,"slug":"contextual-dynamic-pricing-algorithms","title":"Contextual Dynamic Pricing: Algorithms, Optimality, and Local Differential Privacy Constraints","date":"2024-06-04","arxiv_id":"2406.02424","n_code_links":0,"syntology":null},{"paper":null,"slug":"causal-contrastive-learning-for","title":"Causal Contrastive Learning for Counterfactual Regression Over Time","date":"2024-06-01","arxiv_id":"2406.00535","n_code_links":0,"syntology":null},{"paper":"/paper/offline-reinforcement-learning-from-datasets","slug":"offline-reinforcement-learning-from-datasets","title":"Offline Reinforcement Learning from Datasets with Structured Non-Stationarity","date":"2024-05-23","arxiv_id":"2405.14114","n_code_links":1,"syntology":{"ran":10,"of":12,"n_ran_checked":8,"n_instrument":2,"unverified":2,"pointer_only":0,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","official":{"repos":["johannesack/offlinerlstructurednonstationarity"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":8,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"multilingual-turn-taking-prediction-using","title":"Multilingual Turn-taking Prediction Using Voice Activity Projection","date":"2024-03-11","arxiv_id":"2403.06487","n_code_links":0,"syntology":null},{"paper":null,"slug":"event-triggered-robust-cooperative-output","title":"Event-Triggered Robust Cooperative Output Regulation for a Class of Linear Multi-Agent Systems with an Unknown Exosystem","date":"2024-03-01","arxiv_id":"2403.00645","n_code_links":0,"syntology":null},{"paper":null,"slug":"revisiting-speech-segmentation-and-lexicon","title":"Revisiting speech segmentation and lexicon learning with better features","date":"2024-01-31","arxiv_id":"2401.17902","n_code_links":0,"syntology":null},{"paper":"/paper/real-time-and-continuous-turn-taking","slug":"real-time-and-continuous-turn-taking","title":"Real-time and Continuous Turn-taking Prediction Using Voice Activity Projection","date":"2024-01-10","arxiv_id":"2401.04868","n_code_links":2,"syntology":null},{"paper":null,"slug":"replication-proof-bandit-mechanism-design","title":"Replication-proof Bandit Mechanism Design with Bayesian Agents","date":"2023-12-28","arxiv_id":"2312.16896","n_code_links":0,"syntology":null},{"paper":"/paper/bigger-is-not-always-better-the-effect-of","slug":"bigger-is-not-always-better-the-effect-of","title":"Bigger is not Always Better: The Effect of Context Size on Speech Pre-Training","date":"2023-12-03","arxiv_id":"2312.01515","n_code_links":1,"syntology":null},{"paper":"/paper/representation-learning-in-a-decomposed","slug":"representation-learning-in-a-decomposed","title":"Representation Learning in a Decomposed Encoder Design for Bio-inspired Hebbian Learning","date":"2023-11-22","arxiv_id":"2401.08603","n_code_links":1,"syntology":null},{"paper":null,"slug":"self-mi-efficient-multimodal-fusion-via-self","title":"Self-MI: Efficient Multimodal Fusion via Self-Supervised Multi-Task Learning with Auxiliary Mutual Information Maximization","date":"2023-11-07","arxiv_id":"2311.03785","n_code_links":0,"syntology":null},{"paper":"/paper/contrastive-difference-predictive-coding","slug":"contrastive-difference-predictive-coding","title":"Contrastive Difference Predictive Coding","date":"2023-10-31","arxiv_id":"2310.20141","n_code_links":1,"syntology":{"ran":5,"of":5,"n_ran_checked":4,"n_instrument":1,"unverified":0,"pointer_only":5,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["chongyi-zheng/td_infonce"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"learning-based-scheduling-for-information","title":"Learning-based Scheduling for Information Accuracy and Freshness in Wireless Networks","date":"2023-10-24","arxiv_id":"2310.15705","n_code_links":0,"syntology":null},{"paper":null,"slug":"listen-to-minority-encrypted-traffic","title":"Listen to Minority: Encrypted Traffic Classification for Class Imbalance with Contrastive Pre-Training","date":"2023-08-31","arxiv_id":"2308.16453","n_code_links":0,"syntology":null},{"paper":"/paper/towards-quantitative-precision-for-ecg","slug":"towards-quantitative-precision-for-ecg","title":"Towards quantitative precision for ECG analysis: Leveraging state space models, self-supervision and patient metadata","date":"2023-08-29","arxiv_id":"2308.15291","n_code_links":1,"syntology":{"ran":5,"of":7,"n_ran_checked":3,"n_instrument":2,"unverified":2,"pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","official":{"repos":["tmehari/ssm_ecg"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"federated-representation-learning-for","title":"Federated Representation Learning for Automatic Speech Recognition","date":"2023-08-03","arxiv_id":"2308.02013","n_code_links":0,"syntology":null},{"paper":null,"slug":"high-dimensional-contextual-bandit-problem","title":"High-dimensional Contextual Bandit Problem without Sparsity","date":"2023-06-19","arxiv_id":"2306.11017","n_code_links":0,"syntology":null},{"paper":null,"slug":"permutation-decision-trees","title":"Permutation Decision Trees","date":"2023-06-05","arxiv_id":"2306.02617","n_code_links":0,"syntology":null},{"paper":"/paper/contrabar-contrastive-bayes-adaptive-deep-rl","slug":"contrabar-contrastive-bayes-adaptive-deep-rl","title":"ContraBAR: Contrastive Bayes-Adaptive Deep RL","date":"2023-06-04","arxiv_id":"2306.02418","n_code_links":1,"syntology":null},{"paper":null,"slug":"an-improved-heart-disease-prediction-using","title":"An Improved Heart Disease Prediction Using Stacked Ensemble Method","date":"2023-04-12","arxiv_id":"2304.06015","n_code_links":0,"syntology":null},{"paper":null,"slug":"regularizing-contrastive-predictive-coding","title":"Regularizing Contrastive Predictive Coding for Speech Applications","date":"2023-04-12","arxiv_id":"2304.05974","n_code_links":0,"syntology":null},{"paper":null,"slug":"asynchronous-event-triggered-control-for-non","title":"Asynchronous Event-Triggered Control for Non-Linear Systems","date":"2022-11-25","arxiv_id":"2211.13846","n_code_links":0,"syntology":null},{"paper":"/paper/investigating-enhancements-to-contrastive","slug":"investigating-enhancements-to-contrastive","title":"Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition","date":"2022-11-11","arxiv_id":"2211.06173","n_code_links":1,"syntology":null},{"paper":null,"slug":"guided-contrastive-self-supervised-pre","title":"Guided contrastive self-supervised pre-training for automatic speech recognition","date":"2022-10-22","arxiv_id":"2210.12335","n_code_links":0,"syntology":null},{"paper":null,"slug":"littlebird-efficient-faster-longer","title":"LittleBird: Efficient Faster & Longer Transformer for Question Answering","date":"2022-10-21","arxiv_id":"2210.11870","n_code_links":0,"syntology":null},{"paper":null,"slug":"short-text-pre-training-with-extended-token","title":"Short Text Pre-training with Extended Token Classification for E-commerce Query Understanding","date":"2022-10-08","arxiv_id":"2210.03915","n_code_links":0,"syntology":null},{"paper":"/paper/analysis-of-self-supervised-learning-and","slug":"analysis-of-self-supervised-learning-and","title":"Analysis of Self-Supervised Learning and Dimensionality Reduction Methods in Clustering-Based Active Learning for Speech Emotion Recognition","date":"2022-06-21","arxiv_id":"2206.10188","n_code_links":1,"syntology":null},{"paper":"/paper/variable-rate-hierarchical-cpc-leads-to","slug":"variable-rate-hierarchical-cpc-leads-to","title":"Variable-rate hierarchical CPC leads to acoustic unit discovery in speech","date":"2022-06-05","arxiv_id":"2206.02211","n_code_links":1,"syntology":{"ran":3,"of":4,"n_ran_checked":2,"n_instrument":1,"unverified":1,"pointer_only":0,"phrase":"3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","official":{"repos":["chorowski-lab/hcpc"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":1,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"do-self-supervised-speech-models-develop-1","title":"Do self-supervised speech models develop human-like perception biases?","date":"2022-05-31","arxiv_id":"2205.15819","n_code_links":0,"syntology":null},{"paper":"/paper/som-cpc-unsupervised-contrastive-learning","slug":"som-cpc-unsupervised-contrastive-learning","title":"SOM-CPC: Unsupervised Contrastive Learning with Self-Organizing Maps for Structured Representations of High-Rate Time Series","date":"2022-05-31","arxiv_id":"2205.15875","n_code_links":1,"syntology":null},{"paper":null,"slug":"embed-to-control-partially-observed-systems","title":"Embed to Control Partially Observed Systems: Representation Learning with Provable Sample Efficiency","date":"2022-05-26","arxiv_id":"2205.13476","n_code_links":0,"syntology":null},{"paper":"/paper/naive-few-shot-learning-sequence-consistency","slug":"naive-few-shot-learning-sequence-consistency","title":"Naive Few-Shot Learning: Uncovering the fluid intelligence of machines","date":"2022-05-24","arxiv_id":"2205.12013","n_code_links":0,"syntology":null},{"paper":null,"slug":"zero-episode-few-shot-contrastive-predictive","title":"Zero-Episode Few-Shot Contrastive Predictive Coding: Solving intelligence tests without prior training","date":"2022-05-04","arxiv_id":"2205.01924","n_code_links":0,"syntology":null},{"paper":"/paper/thompson-sampling-for-bandit-learning-in","slug":"thompson-sampling-for-bandit-learning-in","title":"Thompson Sampling for Bandit Learning in Matching Markets","date":"2022-04-26","arxiv_id":"2204.12048","n_code_links":1,"syntology":null},{"paper":null,"slug":"probing-phoneme-language-and-speaker","title":"Probing phoneme, language and speaker information in unsupervised speech representations","date":"2022-03-30","arxiv_id":"2203.16193","n_code_links":0,"syntology":null},{"paper":null,"slug":"robust-speaker-recognition-with-transformers","title":"Robust Speaker Recognition with Transformers Using wav2vec 2.0","date":"2022-03-28","arxiv_id":"2203.15095","n_code_links":0,"syntology":null},{"paper":null,"slug":"etcetera-beyond-event-triggered-control","title":"ETCetera: beyond Event-Triggered Control","date":"2022-03-03","arxiv_id":"2203.01623","n_code_links":0,"syntology":null},{"paper":"/paper/word-segmentation-on-discovered-phone-units","slug":"word-segmentation-on-discovered-phone-units","title":"Word Segmentation on Discovered Phone Units with Dynamic Programming and Self-Supervised Scoring","date":"2022-02-24","arxiv_id":"2202.11929","n_code_links":3,"syntology":{"ran":17,"of":19,"n_ran_checked":11,"n_instrument":6,"unverified":2,"pointer_only":1,"phrase":"17 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 5 honoured, 1 violated, 5 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified","official":{"repos":["kamperh/dpdp_aernn","kamperh/vqwordseg"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"paper":null,"slug":"formal-analysis-of-the-sampling-behaviour-of","title":"Formal Analysis of the Sampling Behaviour of Stochastic Event-Triggered Control","date":"2022-02-21","arxiv_id":"2202.10178","n_code_links":0,"syntology":null},{"paper":null,"slug":"vcvts-multi-speaker-video-to-speech-synthesis","title":"VCVTS: Multi-speaker Video-to-Speech synthesis via cross-modal knowledge transfer from voice conversion","date":"2022-02-18","arxiv_id":"2202.09081","n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-predictive-coding-for-anomaly-1","title":"Contrastive predictive coding for Anomaly Detection in Multi-variate Time Series Data","date":"2022-02-08","arxiv_id":"2202.03639","n_code_links":0,"syntology":null},{"paper":null,"slug":"chaos-and-order-in-event-triggered-control","title":"Chaos and order in event-triggered control","date":"2022-01-12","arxiv_id":"2201.04462","n_code_links":0,"syntology":null},{"paper":null,"slug":"detecting-extratropical-cyclones-of-the","title":"Detecting Extratropical Cyclones of the Northern Hemisphere with Single Shot Detector","date":"2021-12-01","arxiv_id":"2112.01283","n_code_links":0,"syntology":null},{"paper":"/paper/non-intrusive-binaural-speech-intelligibility","slug":"non-intrusive-binaural-speech-intelligibility","title":"Non-Intrusive Binaural Speech Intelligibility Prediction from Discrete Latent Representations","date":"2021-11-24","arxiv_id":"2111.12531","n_code_links":1,"syntology":null},{"paper":null,"slug":"stc-speaker-recognition-systems-for-the-nist","title":"STC speaker recognition systems for the NIST SRE 2021","date":"2021-11-03","arxiv_id":"2111.02298","n_code_links":0,"syntology":null},{"paper":"/paper/contrastive-prediction-strategies-for","slug":"contrastive-prediction-strategies-for","title":"Contrastive prediction strategies for unsupervised segmentation and categorization of phonemes and words","date":"2021-10-29","arxiv_id":"2110.15909","n_code_links":1,"syntology":{"ran":1,"of":2,"n_ran_checked":1,"n_instrument":0,"unverified":1,"pointer_only":2,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["chorowski-lab/CPC_audio"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["unlocated"]}}},{"paper":null,"slug":"the-countable-armed-bandit-with-vanishing","title":"Bandits with Dynamic Arm-acquisition Costs","date":"2021-10-23","arxiv_id":"2110.12118","n_code_links":0,"syntology":null},{"paper":null,"slug":"towards-high-fidelity-singing-voice","title":"Towards High-fidelity Singing Voice Conversion with Acoustic Reference and Contrastive Predictive Coding","date":"2021-10-10","arxiv_id":"2110.04754","n_code_links":0,"syntology":null},{"paper":null,"slug":"scala-supervised-contrastive-learning-for-end","title":"SCaLa: Supervised Contrastive Learning for End-to-End Speech Recognition","date":"2021-10-08","arxiv_id":"2110.04187","n_code_links":0,"syntology":null},{"paper":null,"slug":"unsupervised-speech-segmentation-and-variable","title":"Unsupervised Speech Segmentation and Variable Rate Representation Learning using Segmental Contrastive Predictive Coding","date":"2021-10-05","arxiv_id":"2110.02345","n_code_links":0,"syntology":null},{"paper":null,"slug":"computing-the-average-inter-sample-time-of","title":"Computing the average inter-sample time of event-triggered control using quantitative automata","date":"2021-09-29","arxiv_id":"2109.14391","n_code_links":0,"syntology":null},{"paper":null,"slug":"prototypical-contrastive-predictive-coding","title":"Prototypical Contrastive Predictive Coding","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/memory-augmented-multi-instance-contrastive","slug":"memory-augmented-multi-instance-contrastive","title":"Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation","date":"2021-09-01","arxiv_id":"2109.00368","n_code_links":2,"syntology":null},{"paper":null,"slug":"uncertainties-and-output-feedback-in-rollout","title":"Uncertainties and output feedback in rollout event-triggered control","date":"2021-08-20","arxiv_id":"2108.09125","n_code_links":0,"syntology":null},{"paper":null,"slug":"rollout-event-triggered-control-reconciling","title":"Rollout event-triggered control: reconciling event- and time-triggered control","date":"2021-08-06","arxiv_id":"2108.02994","n_code_links":0,"syntology":null},{"paper":null,"slug":"debiasing-samples-from-online-learning-using","title":"Debiasing Samples from Online Learning Using Bootstrap","date":"2021-07-31","arxiv_id":"2108.00236","n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-predictive-coding-for-anomaly","title":"Contrastive Predictive Coding for Anomaly Detection","date":"2021-07-16","arxiv_id":"2107.07820","n_code_links":0,"syntology":null},{"paper":null,"slug":"model-selection-for-generic-contextual","title":"Model Selection for Generic Contextual Bandits","date":"2021-07-07","arxiv_id":"2107.03455","n_code_links":0,"syntology":null},{"paper":null,"slug":"segmental-contrastive-predictive-coding-for","title":"Segmental Contrastive Predictive Coding for Unsupervised Word Segmentation","date":"2021-06-03","arxiv_id":"2106.02170","n_code_links":0,"syntology":null},{"paper":"/paper/unsupervised-representation-learning-from","slug":"unsupervised-representation-learning-from","title":"Unsupervised Representation Learning from Pathology Images with Multi-directional Contrastive Predictive Coding","date":"2021-05-11","arxiv_id":"2105.05345","n_code_links":1,"syntology":null},{"paper":null,"slug":"voice-conversion-based-speaker-normalization","title":"Voice Conversion Based Speaker Normalization for Acoustic Unit Discovery","date":"2021-05-04","arxiv_id":"2105.01786","n_code_links":0,"syntology":null},{"paper":"/paper/vqcpc-gan-variable-length-adversarial-audio","slug":"vqcpc-gan-variable-length-adversarial-audio","title":"VQCPC-GAN: Variable-Length Adversarial Audio Synthesis Using Vector-Quantized Contrastive Predictive Coding","date":"2021-05-04","arxiv_id":"2105.01531","n_code_links":1,"syntology":null},{"paper":null,"slug":"the-interspeech-zero-resource-speech","title":"The Zero Resource Speech Challenge 2021: Spoken language modelling","date":"2021-04-29","arxiv_id":"2104.14700","n_code_links":0,"syntology":null},{"paper":"/paper/aligned-contrastive-predictive-coding","slug":"aligned-contrastive-predictive-coding","title":"Aligned Contrastive Predictive Coding","date":"2021-04-24","arxiv_id":"2104.11946","n_code_links":1,"syntology":{"ran":1,"of":2,"n_ran_checked":1,"n_instrument":0,"unverified":1,"pointer_only":2,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["chorowski-lab/CPC_audio"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["unlocated"]}}},{"paper":null,"slug":"noisevc-towards-high-quality-zero-shot-voice","title":"NoiseVC: Towards High Quality Zero-Shot Voice Conversion","date":"2021-04-13","arxiv_id":"2104.06074","n_code_links":0,"syntology":null},{"paper":null,"slug":"abstracting-the-sampling-behaviour-of","title":"Abstracting the Sampling Behaviour of Stochastic Linear Periodic Event-Triggered Control Systems","date":"2021-03-25","arxiv_id":"2103.13839","n_code_links":0,"syntology":null},{"paper":"/paper/contrastive-unsupervised-learning-for-speech","slug":"contrastive-unsupervised-learning-for-speech","title":"Contrastive Unsupervised Learning for Speech Emotion Recognition","date":"2021-02-12","arxiv_id":"2102.06357","n_code_links":0,"syntology":null},{"paper":null,"slug":"the-wireless-control-bus-enabling-efficient","title":"The Wireless Control Bus: Enabling Efficient Multi-hop Event-Triggered Control with Concurrent Transmissions","date":"2021-01-26","arxiv_id":"2101.10961","n_code_links":0,"syntology":null},{"paper":null,"slug":"novelty-detection-with-rotated-contrastive","title":"Novelty Detection with Rotated Contrastive Predictive Coding","date":"2021-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/informer-transformer-likes-informed-attention","slug":"informer-transformer-likes-informed-attention","title":"RealFormer: Transformer Likes Residual Attention","date":"2020-12-21","arxiv_id":"2012.11747","n_code_links":5,"syntology":null},{"paper":null,"slug":"a-comparison-of-self-supervised-speech","title":"A comparison of self-supervised speech representations as input features for unsupervised acoustic word embeddings","date":"2020-12-14","arxiv_id":"2012.07387","n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-predictive-coding-for-human","title":"Contrastive Predictive Coding for Human Activity Recognition","date":"2020-12-09","arxiv_id":"2012.05333","n_code_links":0,"syntology":null},{"paper":null,"slug":"unsupervised-anomaly-detection-from-semantic","title":"Unsupervised Anomaly Detection From Semantic Similarity Scores","date":"2020-12-01","arxiv_id":"2012.00461","n_code_links":0,"syntology":null},{"paper":"/paper/joint-masked-cpc-and-ctc-training-for-asr","slug":"joint-masked-cpc-and-ctc-training-for-asr","title":"Joint Masked CPC and CTC Training for ASR","date":"2020-10-30","arxiv_id":"2011.00093","n_code_links":1,"syntology":null},{"paper":"/paper/improving-perceptual-quality-by-phone","slug":"improving-perceptual-quality-by-phone","title":"Improving Perceptual Quality by Phone-Fortified Perceptual Loss using Wasserstein Distance for Speech Enhancement","date":"2020-10-28","arxiv_id":"2010.15174","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["aleXiehta/PhoneFortifiedPerceptualLoss"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"traffic-abstractions-of-nonlinear-event","title":"Abstracting the Traffic of Nonlinear Event-Triggered Control Systems","date":"2020-10-23","arxiv_id":"2010.12341","n_code_links":0,"syntology":null},{"paper":null,"slug":"machine-learning-in-event-triggered-control","title":"Machine Learning in Event-Triggered Control: Recent Advances and Open Issues","date":"2020-09-27","arxiv_id":"2009.12783","n_code_links":0,"syntology":null},{"paper":"/paper/uncovering-the-structure-of-clinical-eeg","slug":"uncovering-the-structure-of-clinical-eeg","title":"Uncovering the structure of clinical EEG signals with self-supervised learning","date":"2020-07-31","arxiv_id":"2007.16104","n_code_links":2,"syntology":{"ran":0,"of":3,"n_ran_checked":0,"n_instrument":0,"unverified":3,"pointer_only":0,"phrase":"0 ran · 3 unverified","official":null}},{"paper":null,"slug":"multi-label-contrastive-predictive-coding","title":"Multi-label Contrastive Predictive Coding","date":"2020-07-20","arxiv_id":"2007.09852","n_code_links":0,"syntology":null},{"paper":null,"slug":"analysis-of-predictive-coding-models-for","title":"Analysis of Predictive Coding Models for Phonemic Representation Learning in Small Datasets","date":"2020-07-08","arxiv_id":"2007.04205","n_code_links":0,"syntology":null},{"paper":null,"slug":"embedding-task-knowledge-into-3d-neural","title":"Embedding Task Knowledge into 3D Neural Networks via Self-supervised Learning","date":"2020-06-10","arxiv_id":"2006.05798","n_code_links":0,"syntology":null},{"paper":"/paper/3d-self-supervised-methods-for-medical","slug":"3d-self-supervised-methods-for-medical","title":"3D Self-Supervised Methods for Medical Imaging","date":"2020-06-06","arxiv_id":"2006.03829","n_code_links":1,"syntology":{"ran":14,"of":16,"n_ran_checked":14,"n_instrument":0,"unverified":2,"pointer_only":16,"phrase":"14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","official":{"repos":["HealthML/self-supervised-3d-tasks"],"state":"official (archive's flag): 14 ran","n_ran":14,"n_constructed":0,"n_ran_no_instrument_failure":14,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":"/paper/vector-quantized-neural-networks-for-acoustic","slug":"vector-quantized-neural-networks-for-acoustic","title":"Vector-quantized neural networks for acoustic unit discovery in the ZeroSpeech 2020 challenge","date":"2020-05-19","arxiv_id":"2005.09409","n_code_links":2,"syntology":null},{"paper":"/paper/cobra-contrastive-bi-modal-representation","slug":"cobra-contrastive-bi-modal-representation","title":"COBRA: Contrastive Bi-Modal Representation Algorithm","date":"2020-05-07","arxiv_id":"2005.03687","n_code_links":1,"syntology":{"ran":2,"of":4,"n_ran_checked":2,"n_instrument":0,"unverified":2,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","official":{"repos":["ovshake/cobra"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"region-based-self-triggered-control-for","title":"Region-Based Self-Triggered Control for Perturbed and Uncertain Nonlinear Systems","date":"2020-05-01","arxiv_id":"2005.00473","n_code_links":0,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":113,"with_a_code_link":39,"where_syntology_ran_a_sample":14,"not_listed_spam_title":0,"listed":113,"listed_where_code_ran":14,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":12,"every_run_a_failure_of_syntologys_instrument":2,"listed_with_a_run_with_no_instrument_failure":12,"listed_every_run_a_failure_of_syntologys_instrument":2,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":14,"papers_where_code_ran_first_page":"/method/contrastive-predictive-coding/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":2,"url":"/method/contrastive-predictive-coding/papers/2","json":"/method/contrastive-predictive-coding/papers/2.json","rows":13},{"order":"ran","page":1,"of":1,"url":"/method/contrastive-predictive-coding/papers/ran/1","json":"/method/contrastive-predictive-coding/papers/ran/1.json","rows":14}],"tasks":[{"task":"/task/representation-learning","name":"Representation Learning","papers":23},{"task":"/task/self-supervised-learning","name":"Self-Supervised Learning","papers":17},{"task":"/task/contrastive-learning","name":"Contrastive Learning","papers":10},{"task":"/task/speech-recognition","name":"Speech Recognition","papers":10},{"task":"/task/speech-recognition-1","name":"speech-recognition","papers":10},{"task":"/task/automatic-speech-recognition-2","name":"Automatic Speech Recognition","papers":9},{"task":"/task/automatic-speech-recognition","name":"Automatic Speech Recognition (ASR)","papers":7},{"task":null,"name":"Acoustic Unit Discovery","papers":6},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":6},{"task":"/task/voice-conversion","name":"Voice Conversion","papers":6},{"task":"/task/anomaly-detection","name":"Anomaly Detection","papers":5},{"task":"/task/language-modelling","name":"Language Modelling","papers":5},{"task":"/task/activity-recognition","name":"Activity Recognition","papers":4},{"task":"/task/classification","name":"General Classification","papers":4},{"task":"/task/human-activity-recognition","name":"Human Activity Recognition","papers":4},{"task":"/task/quantization","name":"Quantization","papers":4},{"task":"/task/segmentation","name":"Segmentation","papers":4},{"task":"/task/time-series-1","name":"Time Series","papers":4},{"task":"/task/disentanglement","name":"Disentanglement","papers":3},{"task":"/task/language-modeling","name":"Language Modeling","papers":3}],"tasks_shown":20,"n_tasks":137,"usage_by_year":[{"year":"2018","papers":2},{"year":"2019","papers":7},{"year":"2020","papers":20},{"year":"2021","papers":27},{"year":"2022","papers":21},{"year":"2023","papers":14},{"year":"2024","papers":16},{"year":"2025","papers":6}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/contrastive-predictive-coding"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Contrastive%20Predictive%20Coding","read_at":"2026-10-05T00:53:59+00:00","query":"Contrastive Predictive Coding","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"Contrastive Predictive Coding","origin_arxiv_id":"1807.03748"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"same_paper","archive_paper_arxiv_id":"1807.03748","repositories":{"listed":5,"in_graph":28,"list_truncated":true,"strongest_link":"mentioned_in_github"},"retrieve_with":null,"name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"1807.03748","citations":14319},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'Contrastive Predictive Coding'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[{"name":"Spectral Contrastive Loss","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='Spectral Contrastive Loss')","origin_arxiv_id":"2106.04156"},{"name":"Maximum Entropy Coding (MEC)","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='Maximum Entropy Coding (MEC)')","origin_arxiv_id":"2210.11464"},{"name":"noise-contrastive estimation","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":2,"retrieve_with":"get_reference_implementation(name='noise-contrastive estimation')","origin_arxiv_id":"2011.00717"},{"name":"Behavior Contrastive Learning","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":2,"retrieve_with":"get_reference_implementation(name='Behavior Contrastive Learning')","origin_arxiv_id":"2305.04477"},{"name":"Relative Entropy Coding (REC)","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='Relative Entropy Coding (REC)')","origin_arxiv_id":"2010.01185"},{"name":"contrastive learning framework","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='contrastive learning framework')","origin_arxiv_id":"2206.10442"}],"code_nearby_caption":"Code Syntology holds under other names, as the lookup lists them (code_nearby); not a complete list, and none of them is this method.","origin_paper":{"arxiv_id":"1807.03748","page":"/paper/representation-learning-with-contrastive","syntology_url":"https://syntology.ai/paper/1807.03748","in_graph_layer":true,"samples":45,"ran":35,"n_ran_checked":30,"n_instrument":5,"unverified":10,"phrase":"35 ran (of which 21 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 0 violated, 29 with no contract checked; 5 where Syntology's instrument failed) · 10 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"repository known, no verified implementation (declared_code; repositories: 5 listed of 28 in the graph, strongest link: mentioned on GitHub). This answer is about arXiv:1807.03748, the paper the archive credits with this method.","level_legend":{"state":"quoted","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","card_sha256":"479785a84658dd682a11b10237b3620d651d7f87799f5dc7add970aaa83f6d39","note":"Syntology's served verification levels, quoted verbatim from its MCP server card; a row is split where the card separates clauses with a double hyphen, and the separator is not reproduced","levels":[{"level":"V0","quoted":["imports"]},{"level":"V1","quoted":["executes against a synthesized fixture and returns a value of the recorded type"]},{"level":"V2","quoted":["two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs","neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)"]},{"level":"V3","quoted":["paper-derived property tests pass on both of those same two generations."]}],"no_rung":"No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results."}},"syntology_have_state":"loaded","record_sha256":"0ff03d7cb29e44b659920f7c4dea49f5cd5a68949415035c542a55cf90de470b","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}