{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/infonce","slug":"infonce","name":"InfoNCE","full_name":"InfoNCE","full_name_withheld":false,"description_markdown":"**InfoNCE**, where NCE stands for Noise-Contrastive Estimation, is a type of contrastive loss function used for [self-supervised learning](https://paperswithcode.com/methods/category/self-supervised-learning).\r\n\r\nGiven a set $X = ${$x\\_{1}, \\dots, x\\_{N}$} of $N$ random samples containing one positive sample from $p\\left(x\\_{t+k}|c\\_{t}\\right)$ and $N − 1$ negative samples from the 'proposal' distribution $p\\left(x\\_{t+k}\\right)$, we optimize:\r\n\r\n$$ \\mathcal{L}\\_{N} = - \\mathbb{E}\\_{X}\\left[\\log\\frac{f\\_{k}\\left(x\\_{t+k}, c\\_{t}\\right)}{\\sum\\_{x\\_{j}\\in{X}}f\\_{k}\\left(x\\_{j}, c\\_{t}\\right)}\\right] $$\r\n\r\nOptimizing this loss will result in $f\\_{k}\\left(x\\_{t+k}, c\\_{t}\\right)$ estimating the density ratio, which is:\r\n\r\n$$ f\\_{k}\\left(x\\_{t+k}, c\\_{t}\\right) \\propto \\frac{p\\left(x\\_{t+k}|c\\_{t}\\right)}{p\\left(x\\_{t+k}\\right)} $$","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"http://arxiv.org/abs/1807.03748v2","title":"Representation Learning with Contrastive Predictive Coding","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/jefflai108/Contrastive-Predictive-Coding-PyTorch/blob/dfe687cf463668b16b0c2e205a166dbfbc9db227/src/model/model.py#L98","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Loss Functions","url":"/methods/category/loss-functions","pwc_aliases":[]}],"n_papers_tagged":418,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"slug":"generalizing-supervised-contrastive-learning","title":"Generalizing Supervised Contrastive learning: A Projection Perspective","date":"2025-06-11","arxiv_id":"2506.09810","n_code_links":0,"syntology":null},{"paper":null,"slug":"probabilistic-variational-contrastive","title":"Probabilistic Variational Contrastive Learning","date":"2025-06-11","arxiv_id":"2506.10159","n_code_links":0,"syntology":null},{"paper":"/paper/integration-of-contrastive-predictive-coding","slug":"integration-of-contrastive-predictive-coding","title":"Integration of Contrastive Predictive Coding and Spiking Neural Networks","date":"2025-06-10","arxiv_id":"2506.09194","n_code_links":1,"syntology":null},{"paper":"/paper/conventional-contrastive-learning-often-falls","slug":"conventional-contrastive-learning-often-falls","title":"Conventional Contrastive Learning Often Falls Short: Improving Dense Retrieval with Cross-Encoder Listwise Distillation and Synthetic Data","date":"2025-05-25","arxiv_id":"2505.19274","n_code_links":1,"syntology":null},{"paper":"/paper/graph-supported-dynamic-algorithm","slug":"graph-supported-dynamic-algorithm","title":"Graph-Supported Dynamic Algorithm Configuration for Multi-Objective Combinatorial Optimization","date":"2025-05-22","arxiv_id":"2505.16471","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","official":{"repos":["robbertreijnen/gs-modac"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/rebalancing-contrastive-alignment-with","slug":"rebalancing-contrastive-alignment-with","title":"Contrastive Alignment with Semantic Gap-Aware Corrections in Text-Video Retrieval","date":"2025-05-18","arxiv_id":"2505.12499","n_code_links":1,"syntology":null},{"paper":null,"slug":"adversarial-robustness-for-unified-multi","title":"Adversarial Robustness for Unified Multi-Modal Encoders via Efficient Calibration","date":"2025-05-17","arxiv_id":"2505.11895","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-cross-feature-based-spiking-neural","title":"Self-cross Feature based Spiking Neural Networks for Efficient Few-shot Learning","date":"2025-05-12","arxiv_id":"2505.07921","n_code_links":0,"syntology":null},{"paper":null,"slug":"seeg-based-encoding-for-sentence-retrieval-a","title":"sEEG-based Encoding for Sentence Retrieval: A Contrastive Learning Approach to Brain-Language Alignment","date":"2025-04-20","arxiv_id":"2504.14468","n_code_links":0,"syntology":null},{"paper":null,"slug":"koopman-based-event-triggered-control-from","title":"Koopman-Based Event-Triggered Control from Data","date":"2025-04-19","arxiv_id":"2504.14334","n_code_links":0,"syntology":null},{"paper":null,"slug":"variational-self-supervised-learning","title":"Variational Self-Supervised Learning","date":"2025-04-06","arxiv_id":"2504.04318","n_code_links":0,"syntology":null},{"paper":null,"slug":"node-embeddings-via-neighbor-embeddings","title":"Node Embeddings via Neighbor Embeddings","date":"2025-03-31","arxiv_id":"2503.23822","n_code_links":0,"syntology":null},{"paper":"/paper/beyond-contrastive-learning-synthetic-data","slug":"beyond-contrastive-learning-synthetic-data","title":"Beyond Contrastive Learning: Synthetic Data Enables List-wise Training with Multiple Levels of Relevance","date":"2025-03-29","arxiv_id":"2503.23239","n_code_links":1,"syntology":null},{"paper":"/paper/does-gcl-need-a-large-number-of-negative","slug":"does-gcl-need-a-large-number-of-negative","title":"Does GCL Need a Large Number of Negative Samples? Enhancing Graph Contrastive Learning with Effective and Efficient Negative Sampling","date":"2025-03-23","arxiv_id":"2503.17908","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":2,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result","official":{"repos":["hedongxiao-tju/E2Neg"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":2,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/weighted-graph-structure-learning-with","slug":"weighted-graph-structure-learning-with","title":"Weighted Graph Structure Learning with Attention Denoising for Node Classification","date":"2025-03-15","arxiv_id":"2503.12157","n_code_links":1,"syntology":null},{"paper":"/paper/oasis-order-augmented-strategy-for-improved","slug":"oasis-order-augmented-strategy-for-improved","title":"OASIS: Order-Augmented Strategy for Improved Code Search","date":"2025-03-11","arxiv_id":"2503.08161","n_code_links":0,"syntology":{"ran":0,"of":1,"n_ran_checked":0,"n_instrument":0,"unverified":1,"pointer_only":1,"phrase":"0 ran · 1 unverified","official":null}},{"paper":null,"slug":"advancing-vietnamese-information-retrieval","title":"Advancing Vietnamese Information Retrieval with Learning Objective and Benchmark","date":"2025-03-10","arxiv_id":"2503.07470","n_code_links":0,"syntology":null},{"paper":null,"slug":"task-specific-knowledge-distillation-from-the","title":"Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation","date":"2025-03-10","arxiv_id":"2503.06976","n_code_links":0,"syntology":null},{"paper":null,"slug":"learning-transformer-based-world-models-with","title":"Learning Transformer-based World Models with Contrastive Predictive Coding","date":"2025-03-06","arxiv_id":"2503.04416","n_code_links":0,"syntology":null},{"paper":null,"slug":"llave-large-language-and-vision-embedding","title":"LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning","date":"2025-03-04","arxiv_id":"2503.04812","n_code_links":0,"syntology":null},{"paper":"/paper/teaching-dense-retrieval-models-to-specialize","slug":"teaching-dense-retrieval-models-to-specialize","title":"Teaching Dense Retrieval Models to Specialize with Listwise Distillation and LLM Data Augmentation","date":"2025-02-27","arxiv_id":"2502.19712","n_code_links":1,"syntology":null},{"paper":null,"slug":"distributional-vision-language-alignment-by","title":"Distributional Vision-Language Alignment by Cauchy-Schwarz Divergence","date":"2025-02-24","arxiv_id":"2502.17028","n_code_links":0,"syntology":null},{"paper":"/paper/dataset-ownership-verification-in-contrastive","slug":"dataset-ownership-verification-in-contrastive","title":"Dataset Ownership Verification in Contrastive Pre-trained Models","date":"2025-02-11","arxiv_id":"2502.07276","n_code_links":1,"syntology":null},{"paper":null,"slug":"temperature-free-loss-function-for","title":"Temperature-Free Loss Function for Contrastive Learning","date":"2025-01-29","arxiv_id":"2501.17683","n_code_links":0,"syntology":null},{"paper":null,"slug":"cspcl-category-semantic-prior-contrastive","title":"CSPCL: Category Semantic Prior Contrastive Learning for Deformable DETR-Based Prohibited Item Detectors","date":"2025-01-28","arxiv_id":"2501.16665","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-supervised-benchmark-lottery-on-imagenet","title":"Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets?","date":"2025-01-26","arxiv_id":"2501.15431","n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-representation-learning-helps","title":"Contrastive Representation Learning Helps Cross-institutional Knowledge Transfer: A Study in Pediatric Ventilation Management","date":"2025-01-23","arxiv_id":"2501.13587","n_code_links":0,"syntology":null},{"paper":null,"slug":"language-modulates-vision-evidence-from","title":"Language modulates vision: Evidence from neural networks and human brain-lesion models","date":"2025-01-23","arxiv_id":"2501.13628","n_code_links":0,"syntology":null},{"paper":null,"slug":"an-inclusive-theoretical-framework-of-robust","title":"An Inclusive Theoretical Framework of Robust Supervised Contrastive Loss against Label Noise","date":"2025-01-02","arxiv_id":"2501.01130","n_code_links":0,"syntology":null},{"paper":null,"slug":"performance-barrier-event-triggered-pde","title":"Performance-Barrier Event-Triggered PDE Control of Traffic Flow","date":"2025-01-01","arxiv_id":"2501.00722","n_code_links":0,"syntology":null},{"paper":"/paper/enhancing-contrastive-learning-inspired-by","slug":"enhancing-contrastive-learning-inspired-by","title":"Enhancing Contrastive Learning Inspired by the Philosophy of \"The Blind Men and the Elephant\"","date":"2024-12-21","arxiv_id":"2412.16522","n_code_links":1,"syntology":null},{"paper":"/paper/domclp-domain-wise-contrastive-learning-with","slug":"domclp-domain-wise-contrastive-learning-with","title":"DomCLP: Domain-wise Contrastive Learning with Prototype Mixup for Unsupervised Domain Generalization","date":"2024-12-12","arxiv_id":"2412.09074","n_code_links":1,"syntology":null},{"paper":null,"slug":"automated-toll-management-system-using-rfid","title":"Automated Toll Management System Using RFID and Image Processing","date":"2024-12-02","arxiv_id":"2412.01728","n_code_links":0,"syntology":null},{"paper":"/paper/cv-cities-advancing-cross-view-geo","slug":"cv-cities-advancing-cross-view-geo","title":"CV-Cities: Advancing Cross-View Geo-Localization in Global Cities","date":"2024-11-19","arxiv_id":"2411.12431","n_code_links":1,"syntology":{"ran":8,"of":9,"n_ran_checked":6,"n_instrument":2,"unverified":1,"pointer_only":0,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":{"repos":["gaoshuang98/cvcities"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/scan-bootstrapping-contrastive-pre-training","slug":"scan-bootstrapping-contrastive-pre-training","title":"SCAN: Bootstrapping Contrastive Pre-training for Data Efficiency","date":"2024-11-14","arxiv_id":"2411.09126","n_code_links":1,"syntology":null},{"paper":null,"slug":"a-contrastive-self-supervised-learning-scheme","title":"A Contrastive Self-Supervised Learning scheme for beat tracking amenable to few-shot learning","date":"2024-11-06","arxiv_id":"2411.04152","n_code_links":0,"syntology":null},{"paper":null,"slug":"understanding-contrastive-learning-via-1","title":"Understanding Contrastive Learning via Gaussian Mixture Models","date":"2024-11-05","arxiv_id":"2411.03517","n_code_links":0,"syntology":null},{"paper":"/paper/hex-hierarchical-emergence-exploitation-in","slug":"hex-hierarchical-emergence-exploitation-in","title":"HEX: Hierarchical Emergence Exploitation in Self-Supervised Algorithms","date":"2024-10-30","arxiv_id":"2410.23200","n_code_links":1,"syntology":null},{"paper":null,"slug":"accelerating-augmentation-invariance","title":"Accelerating Augmentation Invariance Pretraining","date":"2024-10-27","arxiv_id":"2410.22364","n_code_links":0,"syntology":null},{"paper":null,"slug":"pathmoco-a-novel-framework-to-improve-feature","title":"SRA: A Novel Method to Improve Feature Embedding in Self-supervised Learning for Histopathological Images","date":"2024-10-23","arxiv_id":"2410.17514","n_code_links":0,"syntology":null},{"paper":null,"slug":"tas-distilling-arbitrary-teacher-and-student","title":"TAS: Distilling Arbitrary Teacher and Student via a Hybrid Assistant","date":"2024-10-16","arxiv_id":"2410.12342","n_code_links":0,"syntology":null},{"paper":"/paper/synco-synthetic-hard-negatives-in-contrastive","slug":"synco-synthetic-hard-negatives-in-contrastive","title":"SynCo: Synthetic Hard Negatives in Contrastive Learning for Better Unsupervised Visual Representations","date":"2024-10-03","arxiv_id":"2410.02401","n_code_links":1,"syntology":null},{"paper":"/paper/prototype-based-masked-audio-model-for-self","slug":"prototype-based-masked-audio-model-for-self","title":"Prototype based Masked Audio Model for Self-Supervised Learning of Sound Event Detection","date":"2024-09-26","arxiv_id":"2409.17656","n_code_links":1,"syntology":null},{"paper":"/paper/moner-motion-correction-in-undersampled","slug":"moner-motion-correction-in-undersampled","title":"Moner: Motion Correction in Undersampled Radial MRI with Unsupervised Neural Representation","date":"2024-09-25","arxiv_id":"2409.16921","n_code_links":1,"syntology":{"ran":4,"of":6,"n_ran_checked":2,"n_instrument":2,"unverified":2,"pointer_only":5,"phrase":"4 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","official":{"repos":["iwuqing/moner"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":1,"n_ran_no_instrument_failure":2,"n_unverified":2,"ran_from_kinds":["found_in_text","official"]}}},{"paper":null,"slug":"trading-through-earnings-seasons-using-self","title":"Trading through Earnings Seasons using Self-Supervised Contrastive Representation Learning","date":"2024-09-25","arxiv_id":"2409.17392","n_code_links":0,"syntology":null},{"paper":"/paper/upper-body-free-breathing-magnetic-resonance","slug":"upper-body-free-breathing-magnetic-resonance","title":"Upper-body free-breathing Magnetic Resonance Fingerprinting applied to the quantification of water T1 and fat fraction","date":"2024-09-24","arxiv_id":"2409.16200","n_code_links":1,"syntology":null},{"paper":"/paper/cross-model-cross-stream-learning-for-self","slug":"cross-model-cross-stream-learning-for-self","title":"Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition","date":"2024-09-23","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/context-aware-predictive-coding-a","slug":"context-aware-predictive-coding-a","title":"Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensing","date":"2024-09-20","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/embedding-geometries-of-contrastive-language","slug":"embedding-geometries-of-contrastive-language","title":"Embedding Geometries of Contrastive Language-Image Pre-Training","date":"2024-09-19","arxiv_id":"2409.13079","n_code_links":1,"syntology":{"ran":9,"of":15,"n_ran_checked":5,"n_instrument":4,"unverified":6,"pointer_only":15,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified","official":{"repos":["eify/open_clip"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":6,"ran_from_kinds":["official"]}}},{"paper":"/paper/context-aware-predictive-coding-a-1","slug":"context-aware-predictive-coding-a-1","title":"Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensing","date":"2024-09-16","arxiv_id":"2410.01825","n_code_links":1,"syntology":null},{"paper":null,"slug":"hierarchical-event-triggered-systems-safe","title":"Hierarchical Event-Triggered Systems: Safe Learning of Quasi-Optimal Deadline Policies","date":"2024-09-15","arxiv_id":"2409.09812","n_code_links":0,"syntology":null},{"paper":null,"slug":"speaker-and-style-disentanglement-of-speech","title":"Speaker and Style Disentanglement of Speech Based on Contrastive Predictive Coding Supported Factorized Variational Autoencoder","date":"2024-09-05","arxiv_id":"2409.03520","n_code_links":0,"syntology":null},{"paper":null,"slug":"interpretable-convolutional-syncnet","title":"Interpretable Convolutional SyncNet","date":"2024-09-02","arxiv_id":"2409.00971","n_code_links":0,"syntology":null},{"paper":null,"slug":"proteinrpn-towards-accurate-protein-function","title":"ProteinRPN: Towards Accurate Protein Function Prediction with Graph-Based Region Proposals","date":"2024-09-01","arxiv_id":"2409.00610","n_code_links":0,"syntology":null},{"paper":null,"slug":"uncertainties-of-latent-representations-in","title":"Uncertainties of Latent Representations in Computer Vision","date":"2024-08-26","arxiv_id":"2408.14281","n_code_links":0,"syntology":null},{"paper":"/paper/smooth-infomax-towards-easier-post-hoc","slug":"smooth-infomax-towards-easier-post-hoc","title":"Smooth InfoMax -- Towards easier Post-Hoc interpretability","date":"2024-08-23","arxiv_id":"2408.12936","n_code_links":1,"syntology":null},{"paper":"/paper/contrastive-representation-learning-for-3","slug":"contrastive-representation-learning-for-3","title":"Contrastive Representation Learning for Dynamic Link Prediction in Temporal Networks","date":"2024-08-22","arxiv_id":"2408.12753","n_code_links":1,"syntology":null},{"paper":"/paper/accelerating-goal-conditioned-rl-algorithms","slug":"accelerating-goal-conditioned-rl-algorithms","title":"Accelerating Goal-Conditioned RL Algorithms and Research","date":"2024-08-20","arxiv_id":"2408.11052","n_code_links":1,"syntology":{"ran":6,"of":9,"n_ran_checked":5,"n_instrument":1,"unverified":3,"pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","official":{"repos":["michalbortkiewicz/jaxgcrl"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":"/paper/drl-based-resource-allocation-for-motion-blur","slug":"drl-based-resource-allocation-for-motion-blur","title":"DRL-Based Resource Allocation for Motion Blur Resistant Federated Self-Supervised Learning in IoV","date":"2024-08-17","arxiv_id":"2408.09194","n_code_links":1,"syntology":null},{"paper":null,"slug":"boosting-adverse-weather-crowd-counting-via","title":"Boosting Adverse Weather Crowd Counting via Multi-queue Contrastive Learning","date":"2024-08-12","arxiv_id":"2408.05956","n_code_links":0,"syntology":null},{"paper":null,"slug":"2408-03230","title":"Contrastive Learning for Image Complexity Representation","date":"2024-08-06","arxiv_id":"2408.03230","n_code_links":0,"syntology":null},{"paper":"/paper/relational-representation-distillation","slug":"relational-representation-distillation","title":"Relational Representation Distillation","date":"2024-07-16","arxiv_id":"2407.12073","n_code_links":1,"syntology":null},{"paper":null,"slug":"performance-barrier-event-triggered-control","title":"Performance-Barrier Event-Triggered Control of a Class of Reaction-Diffusion PDEs","date":"2024-07-11","arxiv_id":"2407.08178","n_code_links":0,"syntology":null},{"paper":null,"slug":"contrastive-learning-of-preferences-with-a","title":"Contrastive Learning of Preferences with a Contextual InfoNCE Loss","date":"2024-07-08","arxiv_id":"2407.05898","n_code_links":0,"syntology":null},{"paper":null,"slug":"infonce-identifying-the-gap-between-theory","title":"InfoNCE: Identifying the Gap Between Theory and Practice","date":"2024-06-28","arxiv_id":"2407.00143","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-gradient-accumulation-method-for-dense","title":"A Gradient Accumulation Method for Dense Retriever under Memory Constraint","date":"2024-06-18","arxiv_id":"2406.12356","n_code_links":0,"syntology":null},{"paper":null,"slug":"svitt-ego-a-sparse-video-text-transformer-for","title":"SViTT-Ego: A Sparse Video-Text Transformer for Egocentric Video","date":"2024-06-13","arxiv_id":"2406.09462","n_code_links":0,"syntology":null},{"paper":null,"slug":"alignment-calibration-machine-unlearning-for","title":"Alignment Calibration: Machine Unlearning for Contrastive Learning under Auditing","date":"2024-06-05","arxiv_id":"2406.03603","n_code_links":0,"syntology":null},{"paper":null,"slug":"contextual-dynamic-pricing-algorithms","title":"Contextual Dynamic Pricing: Algorithms, Optimality, and Local Differential Privacy Constraints","date":"2024-06-04","arxiv_id":"2406.02424","n_code_links":0,"syntology":null},{"paper":null,"slug":"causal-contrastive-learning-for","title":"Causal Contrastive Learning for Counterfactual Regression Over Time","date":"2024-06-01","arxiv_id":"2406.00535","n_code_links":0,"syntology":null},{"paper":null,"slug":"do-spectral-cues-matter-in-contrast-based","title":"Rethinking Spectral Augmentation for Contrast-based Graph Self-Supervised Learning","date":"2024-05-30","arxiv_id":"2405.19600","n_code_links":0,"syntology":null},{"paper":null,"slug":"widin-wording-image-for-domain-invariant","title":"WIDIn: Wording Image for Domain-Invariant Representation in Single-Source Domain Generalization","date":"2024-05-28","arxiv_id":"2405.18405","n_code_links":0,"syntology":null},{"paper":null,"slug":"negative-as-positive-enhancing-out-of","title":"Negative as Positive: Enhancing Out-of-distribution Generalization for Graph Contrastive Learning","date":"2024-05-25","arxiv_id":"2405.16224","n_code_links":0,"syntology":null},{"paper":"/paper/protfad-introducing-function-aware-domains-as","slug":"protfad-introducing-function-aware-domains-as","title":"ProtFAD: Introducing function-aware domains as implicit modality towards protein function prediction","date":"2024-05-24","arxiv_id":"2405.15158","n_code_links":2,"syntology":null},{"paper":"/paper/offline-reinforcement-learning-from-datasets","slug":"offline-reinforcement-learning-from-datasets","title":"Offline Reinforcement Learning from Datasets with Structured Non-Stationarity","date":"2024-05-23","arxiv_id":"2405.14114","n_code_links":1,"syntology":{"ran":10,"of":12,"n_ran_checked":8,"n_instrument":2,"unverified":2,"pointer_only":0,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","official":{"repos":["johannesack/offlinerlstructurednonstationarity"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":8,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"towards-geometry-aware-pareto-set-learning","title":"Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization","date":"2024-05-14","arxiv_id":"2405.08604","n_code_links":0,"syntology":null},{"paper":"/paper/understanding-multimodal-contrastive-learning-1","slug":"understanding-multimodal-contrastive-learning-1","title":"Weighted Point Cloud Embedding for Multimodal Contrastive Learning Toward Optimal Similarity Metric","date":"2024-04-30","arxiv_id":"2404.19228","n_code_links":0,"syntology":{"ran":5,"of":7,"n_ran_checked":5,"n_instrument":0,"unverified":2,"pointer_only":0,"phrase":"5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","official":null}},{"paper":"/paper/additive-margin-in-contrastive-self","slug":"additive-margin-in-contrastive-self","title":"Additive Margin in Contrastive Self-Supervised Frameworks to Learn Discriminative Speaker Representations","date":"2024-04-23","arxiv_id":"2404.14913","n_code_links":1,"syntology":null},{"paper":"/paper/ckd-contrastive-knowledge-distillation-from-a","slug":"ckd-contrastive-knowledge-distillation-from-a","title":"CKD: Contrastive Knowledge Distillation from A Sample-wise Perspective","date":"2024-04-22","arxiv_id":"2404.14109","n_code_links":1,"syntology":null},{"paper":"/paper/noise-contrastive-estimation-with-soft","slug":"noise-contrastive-estimation-with-soft","title":"Towards noise contrastive estimation with soft targets for conditional models","date":"2024-04-22","arxiv_id":"2404.14076","n_code_links":1,"syntology":{"ran":4,"of":6,"n_ran_checked":4,"n_instrument":0,"unverified":2,"pointer_only":6,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","official":{"repos":["uhlmanngroup/soft-target-infonce"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"contrastive-learning-with-orthonormal-anchors","title":"Preventing Collapse in Contrastive Learning with Orthonormal Prototypes (CLOP)","date":"2024-03-27","arxiv_id":"2403.18699","n_code_links":0,"syntology":null},{"paper":null,"slug":"multilingual-turn-taking-prediction-using","title":"Multilingual Turn-taking Prediction Using Voice Activity Projection","date":"2024-03-11","arxiv_id":"2403.06487","n_code_links":0,"syntology":null},{"paper":null,"slug":"event-triggered-robust-cooperative-output","title":"Event-Triggered Robust Cooperative Output Regulation for a Class of Linear Multi-Agent Systems with an Unknown Exosystem","date":"2024-03-01","arxiv_id":"2403.00645","n_code_links":0,"syntology":null},{"paper":null,"slug":"overcoming-dimensional-collapse-in-self","title":"Overcoming Dimensional Collapse in Self-supervised Contrastive Learning for Medical Image Segmentation","date":"2024-02-22","arxiv_id":"2402.14611","n_code_links":0,"syntology":null},{"paper":null,"slug":"analysis-of-using-sigmoid-loss-for","title":"Analysis of Using Sigmoid Loss for Contrastive Learning","date":"2024-02-20","arxiv_id":"2402.12613","n_code_links":0,"syntology":null},{"paper":null,"slug":"f-micl-understanding-and-generalizing-infonce","title":"$f$-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning","date":"2024-02-15","arxiv_id":"2402.10150","n_code_links":0,"syntology":null},{"paper":"/paper/moco-a-learnable-meta-optimizer-for","slug":"moco-a-learnable-meta-optimizer-for","title":"Moco: A Learnable Meta Optimizer for Combinatorial Optimization","date":"2024-02-07","arxiv_id":"2402.04915","n_code_links":1,"syntology":{"ran":9,"of":10,"n_ran_checked":7,"n_instrument":2,"unverified":1,"pointer_only":0,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":{"repos":["timd3/moco"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":7,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"revisiting-speech-segmentation-and-lexicon","title":"Revisiting speech segmentation and lexicon learning with better features","date":"2024-01-31","arxiv_id":"2401.17902","n_code_links":0,"syntology":null},{"paper":null,"slug":"curriculum-recommendations-using-transformer","title":"Curriculum Recommendations Using Transformer Base Model with InfoNCE Loss And Language Switching Method","date":"2024-01-18","arxiv_id":"2401.09699","n_code_links":0,"syntology":null},{"paper":"/paper/diffclone-enhanced-behaviour-cloning-in","slug":"diffclone-enhanced-behaviour-cloning-in","title":"DiffClone: Enhanced Behaviour Cloning in Robotics with Diffusion-Driven Policy Learning","date":"2024-01-17","arxiv_id":"2401.09243","n_code_links":1,"syntology":{"ran":3,"of":3,"n_ran_checked":2,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["sirabas369/diffclone"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"contrastive-learning-with-audio","title":"Contrastive Learning With Audio Discrimination For Customizable Keyword Spotting In Continuous Speech","date":"2024-01-12","arxiv_id":"2401.06485","n_code_links":0,"syntology":null},{"paper":"/paper/real-time-and-continuous-turn-taking","slug":"real-time-and-continuous-turn-taking","title":"Real-time and Continuous Turn-taking Prediction Using Voice Activity Projection","date":"2024-01-10","arxiv_id":"2401.04868","n_code_links":2,"syntology":null},{"paper":null,"slug":"reinforcement-learning-for-optimizing-rag-for","title":"Reinforcement Learning for Optimizing RAG for Domain Chatbots","date":"2024-01-10","arxiv_id":"2401.06800","n_code_links":0,"syntology":null},{"paper":null,"slug":"boosting-transformer-s-robustness-and","title":"A Novel Transformer-Based Self-Supervised Learning Method to Enhance Photoplethysmogram Signal Artifact Detection","date":"2024-01-02","arxiv_id":"2401.01013","n_code_links":0,"syntology":null},{"paper":null,"slug":"replication-proof-bandit-mechanism-design","title":"Replication-proof Bandit Mechanism Design with Bayesian Agents","date":"2023-12-28","arxiv_id":"2312.16896","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-beam-segmenting-polar-format-algorithm","title":"A Beam-Segmenting Polar Format Algorithm Based on Double PCS for Video SAR Persistent Imaging","date":"2023-12-19","arxiv_id":"2401.10252","n_code_links":0,"syntology":null},{"paper":null,"slug":"time-series-contrastive-learning-against","title":"Time-Series Contrastive Learning against False Negatives and Class Imbalance","date":"2023-12-19","arxiv_id":"2312.11939","n_code_links":0,"syntology":null},{"paper":null,"slug":"debiased-contrastive-learning-loss-for","title":"(Debiased) Contrastive Learning Loss for Recommendation (Technical Report)","date":"2023-12-13","arxiv_id":"2312.08517","n_code_links":0,"syntology":null},{"paper":null,"slug":"revisiting-recommendation-loss-functions","title":"Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)","date":"2023-12-13","arxiv_id":"2312.08520","n_code_links":0,"syntology":null},{"paper":null,"slug":"at4ctr-auxiliary-match-tasks-for-enhancing","title":"AT4CTR: Auxiliary Match Tasks for Enhancing Click-Through Rate Prediction","date":"2023-12-09","arxiv_id":"2312.06683","n_code_links":0,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":418,"with_a_code_link":217,"where_syntology_ran_a_sample":89,"not_listed_spam_title":0,"listed":418,"listed_where_code_ran":89,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":72,"every_run_a_failure_of_syntologys_instrument":17,"listed_with_a_run_with_no_instrument_failure":72,"listed_every_run_a_failure_of_syntologys_instrument":17,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":89,"papers_where_code_ran_first_page":"/method/infonce/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":5,"url":"/method/infonce/papers/2","json":"/method/infonce/papers/2.json","rows":100},{"order":"archive","page":3,"of":5,"url":"/method/infonce/papers/3","json":"/method/infonce/papers/3.json","rows":100},{"order":"archive","page":4,"of":5,"url":"/method/infonce/papers/4","json":"/method/infonce/papers/4.json","rows":100},{"order":"archive","page":5,"of":5,"url":"/method/infonce/papers/5","json":"/method/infonce/papers/5.json","rows":18},{"order":"ran","page":1,"of":1,"url":"/method/infonce/papers/ran/1","json":"/method/infonce/papers/ran/1.json","rows":89}],"tasks":[{"task":"/task/contrastive-learning","name":"Contrastive Learning","papers":172},{"task":"/task/self-supervised-learning","name":"Self-Supervised Learning","papers":110},{"task":"/task/representation-learning","name":"Representation Learning","papers":104},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":28},{"task":"/task/retrieval","name":"Retrieval","papers":27},{"task":"/task/image-classification","name":"Image Classification","papers":26},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":25},{"task":"/task/image-classification","name":"image-classification","papers":18},{"task":"/task/object-detection","name":"Object Detection","papers":17},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":17},{"task":"/task/linear-evaluation","name":"Linear evaluation","papers":16},{"task":"/task/object-detection-1","name":"object-detection","papers":16},{"task":"/task/self-supervised-image-classification","name":"Self-Supervised Image Classification","papers":15},{"task":"/task/classification-1","name":"Classification","papers":13},{"task":"/task/classification","name":"General Classification","papers":11},{"task":"/task/language-modelling","name":"Language Modelling","papers":11},{"task":"/task/speech-recognition","name":"Speech Recognition","papers":10},{"task":"/task/speech-recognition-1","name":"speech-recognition","papers":10},{"task":"/task/automatic-speech-recognition-2","name":"Automatic Speech Recognition","papers":9},{"task":"/task/clustering","name":"Clustering","papers":9}],"tasks_shown":20,"n_tasks":343,"usage_by_year":[{"year":"2018","papers":2},{"year":"2019","papers":10},{"year":"2020","papers":52},{"year":"2021","papers":97},{"year":"2022","papers":89},{"year":"2023","papers":74},{"year":"2024","papers":64},{"year":"2025","papers":30}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/infonce"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=InfoNCE","read_at":"2026-10-05T00:58:02+00:00","query":"InfoNCE","kind":"paper","have":"no_code","tier":"paper_only","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"arxiv_id":"2407.00143"},"resolution":"paper","resolved_name_differs":false,"absence_asserted":"for_this_paper_only","absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"unknown","archive_paper_arxiv_id":null,"repositories":{"listed":null,"in_graph":0,"list_truncated":null,"strongest_link":null},"retrieve_with":null,"name_competition":{"verdict":"contested","may_be_wrong_sense":false,"bearers_found":2,"served":{"arxiv_id":"2407.00143","citations":67},"leading_other_bearer":{"arxiv_id":"2606.04280","title":"The Loss Is Not Enough: Sampling Conditions and Inductive Bias in Contrastive Representation Learning","citations":0,"named_by":["acronym_expansion"],"bearer_name":"support-corrected Information Noise Contrastive Estimation (InfoNCE)","ask_with":"have('2606.04280')"},"n_other_bearers_listed":1,"note":"1 other thing(s) here are also called 'InfoNCE', and none of them is cited more than the paper this answer is about. They are listed in `also_named` -- check `served.arxiv_id` is the paper you meant."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2407.00143","page":null,"syntology_url":"https://syntology.ai/paper/2407.00143","in_graph_layer":false,"samples":0},"line":"the paper matched by title, arXiv:2407.00143, held, no code (no_code; paper_only). The lookup matched a paper by its title, arXiv:2407.00143, not a method entry. The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2407.00143) is about this method is not checked; it does not say whether this method has code.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"8fa2f0074f3cb900b8d1e690f661092dc73f9d5ad25ba3fcbdafc3cacf7feba7","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}