{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/manifold-mixup","slug":"manifold-mixup","name":"Manifold Mixup","full_name":"Manifold Mixup","full_name_withheld":false,"description_markdown":"**Manifold Mixup** is a regularization method that encourages neural networks to predict less confidently on interpolations of hidden representations. It leverages semantic interpolations as an additional training signal, obtaining neural networks with smoother decision boundaries at multiple levels of representation. As a result, neural networks trained with Manifold Mixup learn class-representations with fewer directions of variance.\r\n\r\nConsider training a deep neural network $f\\left(x\\right) = f\\_{k}\\left(g\\_{k}\\left(x\\right)\\right)$, where $g\\_{k}$ denotes the part of the neural network mapping the input data to the hidden representation at layer $k$, and $f\\_{k}$ denotes the\r\npart mapping such hidden representation to the output $f\\left(x\\right)$. Training $f$ using Manifold Mixup is performed in five steps:\r\n\r\n(1) Select a random layer $k$ from a set of eligible layers $S$ in the neural network. This set may include the input layer $g\\_{0}\\left(x\\right)$.\r\n\r\n(2) Process two random data minibatches $\\left(x, y\\right)$ and $\\left(x', y'\\right)$ as usual, until reaching layer $k$. This provides us with two intermediate minibatches $\\left(g\\_{k}\\left(x\\right), y\\right)$ and $\\left(g\\_{k}\\left(x'\\right), y'\\right)$.\r\n\r\n(3) Perform Input [Mixup](https://paperswithcode.com/method/mixup) on these intermediate minibatches. This produces the mixed minibatch:\r\n\r\n$$\r\n\\left(\\tilde{g}\\_{k}, \\tilde{y}\\right) = \\left(\\text{Mix}\\_{\\lambda}\\left(g\\_{k}\\left(x\\right), g\\_{k}\\left(x'\\right)\\right), \\text{Mix}\\_{\\lambda}\\left(y, y'\\right\r\n)\\right),\r\n$$\r\n\r\nwhere $\\text{Mix}\\_{\\lambda}\\left(a, b\\right) = \\lambda \\cdot a + \\left(1 − \\lambda\\right) \\cdot b$. Here, $\\left(y, y'\r\n\\right)$ are one-hot labels, and the mixing coefficient\r\n$\\lambda \\sim \\text{Beta}\\left(\\alpha, \\alpha\\right)$ as in mixup. For instance, $\\alpha = 1.0$ is equivalent to sampling $\\lambda \\sim U\\left(0, 1\\right)$.\r\n\r\n(4) Continue the forward pass in the network from layer $k$ until the output using the mixed minibatch $\\left(\\tilde{g}\\_{k}, \\tilde{y}\\right)$.\r\n\r\n(5) This output is used to compute the loss value and\r\ngradients that update all the parameters of the neural network.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Manifold Mixup: Better Representations by Interpolating Hidden States","paper":"/paper/manifold-mixup-better-representations-by","first_author":"Vikas Verma","n_authors":8,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/manifold-mixup-better-representations-by"},"source":{"url":"https://arxiv.org/abs/1806.05236v7","title":"Manifold Mixup: Better Representations by Interpolating Hidden States","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/vikasverma1077/manifold_mixup/blob/118ec709808b79dd336b10f4cf7deeacf541dfc7/supervised/models/resnet.py#L98","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Regularization","url":"/methods/category/regularization","pwc_aliases":[]}],"n_papers_tagged":26,"archive_num_papers":26,"papers_newest_first":[{"paper":"/paper/medusa-a-multimodal-deep-fusion-multi-stage","slug":"medusa-a-multimodal-deep-fusion-multi-stage","title":"MEDUSA: A Multimodal Deep Fusion Multi-Stage Training Framework for Speech Emotion Recognition in Naturalistic Conditions","date":"2025-06-11","arxiv_id":"2506.09556","n_code_links":1,"syntology":null},{"paper":null,"slug":"a-few-shot-label-unlearning-in-vertical","title":"A few-shot Label Unlearning in Vertical Federated Learning","date":"2024-10-14","arxiv_id":"2410.10922","n_code_links":0,"syntology":null},{"paper":null,"slug":"2408-01162","title":"PreMix: Addressing Label Scarcity in Whole Slide Image Classification with Pre-trained Multiple Instance Learning Aggregators","date":"2024-08-02","arxiv_id":"2408.01162","n_code_links":0,"syntology":null},{"paper":"/paper/improving-image-classification-accuracy","slug":"improving-image-classification-accuracy","title":"SynerMix: Synergistic Mixup Solution for Enhanced Intra-Class Cohesion and Inter-Class Separability in Image Classification","date":"2024-03-21","arxiv_id":"2403.14137","n_code_links":2,"syntology":null},{"paper":"/paper/mixture-of-mixups-for-multi-label","slug":"mixture-of-mixups-for-multi-label","title":"Mixture of Mixups for Multi-label Classification of Rare Anuran Sounds","date":"2024-03-14","arxiv_id":"2403.09598","n_code_links":1,"syntology":null},{"paper":null,"slug":"improved-automatic-diabetic-retinopathy","title":"Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Images","date":"2023-10-03","arxiv_id":"2310.01912","n_code_links":0,"syntology":null},{"paper":"/paper/shufflemix-improving-representations-via","slug":"shufflemix-improving-representations-via","title":"ShuffleMix: Improving Representations via Channel-Wise Shuffle of Interpolated Hidden States","date":"2023-05-30","arxiv_id":"2305.18684","n_code_links":1,"syntology":null},{"paper":"/paper/enhancing-mixup-based-graph-learning-for","slug":"enhancing-mixup-based-graph-learning-for","title":"On the Effectiveness of Hybrid Pooling in Mixup-Based Graph Learning for Language Processing","date":"2022-10-06","arxiv_id":"2210.03123","n_code_links":1,"syntology":null},{"paper":null,"slug":"set-based-meta-interpolation-for-few-task","title":"Set-based Meta-Interpolation for Few-Task Meta-Learning","date":"2022-05-20","arxiv_id":"2205.09990","n_code_links":0,"syntology":null},{"paper":"/paper/enhancing-cross-lingual-transfer-by-manifold-1","slug":"enhancing-cross-lingual-transfer-by-manifold-1","title":"Enhancing Cross-lingual Transfer by Manifold Mixup","date":"2022-05-09","arxiv_id":"2205.04182","n_code_links":1,"syntology":null},{"paper":"/paper/learning-to-classify-open-intent-via-soft","slug":"learning-to-classify-open-intent-via-soft","title":"Learning to Classify Open Intent via Soft Labeling and Manifold Mixup","date":"2022-04-16","arxiv_id":"2204.07804","n_code_links":1,"syntology":null},{"paper":"/paper/stemm-self-learning-with-speech-text-manifold","slug":"stemm-self-learning-with-speech-text-manifold","title":"STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation","date":"2022-03-20","arxiv_id":"2203.10426","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["ictnlp/stemm"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/noisy-feature-mixup","slug":"noisy-feature-mixup","title":"Noisy Feature Mixup","date":"2021-10-05","arxiv_id":"2110.02180","n_code_links":2,"syntology":{"ran":0,"of":3,"n_ran_checked":0,"n_instrument":0,"unverified":3,"pointer_only":0,"phrase":"0 ran · 3 unverified","official":{"repos":["erichson/noisy_mixup"],"state":"official: harvested for another paper","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":[]}}},{"paper":null,"slug":"coded-invnet-for-resilient-prediction-serving","title":"Coded-InvNet for Resilient Prediction Serving Systems","date":"2021-06-11","arxiv_id":"2106.06445","n_code_links":0,"syntology":null},{"paper":null,"slug":"siamese-network-features-for-endoscopy-image","title":"Distance Metric-Based Learning with Interpolated Latent Features for Location Classification in Endoscopy Image and Video","date":"2021-03-15","arxiv_id":"2103.08504","n_code_links":0,"syntology":null},{"paper":null,"slug":"robust-pollen-imagery-classification-with","title":"Robust Pollen Imagery Classification with Generative Modeling and Mixup Training","date":"2021-02-25","arxiv_id":"2102.13143","n_code_links":0,"syntology":null},{"paper":null,"slug":"logit-as-auxiliary-weak-supervision-for-more","title":"Logit As Auxiliary Weak-supervision for More Reliable and Accurate Prediction","date":"2021-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"regularizing-recurrent-neural-networks-via","title":"Regularizing Recurrent Neural Networks via Sequence Mixup","date":"2020-11-27","arxiv_id":"2012.07527","n_code_links":0,"syntology":null},{"paper":"/paper/pointmixup-augmentation-for-point-clouds","slug":"pointmixup-augmentation-for-point-clouds","title":"PointMixup: Augmentation for Point Clouds","date":"2020-08-14","arxiv_id":"2008.06374","n_code_links":1,"syntology":null},{"paper":null,"slug":"remix-rebalanced-mixup","title":"Remix: Rebalanced Mixup","date":"2020-07-08","arxiv_id":"2007.03943","n_code_links":0,"syntology":null},{"paper":"/paper/cross-lingual-disaster-related-multi-label","slug":"cross-lingual-disaster-related-multi-label","title":"Cross-Lingual Disaster-related Multi-label Tweet Classification with Manifold Mixup","date":"2020-07-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"systematic-evaluation-of-backdoor-data","title":"Systematic Evaluation of Backdoor Data Poisoning Attacks on Image Classifiers","date":"2020-04-24","arxiv_id":"2004.11514","n_code_links":0,"syntology":null},{"paper":"/paper/charting-the-right-manifold-manifold-mixup","slug":"charting-the-right-manifold-manifold-mixup","title":"Charting the Right Manifold: Manifold Mixup for Few-shot Learning","date":"2019-07-28","arxiv_id":"1907.12087","n_code_links":8,"syntology":null},{"paper":"/paper/manifold-mixup-learning-better","slug":"manifold-mixup-learning-better","title":"Manifold Mixup: Learning Better Representations by Interpolating Hidden States","date":"2019-05-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/manifold-mixup-improves-text-recognition-with","slug":"manifold-mixup-improves-text-recognition-with","title":"Manifold Mixup improves text recognition with CTC loss","date":"2019-03-11","arxiv_id":"1903.04246","n_code_links":1,"syntology":null},{"paper":"/paper/manifold-mixup-better-representations-by","slug":"manifold-mixup-better-representations-by","title":"Manifold Mixup: Better Representations by Interpolating Hidden States","date":"2018-06-13","arxiv_id":"1806.05236","n_code_links":12,"syntology":{"ran":7,"of":11,"n_ran_checked":5,"n_instrument":2,"unverified":4,"pointer_only":5,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified","official":{"repos":["vikasverma1077/manifold_mixup"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}}],"papers_shown":26,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":26,"with_a_code_link":15,"where_syntology_ran_a_sample":2,"not_listed_spam_title":0,"listed":26,"listed_where_code_ran":2,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":2,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":2,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":2,"papers_where_code_ran_first_page":"/method/manifold-mixup/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/manifold-mixup/papers/ran/1","json":"/method/manifold-mixup/papers/ran/1.json","rows":2}],"tasks":[{"task":"/task/data-augmentation","name":"Data Augmentation","papers":7},{"task":"/task/image-classification","name":"Image Classification","papers":6},{"task":"/task/image-classification","name":"image-classification","papers":5},{"task":"/task/classification","name":"General Classification","papers":3},{"task":"/task/few-shot-learning","name":"Few-Shot Learning","papers":2},{"task":"/task/multi-label-classification-2","name":"MUlTI-LABEL-ClASSIFICATION","papers":2},{"task":"/task/meta-learning","name":"Meta-Learning","papers":2},{"task":"/task/multi-label-classification","name":"Multi-Label Classification","papers":2},{"task":"/task/representation-learning","name":"Representation Learning","papers":2},{"task":"/task/text-classification","name":"Text Classification","papers":2},{"task":"/task/text-classification-1","name":"text-classification","papers":2},{"task":"/task/3d-point-cloud-classification","name":"3D Point Cloud Classification","papers":1},{"task":"/task/3d-point-cloud-data-augmentation","name":"3D Point Cloud Data Augmentation","papers":1},{"task":"/task/active-learning","name":"Active Learning","papers":1},{"task":"/task/anomaly-detection","name":"Anomaly Detection","papers":1},{"task":"/task/benchmarking","name":"Benchmarking","papers":1},{"task":"/task/bilevel-optimization","name":"Bilevel Optimization","papers":1},{"task":"/task/classification-1","name":"Classification","papers":1},{"task":"/task/code-classification","name":"Code Classification","papers":1},{"task":"/task/computational-efficiency","name":"Computational Efficiency","papers":1}],"tasks_shown":20,"n_tasks":57,"usage_by_year":[{"year":"2018","papers":1},{"year":"2019","papers":3},{"year":"2020","papers":5},{"year":"2021","papers":5},{"year":"2022","papers":5},{"year":"2023","papers":2},{"year":"2024","papers":4},{"year":"2025","papers":1}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/manifold-mixup"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Manifold%20Mixup","read_at":"2026-10-05T00:58:54+00:00","query":"Manifold Mixup","kind":"paper","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":"1806.05236","repositories":null,"retrieve_with":null,"name_competition":{"verdict":"unresolved_bearers","may_be_wrong_sense":false,"bearers_found":2,"served":null,"leading_other_bearer":{"arxiv_id":"1806.05236","title":"Manifold Mixup: Better Representations by Interpolating Hidden States","citations":39,"named_by":["title_prefix"],"bearer_name":"Manifold Mixup: Better Representations by Interpolating Hidden States","ask_with":"have('1806.05236')"},"n_other_bearers_listed":2,"note":"Nothing resolved to 'Manifold Mixup' by name, but 2 thing(s) here DECLARE that name -- most cited: the paper 'Manifold Mixup: Better Representations by Interpolating Hidden States' (arXiv:1806.05236, 39 citations). None of them is a well-cited bearer of the name, so this is still a coverage gap for any better-known sense -- they are listed so you can judge, not as a substitute."},"name_competition_text":"Nothing resolved to this name, but 2 entries in Syntology's graph carry it; the most cited is the paper “Manifold Mixup: Better Representations by Interpolating Hidden States” (arXiv:1806.05236, 39 citations). None of them is well cited, so for any better known sense of the name this is still a gap in coverage; they are listed so you can judge, not as a substitute.","near_matches":["mixup","C-Mixup","Co-Mixup","TD-MixUp","SOT-Mixup","Region Mixup","Latent Mixup","Weight Mixup"],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). Other entries in Syntology's graph carry this name; the lookup's note below says what that means for this name.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"aa92f1764f33ee2925ba8b8aaa6ef0c2d25cc46e0ba9d70804eef11a81516af4","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}