{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/noisy-student","slug":"noisy-student","name":"Noisy Student","full_name":"Noisy Student","full_name_withheld":false,"description_markdown":"**Noisy Student Training** is a semi-supervised learning approach. It extends the idea of self-training\r\nand distillation with the use of equal-or-larger student models and noise added to the student during learning. It has three main steps: \r\n\r\n1. train a teacher model on labeled images\r\n2. use the teacher to generate pseudo labels on unlabeled images\r\n3. train a student model on the combination of labeled images and pseudo labeled images. \r\n\r\nThe algorithm is iterated a few times by treating the student as a teacher to relabel the unlabeled data and training a new student.\r\n\r\nNoisy Student Training seeks to improve on self-training and distillation in two ways. First, it makes the student larger than, or at least equal to, the teacher so the student can better learn from a larger dataset. Second, it adds noise to the student so the noised student is forced to learn harder from the pseudo labels. To noise the student, it uses input noise such as [RandAugment](https://paperswithcode.com/method/randaugment) data augmentation, and model noise such as [dropout](https://paperswithcode.com/method/dropout) and [stochastic depth](https://paperswithcode.com/method/stochastic-depth) during training.","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/1911.04252v4","title":"Self-training with Noisy Student improves ImageNet classification","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/google-research/noisystudent","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Semi-Supervised Learning Methods","url":"/methods/category/semi-supervised-learning-methods","pwc_aliases":[]}],"n_papers_tagged":38,"archive_num_papers":null,"papers_newest_first":[{"paper":"/paper/sst-self-training-with-self-adaptive-1","slug":"sst-self-training-with-self-adaptive-1","title":"SST: Self-training with Self-adaptive Thresholding for Semi-supervised Learning","date":"2025-05-31","arxiv_id":"2506.00467","n_code_links":0,"syntology":null},{"paper":"/paper/zipa-a-family-of-efficient-models-for","slug":"zipa-a-family-of-efficient-models-for","title":"ZIPA: A family of efficient models for multilingual phone recognition","date":"2025-05-29","arxiv_id":"2505.23170","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["lingjzhu/zipa"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"hdc-hierarchical-distillation-for-multi-level","title":"HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentation","date":"2025-04-14","arxiv_id":"2504.09876","n_code_links":0,"syntology":null},{"paper":null,"slug":"2407-21061","title":"Improving noisy student training for low-resource languages in End-to-End ASR using CycleGAN and inter-domain losses","date":"2024-07-26","arxiv_id":"2407.21061","n_code_links":0,"syntology":null},{"paper":null,"slug":"semi-supervised-learning-for-code-switching","title":"Semi-supervised Learning for Code-Switching ASR with Large Language Model Filter","date":"2024-07-05","arxiv_id":"2407.04219","n_code_links":0,"syntology":null},{"paper":"/paper/gigaspeech-2-an-evolving-large-scale-and","slug":"gigaspeech-2-an-evolving-large-scale-and","title":"GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement","date":"2024-06-17","arxiv_id":"2406.11546","n_code_links":2,"syntology":{"ran":1,"of":2,"n_ran_checked":1,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["SpeechColab/GigaSpeech2"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/self-train-before-you-transcribe","slug":"self-train-before-you-transcribe","title":"Self-Train Before You Transcribe","date":"2024-06-17","arxiv_id":"2406.12937","n_code_links":1,"syntology":null},{"paper":null,"slug":"conformer-1-robust-asr-via-large-scale","title":"Conformer-1: Robust ASR via Large-Scale Semisupervised Bootstrapping","date":"2024-04-10","arxiv_id":"2404.07341","n_code_links":0,"syntology":null},{"paper":null,"slug":"on-the-effect-of-image-resolution-on-semantic","title":"On the Effect of Image Resolution on Semantic Segmentation","date":"2024-02-08","arxiv_id":"2402.05398","n_code_links":0,"syntology":null},{"paper":null,"slug":"efficient-adapter-finetuning-for-tail","title":"Efficient Adapter Finetuning for Tail Languages in Streaming Multilingual ASR","date":"2024-01-17","arxiv_id":"2401.08992","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-supervised-reflective-learning-through","title":"Self-supervised Reflective Learning through Self-distillation and Online Clustering for Speaker Representation Learning","date":"2024-01-03","arxiv_id":"2401.01473","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-transriber-few-shot-lyrics-transcription","title":"Self-Transriber: Few-shot Lyrics Transcription with Self-training","date":"2022-11-18","arxiv_id":"2211.10152","n_code_links":0,"syntology":null},{"paper":null,"slug":"comparison-of-soft-and-hard-target-rnn-t","title":"Comparison of Soft and Hard Target RNN-T Distillation for Large-scale ASR","date":"2022-10-11","arxiv_id":"2210.05793","n_code_links":0,"syntology":null},{"paper":"/paper/progress-and-limitations-of-deep-networks-to","slug":"progress-and-limitations-of-deep-networks-to","title":"Progress and limitations of deep networks to recognize objects in unusual poses","date":"2022-07-16","arxiv_id":"2207.08034","n_code_links":1,"syntology":null},{"paper":null,"slug":"fednst-federated-noisy-student-training-for","title":"FedNST: Federated Noisy Student Training for Automatic Speech Recognition","date":"2022-06-06","arxiv_id":"2206.02797","n_code_links":0,"syntology":null},{"paper":"/paper/conformer-and-blind-noisy-students-for","slug":"conformer-and-blind-noisy-students-for","title":"Conformer and Blind Noisy Students for Improved Image Quality Assessment","date":"2022-04-27","arxiv_id":"2204.12819","n_code_links":1,"syntology":null},{"paper":"/paper/pseudo-label-transfer-from-frame-level-to","slug":"pseudo-label-transfer-from-frame-level-to","title":"Pseudo-Label Transfer from Frame-Level to Note-Level in a Teacher-Student Framework for Singing Transcription from Polyphonic Music","date":"2022-03-25","arxiv_id":"2203.13422","n_code_links":1,"syntology":null},{"paper":null,"slug":"pseudo-label-is-better-than-human-label","title":"Pseudo Label Is Better Than Human Label","date":"2022-03-22","arxiv_id":"2203.12668","n_code_links":0,"syntology":null},{"paper":"/paper/occlusion-aware-self-supervised-monocular-6d","slug":"occlusion-aware-self-supervised-monocular-6d","title":"Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimation","date":"2022-03-19","arxiv_id":"2203.10339","n_code_links":1,"syntology":null},{"paper":"/paper/semi-supervised-music-emotion-recognition","slug":"semi-supervised-music-emotion-recognition","title":"Semi-supervised music emotion recognition using noisy student training and harmonic pitch class profiles","date":"2021-12-01","arxiv_id":"2112.00702","n_code_links":1,"syntology":null},{"paper":null,"slug":"using-contrastive-learning-and-pseudolabels","title":"Using Contrastive Learning and Pseudolabels to learn representations for Retail Product Image Classification","date":"2021-10-07","arxiv_id":"2110.03639","n_code_links":0,"syntology":null},{"paper":"/paper/perturb-predict-paraphrase-semi-supervised","slug":"perturb-predict-paraphrase-semi-supervised","title":"Perturb, Predict & Paraphrase: Semi-Supervised Learning using Noisy Student for Image Captioning","date":"2021-08-19","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"star-noisy-semi-supervised-transfer-learning","title":"STAR: Noisy Semi-Supervised Transfer Learning for Visual Classification","date":"2021-08-18","arxiv_id":"2108.08362","n_code_links":0,"syntology":null},{"paper":null,"slug":"caspianet-a-multidimensional-channel-spatial","title":"CASPIANET++: A Multidimensional Channel-Spatial Asymmetric Attention Network with Noisy Student Curriculum Learning Paradigm for Brain Tumor Segmentation","date":"2021-07-08","arxiv_id":"2107.04099","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-training-with-noisy-student-model-and","title":"Self-training with noisy student model and semi-supervised loss function for dcase 2021 challenge task 4","date":"2021-07-06","arxiv_id":"2107.02569","n_code_links":0,"syntology":null},{"paper":null,"slug":"semi-supervised-learning-for-dense-object","title":"Semi-supervised Learning for Dense Object Detection in Retail Scenes","date":"2021-07-05","arxiv_id":"2107.02114","n_code_links":0,"syntology":null},{"paper":null,"slug":"predicting-students-difficulties-from-a-piece","title":"Predicting Students’ Difficulties From a Piece of Code","date":"2021-06-03","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"deep-learning-for-detecting-pulmonary","title":"Deep learning for detecting pulmonary tuberculosis via chest radiography: an international study across 10 countries","date":"2021-05-16","arxiv_id":"2105.07540","n_code_links":0,"syntology":null},{"paper":null,"slug":"noisy-student-learning-for-cross-institution","title":"Semi-supervised learning for generalizable intracranial hemorrhage detection and segmentation","date":"2021-05-03","arxiv_id":"2105.00582","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-new-semi-supervised-self-training-method","title":"A new semi-supervised self-training method for lung cancer prediction","date":"2020-12-17","arxiv_id":"2012.09472","n_code_links":0,"syntology":null},{"paper":null,"slug":"pgsg-at-semeval-2020-task-12-bert-lstm-with","title":"PGSG at SemEval-2020 Task 12: BERT-LSTM with Tweets' Pretrained Model and Noisy Student Training Method","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"semi-supervised-noisy-student-pre-training-on","title":"Semi-Supervised Noisy Student Pre-training on EfficientNet Architectures for Plant Pathology Classification","date":"2020-12-01","arxiv_id":"2012.00332","n_code_links":0,"syntology":null},{"paper":"/paper/combining-self-training-and-self-supervised","slug":"combining-self-training-and-self-supervised","title":"Combining Self-Training and Self-Supervised Learning for Unsupervised Disfluency Detection","date":"2020-10-29","arxiv_id":"2010.15360","n_code_links":1,"syntology":null},{"paper":"/paper/pushing-the-limits-of-semi-supervised","slug":"pushing-the-limits-of-semi-supervised","title":"Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognition","date":"2020-10-20","arxiv_id":"2010.10504","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":1,"n_instrument":1,"unverified":0,"pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":null}},{"paper":"/paper/noisy-student-training-using-body-language","slug":"noisy-student-training-using-body-language","title":"Noisy Student Training using Body Language Dataset Improves Facial Expression Recognition","date":"2020-08-06","arxiv_id":"2008.02655","n_code_links":0,"syntology":null},{"paper":null,"slug":"semi-supervised-learning-with-data","title":"Semi-Supervised Learning with Data Augmentation for End-to-End ASR","date":"2020-07-27","arxiv_id":"2007.13876","n_code_links":0,"syntology":null},{"paper":"/paper/improved-noisy-student-training-for-automatic","slug":"improved-noisy-student-training-for-automatic","title":"Improved Noisy Student Training for Automatic Speech Recognition","date":"2020-05-19","arxiv_id":"2005.09629","n_code_links":1,"syntology":null},{"paper":"/paper/self-training-with-noisy-student-improves","slug":"self-training-with-noisy-student-improves","title":"Self-training with Noisy Student improves ImageNet classification","date":"2019-11-11","arxiv_id":"1911.04252","n_code_links":13,"syntology":{"ran":13,"of":24,"n_ran_checked":10,"n_instrument":3,"unverified":11,"pointer_only":2,"phrase":"13 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 11 unverified","official":{"repos":["google-research/noisystudent","tensorflow/tpu"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":10,"ran_from_kinds":["listed","official"]}}}],"papers_shown":38,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":38,"with_a_code_link":13,"where_syntology_ran_a_sample":4,"not_listed_spam_title":0,"listed":38,"listed_where_code_ran":4,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":4,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":4,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":4,"papers_where_code_ran_first_page":"/method/noisy-student/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/noisy-student/papers/ran/1","json":"/method/noisy-student/papers/ran/1.json","rows":4}],"tasks":[{"task":"/task/speech-recognition","name":"Speech Recognition","papers":10},{"task":"/task/speech-recognition-1","name":"speech-recognition","papers":10},{"task":"/task/automatic-speech-recognition-2","name":"Automatic Speech Recognition","papers":8},{"task":"/task/automatic-speech-recognition","name":"Automatic Speech Recognition (ASR)","papers":7},{"task":"/task/image-classification","name":"Image Classification","papers":6},{"task":"/task/image-classification","name":"image-classification","papers":6},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":4},{"task":"/task/pseudo-label","name":"Pseudo Label","papers":4},{"task":"/task/segmentation","name":"Segmentation","papers":4},{"task":"/task/knowledge-distillation","name":"Knowledge Distillation","papers":3},{"task":"/task/self-supervised-learning","name":"Self-Supervised Learning","papers":3},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":3},{"task":"/task/classification-1","name":"Classification","papers":2},{"task":"/task/computed-tomography-ct","name":"Computed Tomography (CT)","papers":2},{"task":"/task/domain-adaptation","name":"Domain Adaptation","papers":2},{"task":"/task/classification","name":"General Classification","papers":2},{"task":"/task/language-modelling","name":"Language Modelling","papers":2},{"task":"/task/object","name":"Object","papers":2},{"task":"/task/6d-pose-estimation-1","name":"6D Pose Estimation","papers":1},{"task":"/task/6d-pose-estimation","name":"6D Pose Estimation using RGB","papers":1}],"tasks_shown":20,"n_tasks":65,"usage_by_year":[{"year":"2019","papers":1},{"year":"2020","papers":8},{"year":"2021","papers":10},{"year":"2022","papers":8},{"year":"2024","papers":8},{"year":"2025","papers":3}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/noisy-student"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Noisy%20Student","read_at":"2026-10-05T00:59:41+00:00","query":"Noisy Student","kind":"method","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":null,"repositories":null,"retrieve_with":null,"name_competition":{"verdict":"none","may_be_wrong_sense":false,"bearers_found":0,"served":null,"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing in this corpus is named 'Noisy Student' -- no method node, no paper announcing it in its title, no expanded form declaring it as an acronym."},"name_competition_text":null,"near_matches":["Noisy Student Training","NOPD (Noisy Student On-Policy Self-Distillation)","IAG-Student","Noisy Nodes","Dual Student","Noisy Alignment","Noisy but Valid","PLL student model"],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"130d0e8ea0e88b50bbc94e8ed2cc928cf3eb26d471bcf83c57e259e30d954325","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}