{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/fastspeech-2","slug":"fastspeech-2","name":"FastSpeech 2","full_name":"FastSpeech 2","full_name_withheld":false,"description_markdown":"**FastSpeech2** is a text-to-speech model that aims to improve upon FastSpeech by better solving the one-to-many mapping problem in TTS, i.e., multiple speech variations corresponding to the same text. It attempts to solve this problem by 1) directly training the model with ground-truth target instead of the simplified output from teacher, and 2) introducing more variation information of speech (e.g., pitch, energy and more accurate duration) as conditional inputs. Specifically, in FastSpeech 2, we extract duration, pitch and energy from speech waveform and directly take them as conditional inputs in training and use predicted values in inference.\r\n\r\nThe encoder converts the phoneme embedding sequence into the phoneme hidden sequence, and then the variance adaptor adds different variance information such as duration, pitch and energy into the hidden sequence, finally the mel-spectrogram decoder converts the adapted hidden sequence into mel-spectrogram sequence in parallel. FastSpeech 2 uses a feed-forward [Transformer](https://paperswithcode.com/method/transformer) block, which is a stack of [self-attention](https://paperswithcode.com/method/multi-head-attention) and 1D-[convolution](https://paperswithcode.com/method/convolution) as in FastSpeech, as the basic structure for the encoder and mel-spectrogram decoder.","description_state":"present","introduced_year":null,"introduced_by":{"title":"FastSpeech 2: Fast and High-Quality End-to-End Text to Speech","paper":"/paper/fastspeech-2-fast-and-high-quality-end-to-end","first_author":"Yi Ren","n_authors":7,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/fastspeech-2-fast-and-high-quality-end-to-end"},"source":{"url":"https://arxiv.org/abs/2006.04558v8","title":"FastSpeech 2: Fast and High-Quality End-to-End Text to Speech","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Audio","area_id":"audio","collection":"Text-to-Speech Models","url":"/methods/category/text-to-speech-models","pwc_aliases":[]}],"n_papers_tagged":20,"archive_num_papers":20,"papers_newest_first":[{"paper":null,"slug":"amnet-an-acoustic-model-network-for-enhanced","title":"AMNet: An Acoustic Model Network for Enhanced Mandarin Speech Synthesis","date":"2025-04-12","arxiv_id":"2504.09225","n_code_links":0,"syntology":null},{"paper":null,"slug":"amused-an-attentive-deep-neural-network-for","title":"AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation","date":"2024-12-13","arxiv_id":"2412.10103","n_code_links":0,"syntology":null},{"paper":null,"slug":"training-universal-vocoders-with-feature","title":"Training Universal Vocoders with Feature Smoothing-Based Augmentation Methods for High-Quality TTS Systems","date":"2024-09-04","arxiv_id":"2409.02517","n_code_links":0,"syntology":null},{"paper":null,"slug":"attentionstitch-how-attention-solves-the","title":"AttentionStitch: How Attention Solves the Speech Editing Problem","date":"2024-03-05","arxiv_id":"2403.04804","n_code_links":0,"syntology":null},{"paper":"/paper/back-transcription-as-a-method-for-evaluating","slug":"back-transcription-as-a-method-for-evaluating","title":"Back Transcription as a Method for Evaluating Robustness of Natural Language Understanding Models to Speech Recognition Errors","date":"2023-10-25","arxiv_id":"2310.16609","n_code_links":2,"syntology":null},{"paper":null,"slug":"energy-based-models-for-speech-synthesis","title":"Energy-Based Models For Speech Synthesis","date":"2023-10-19","arxiv_id":"2310.12765","n_code_links":0,"syntology":null},{"paper":"/paper/daspeech-directed-acyclic-transformer-for-1","slug":"daspeech-directed-acyclic-transformer-for-1","title":"DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation","date":"2023-10-11","arxiv_id":"2310.07403","n_code_links":1,"syntology":{"ran":5,"of":7,"n_ran_checked":5,"n_instrument":0,"unverified":2,"pointer_only":7,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","official":{"repos":["ictnlp/daspeech"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":"/paper/towards-robust-fastspeech-2-by-modelling","slug":"towards-robust-fastspeech-2-by-modelling","title":"Towards Robust FastSpeech 2 by Modelling Residual Multimodality","date":"2023-06-02","arxiv_id":"2306.01442","n_code_links":1,"syntology":null},{"paper":null,"slug":"the-effects-of-input-type-and-pronunciation","title":"The Effects of Input Type and Pronunciation Dictionary Usage in Transfer Learning for Low-Resource Text-to-Speech","date":"2023-06-01","arxiv_id":"2306.00535","n_code_links":0,"syntology":null},{"paper":"/paper/libris2s-a-german-english-speech-to-speech","slug":"libris2s-a-german-english-speech-to-speech","title":"LibriS2S: A German-English Speech-to-Speech Translation Corpus","date":"2022-04-22","arxiv_id":"2204.10593","n_code_links":1,"syntology":null},{"paper":null,"slug":"mixed-phoneme-bert-improving-bert-with-mixed","title":"Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech","date":"2022-03-31","arxiv_id":"2203.17190","n_code_links":0,"syntology":null},{"paper":"/paper/ecapa-tdnn-for-multi-speaker-text-to-speech","slug":"ecapa-tdnn-for-multi-speaker-text-to-speech","title":"ECAPA-TDNN for Multi-speaker Text-to-speech Synthesis","date":"2022-03-20","arxiv_id":"2203.10473","n_code_links":1,"syntology":null},{"paper":"/paper/multi-singer-fast-multi-singer-singing-voice-1","slug":"multi-singer-fast-multi-singer-singing-voice-1","title":"Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpus","date":"2021-12-20","arxiv_id":"2112.10358","n_code_links":2,"syntology":{"ran":1,"of":2,"n_ran_checked":1,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["Rongjiehuang/Multi-Singer"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"improving-prosody-for-unseen-texts-in-speech","title":"Improving Prosody for Unseen Texts in Speech Synthesis by Utilizing Linguistic Information and Noisy Data","date":"2021-11-15","arxiv_id":"2111.07549","n_code_links":0,"syntology":null},{"paper":"/paper/portaspeech-portable-and-high-quality","slug":"portaspeech-portable-and-high-quality","title":"PortaSpeech: Portable and High-Quality Generative Text-to-Speech","date":"2021-09-30","arxiv_id":"2109.15166","n_code_links":4,"syntology":{"ran":12,"of":12,"n_ran_checked":9,"n_instrument":3,"unverified":0,"pointer_only":6,"phrase":"12 ran (of which 1 constructed an object rather than computing a result; 9 with no instrument failure: 3 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","official":{"repos":["natspeech/natspeech"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":1,"n_ran_no_instrument_failure":3,"n_unverified":0,"ran_from_kinds":["listed","official","unlocated"]}}},{"paper":"/paper/one-tts-alignment-to-rule-them-all","slug":"one-tts-alignment-to-rule-them-all","title":"One TTS Alignment To Rule Them All","date":"2021-08-23","arxiv_id":"2108.10447","n_code_links":3,"syntology":null},{"paper":null,"slug":"digital-einstein-experience-fast-text-to","title":"Digital Einstein Experience: Fast Text-to-Speech for Conversational AI","date":"2021-07-21","arxiv_id":"2107.10658","n_code_links":0,"syntology":null},{"paper":"/paper/investigating-on-incorporating-pretrained-and","slug":"investigating-on-incorporating-pretrained-and","title":"Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech","date":"2021-03-06","arxiv_id":"2103.04088","n_code_links":1,"syntology":null},{"paper":null,"slug":"parallel-waveform-synthesis-based-on","title":"Parallel waveform synthesis based on generative adversarial networks with voicing-aware conditional discriminators","date":"2020-10-27","arxiv_id":"2010.14151","n_code_links":0,"syntology":null},{"paper":"/paper/fastspeech-2-fast-and-high-quality-end-to-end","slug":"fastspeech-2-fast-and-high-quality-end-to-end","title":"FastSpeech 2: Fast and High-Quality End-to-End Text to Speech","date":"2020-06-08","arxiv_id":"2006.04558","n_code_links":37,"syntology":{"ran":83,"of":119,"n_ran_checked":70,"n_instrument":13,"unverified":36,"pointer_only":40,"phrase":"83 ran (of which 27 constructed an object rather than computing a result; 70 with no instrument failure: 9 honoured, 1 violated, 60 with no contract checked; 13 where Syntology's instrument failed) · 36 unverified","official":null}}],"papers_shown":20,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":20,"with_a_code_link":10,"where_syntology_ran_a_sample":4,"not_listed_spam_title":0,"listed":20,"listed_where_code_ran":4,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":4,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":4,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":4,"papers_where_code_ran_first_page":"/method/fastspeech-2/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/fastspeech-2/papers/ran/1","json":"/method/fastspeech-2/papers/ran/1.json","rows":4}],"tasks":[{"task":"/task/text-to-speech","name":"Text to Speech","papers":13},{"task":"/task/text-to-speech-1","name":"text-to-speech","papers":13},{"task":"/task/speech-synthesis","name":"Speech Synthesis","papers":7},{"task":"/task/text-to-speech-synthesis","name":"Text-To-Speech Synthesis","papers":5},{"task":"/task/decoder","name":"Decoder","papers":2},{"task":"/task/knowledge-distillation","name":"Knowledge Distillation","papers":2},{"task":"/task/speech-to-speech-translation","name":"Speech-to-Speech Translation","papers":2},{"task":"/task/speech-to-text","name":"Speech-to-Text","papers":2},{"task":"/task/translation","name":"Translation","papers":2},{"task":"/task/all","name":"All","papers":1},{"task":"/task/audio-generation","name":"Audio Generation","papers":1},{"task":"/task/chinese-word-segmentation","name":"Chinese Word Segmentation","papers":1},{"task":"/task/cross-lingual-transfer","name":"Cross-Lingual Transfer","papers":1},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":1},{"task":"/task/multi-task-learning","name":"Multi-Task Learning","papers":1},{"task":"/task/natural-language-understanding","name":"Natural Language Understanding","papers":1},{"task":"/task/pos","name":"POS","papers":1},{"task":"/task/pos-tagging","name":"POS Tagging","papers":1},{"task":"/task/part-of-speech-tagging","name":"Part-Of-Speech Tagging","papers":1},{"task":"/task/polyphone-disambiguation","name":"Polyphone disambiguation","papers":1}],"tasks_shown":20,"n_tasks":36,"usage_by_year":[{"year":"2020","papers":2},{"year":"2021","papers":6},{"year":"2022","papers":3},{"year":"2023","papers":5},{"year":"2024","papers":3},{"year":"2025","papers":1}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/fastspeech-2"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=FastSpeech%202","read_at":"2026-10-05T00:55:53+00:00","query":"FastSpeech 2","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"FastSpeech 2","origin_arxiv_id":"2006.04558"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"same_paper","archive_paper_arxiv_id":"2006.04558","repositories":{"listed":5,"in_graph":37,"list_truncated":true,"strongest_link":"mentioned_in_github"},"retrieve_with":null,"name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"2006.04558","citations":1833},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'FastSpeech 2'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2006.04558","page":"/paper/fastspeech-2-fast-and-high-quality-end-to-end","syntology_url":"https://syntology.ai/paper/2006.04558","in_graph_layer":true,"samples":119,"ran":83,"n_ran_checked":70,"n_instrument":13,"unverified":36,"phrase":"83 ran (of which 27 constructed an object rather than computing a result; 70 with no instrument failure: 9 honoured, 1 violated, 60 with no contract checked; 13 where Syntology's instrument failed) · 36 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"repository known, no verified implementation (declared_code; repositories: 5 listed of 37 in the graph, strongest link: mentioned on GitHub). This answer is about arXiv:2006.04558, the paper the archive credits with this method.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"024068779cc5da75169c92137c8f271f34eda9c6774ed112b068044c3d178a7c","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}