Methods › Sequential › Recurrent Neural Networks › WaveRNN
WaveRNN
Introduced by Nal Kalchbrenner et al. in Efficient Neural Audio Synthesis
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
WaveRNN is a single-layer recurrent neural network for audio generation that is designed efficiently predict 16-bit raw audio samples.
The overall computation in the WaveRNN is as follows (biases omitted for brevity):
xₜ = [cₜ₋₁,fₜ₋₁, cₜ]
uₜ = σ(Rᵤhₜ₋₁ + I^*ᵤxₜ)
rₜ = σ(Rᵣhₜ₋₁ + I^*ᵣxₜ)
eₜ = τ(rₜ ⊙(Rₑhₜ₋₁) + I^*ₑxₜ )
hₜ = uₜ ·hₜ₋₁ + (1-uₜ) ·eₜ
y_c, y_f = split(hₜ)
P(cₜ) = softmax(O₂relu(O₁y_c))
P(fₜ) = softmax(O₄relu(O₃y_f))
where the * indicates a masked matrix whereby the last coarse input cₜ is only connected to the fine part of the states uₜ, rₜ, eₜ and hₜ and thus only affects the fine output y_f. The coarse and fine parts cₜ and fₜ are encoded as scalars in [0, 255] and scaled to the interval [−1, 1]. The matrix R formed from the matrices Rᵤ, Rᵣ, Rₑ is computed as a single matrix-vector product to produce the contributions to all three gates uₜ, mathbfrₜ and eₜ (a variant of the GRU cell. σ and τ are the standard sigmoid and tanh non-linearities.
Each part feeds into a softmax layer over the corresponding 8 bits and the prediction of the 8 fine bits is conditioned on the 8 coarse bits. The resulting Dual Softmax layer allows for efficient prediction of 16-bit samples using two small output spaces (2 8 values each) instead of a single large output space (with 2 16 values).
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 26 · with a code link: 11 · where Syntology ran a sample: 4 (3 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (4 of 26 tagged: 3 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 26 of 26, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Exploratory Evaluation of Speech Content Masking 8 Jan 2024 · 0 repositories · arXiv:2401.03936
-
An End-to-End Multi-Module Audio Deepfake Generation System for ADD Challenge 2023 3 Jul 2023 · 0 repositories · arXiv:2307.00729
-
Evince the artifacts of Spoof Speech by blending Vocal Tract and Voice Source Features 5 Dec 2022 · 0 repositories · arXiv:2212.02013
-
SIMD-size aware weight regularization for fast neural vocoding on CPU 2 Nov 2022 · 0 repositories · arXiv:2211.00898
-
Perfectly Secure Steganography Using Minimum Entropy Coupling 24 Oct 2022 · 2 repositories · arXiv:2210.14889Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
-
Adaptive re-calibration of channel-wise features for Adversarial Audio Classification 21 Oct 2022 · 0 repositories · arXiv:2210.11722
-
WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iteration 3 Oct 2022 · 0 repositories · arXiv:2210.01029
-
R-MelNet: Reduced Mel-Spectral Modeling for Neural TTS 30 Jun 2022 · 0 repositories · arXiv:2206.15276
-
NatiQ: An End-to-end Text-to-Speech System for Arabic 15 Jun 2022 · 0 repositories · arXiv:2206.07373
-
VocBench: A Neural Vocoder Benchmark for Speech Synthesis 6 Dec 2021 · 1 repository · arXiv:2112.03099
-
On-device neural speech synthesis 17 Sep 2021 · 0 repositories · arXiv:2109.08710
-
High-Fidelity and Low-Latency Universal Neural Vocoder based on Multiband WaveRNN with Data-Driven Linear Prediction for Discrete Waveform Modeling 20 May 2021 · 1 repository · arXiv:2105.09856
-
Low-Latency Real-Time Non-Parallel Voice Conversion based on Cyclic Variational Autoencoder and Multiband WaveRNN with Data-Driven Linear Prediction 20 May 2021 · 2 repositories · arXiv:2105.09858
-
Enhancing into the codec: Noise Robust Speech Coding with Vector-Quantized Autoencoders 12 Feb 2021 · 0 repositories · arXiv:2102.06610
-
FBWave: Efficient and Scalable Neural Vocoders for Streaming Text-To-Speech on the Edge 25 Nov 2020 · 0 repositories · arXiv:2011.12985
-
TFGAN: Time and Frequency Domain Based Generative Adversarial Network for High-fidelity Speech Synthesis 24 Nov 2020 · 1 repository · arXiv:2011.12206
-
Pretraining Strategies, Waveform Model Choice, and Acoustic Configurations for Multi-Speaker End-to-End Speech Synthesis 10 Nov 2020 · 0 repositories · arXiv:2011.04839
-
Enhancing Speech Intelligibility in Text-To-Speech Synthesis using Speaking Style Conversion 13 Aug 2020 · 1 repository · arXiv:2008.05809Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Speaker Conditional WaveRNN: Towards Universal Neural Vocoder for Unseen Speaker and Recording Conditions 9 Aug 2020 · 1 repository · arXiv:2008.05289Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Audiovisual Speech Synthesis using Tacotron2 3 Aug 2020 · 0 repositories · arXiv:2008.00620
-
TTS-Portuguese Corpus: a corpus for speech synthesis in Brazilian Portuguese 11 May 2020 · 1 repository · arXiv:2005.05144
-
Towards Robust Neural Vocoding for Speech Generation: A Survey 5 Dec 2019 · 0 repositories · arXiv:1912.02461
-
A unified sequence-to-sequence front-end model for Mandarin text-to-speech synthesis 11 Nov 2019 · 0 repositories · arXiv:1911.04111
-
DurIAN: Duration Informed Attention Network For Multimodal Synthesis 4 Sep 2019 · 6 repositories · arXiv:1909.01700
-
LPCNet: Improving Neural Speech Synthesis Through Linear Prediction 28 Oct 2018 · 2 repositories · arXiv:1810.11846
-
Efficient Neural Audio Synthesis 23 Feb 2018 · 16 repositories · arXiv:1802.08435Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 27 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| Speech Synthesis | 14 |
| Text to Speech | 11 |
| text-to-speech | 11 |
| CPU | 5 |
| Text-To-Speech Synthesis | 4 |
| GPU | 3 |
| Decoder | 2 |
| Denoising | 2 |
| Face Swapping | 2 |
| Transfer Learning | 2 |
| Voice Conversion | 2 |
| Audio Classification | 1 |
| Audio Synthesis | 1 |
| Automatic Speech Recognition | 1 |
| Automatic Speech Recognition (ASR) | 1 |
| Edge Classification | 1 |
| Face Model | 1 |
| Generative Adversarial Network | 1 |
| Low-latency processing | 1 |
| Polyphone disambiguation | 1 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections