{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/weight-normalization","slug":"weight-normalization","name":"Weight Normalization","full_name":"Weight Normalization","full_name_withheld":false,"description_markdown":"**Weight Normalization** is a normalization method for training neural networks. It is inspired by [batch normalization](https://paperswithcode.com/method/batch-normalization), but it is a deterministic method that does not share batch normalization's property of adding noise to the gradients. It reparameterizes each $k$-dimentional weight vector $\\textbf{w}$ in terms of a parameter vector $\\textbf{v}$ and a scalar parameter $g$ and to perform stochastic gradient descent with respect to those parameters instead. Weight vectors are expressed in terms of the new parameters using:\r\n\r\n$$ \\textbf{w} = \\frac{g}{\\Vert\\\\textbf{v}\\Vert}\\textbf{v}$$\r\n\r\nwhere $\\textbf{v}$ is a $k$-dimensional vector, $g$ is a scalar, and $\\Vert\\textbf{v}\\Vert$ denotes the Euclidean norm of $\\textbf{v}$. This reparameterization has the effect of fixing the Euclidean norm of the weight vector $\\textbf{w}$: we now have $\\Vert\\textbf{w}\\Vert = g$, independent of the parameters $\\textbf{v}$.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks","paper":"/paper/weight-normalization-a-simple","first_author":"Tim Salimans","n_authors":2,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/weight-normalization-a-simple"},"source":{"url":"http://arxiv.org/abs/1602.07868v3","title":"Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/pytorch/pytorch/blob/1c5c289b6218eb1026dcb5fd9738231401cfccea/torch/nn/utils/weight_norm.py#L8","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Normalization","url":"/methods/category/normalization","pwc_aliases":[]}],"n_papers_tagged":88,"archive_num_papers":88,"papers_newest_first":[{"paper":null,"slug":"bio-inspired-plastic-neural-networks-for-zero","title":"Bio-Inspired Plastic Neural Networks for Zero-Shot Out-of-Distribution Generalization in Complex Animal-Inspired Robots","date":"2025-03-16","arxiv_id":"2503.12406","n_code_links":0,"syntology":null},{"paper":null,"slug":"scaling-off-policy-reinforcement-learning","title":"Scaling Off-Policy Reinforcement Learning with Batch and Weight Normalization","date":"2025-02-11","arxiv_id":"2502.07523","n_code_links":0,"syntology":null},{"paper":"/paper/p-mod-building-mixture-of-depths-mllms-via","slug":"p-mod-building-mixture-of-depths-mllms-via","title":"p-MoD: Building Mixture-of-Depths MLLMs via Progressive Ratio Decay","date":"2024-12-05","arxiv_id":"2412.04449","n_code_links":1,"syntology":{"ran":8,"of":8,"n_ran_checked":1,"n_instrument":7,"unverified":0,"pointer_only":1,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 7 where Syntology's instrument failed) · 0 unverified","official":{"repos":["mcg-nju/p-mod"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"at-moe-adaptive-task-planning-mixture-of","title":"AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approach","date":"2024-10-12","arxiv_id":"2410.10896","n_code_links":0,"syntology":null},{"paper":null,"slug":"optimization-and-generalization-guarantees","title":"Optimization and Generalization Guarantees for Weight Normalization","date":"2024-09-13","arxiv_id":"2409.08935","n_code_links":0,"syntology":null},{"paper":null,"slug":"weight-conditioning-for-smooth-optimization","title":"Weight Conditioning for Smooth Optimization of Neural Networks","date":"2024-09-05","arxiv_id":"2409.03424","n_code_links":0,"syntology":null},{"paper":null,"slug":"an-adaptive-gradient-regularization-method","title":"Adaptive Gradient Regularization: A Faster and Generalizable Optimization Technique for Deep Neural Networks","date":"2024-07-24","arxiv_id":"2407.16944","n_code_links":0,"syntology":null},{"paper":null,"slug":"blood-glucose-control-via-pre-trained","title":"Blood Glucose Control Via Pre-trained Counterfactual Invertible Neural Networks","date":"2024-05-23","arxiv_id":"2405.17458","n_code_links":0,"syntology":null},{"paper":"/paper/pac-bayesian-generalization-bounds-for-2","slug":"pac-bayesian-generalization-bounds-for-2","title":"PAC-Bayesian Generalization Bounds for Knowledge Graph Representation Learning","date":"2024-05-10","arxiv_id":"2405.06418","n_code_links":1,"syntology":{"ran":3,"of":4,"n_ran_checked":3,"n_instrument":0,"unverified":1,"pointer_only":4,"phrase":"3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["bdi-lab/reed"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":2,"n_ran_no_instrument_failure":3,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"hidden-synergy-l-1-weight-normalization-and-1","title":"Hidden Synergy: $L_1$ Weight Normalization and 1-Path-Norm Regularization","date":"2024-04-29","arxiv_id":"2404.19112","n_code_links":0,"syntology":null},{"paper":"/paper/xft-unlocking-the-power-of-code-instruction","slug":"xft-unlocking-the-power-of-code-instruction","title":"XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts","date":"2024-04-23","arxiv_id":"2404.15247","n_code_links":1,"syntology":{"ran":11,"of":14,"n_ran_checked":2,"n_instrument":9,"unverified":3,"pointer_only":0,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 9 where Syntology's instrument failed) · 3 unverified","official":{"repos":["ise-uiuc/xft"],"state":"official (archive's flag): 11 ran","n_ran":11,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":"/paper/a2q-improving-accumulator-aware-weight","slug":"a2q-improving-accumulator-aware-weight","title":"A2Q+: Improving Accumulator-Aware Weight Quantization","date":"2024-01-19","arxiv_id":"2401.10432","n_code_links":1,"syntology":null},{"paper":null,"slug":"banach-space-optimality-of-neural","title":"Function-Space Optimality of Neural Architectures with Multivariate Nonlinearities","date":"2023-10-05","arxiv_id":"2310.03696","n_code_links":0,"syntology":null},{"paper":null,"slug":"gradient-based-feature-learning-under","title":"Gradient-Based Feature Learning under Structured Data","date":"2023-09-07","arxiv_id":"2309.03843","n_code_links":0,"syntology":null},{"paper":"/paper/a2q-accumulator-aware-quantization-with","slug":"a2q-accumulator-aware-quantization-with","title":"A2Q: Accumulator-Aware Quantization with Guaranteed Overflow Avoidance","date":"2023-08-25","arxiv_id":"2308.13504","n_code_links":1,"syntology":null},{"paper":null,"slug":"robust-implicit-regularization-via-weight","title":"Robust Implicit Regularization via Weight Normalization","date":"2023-05-09","arxiv_id":"2305.05448","n_code_links":0,"syntology":null},{"paper":null,"slug":"quantized-neural-networks-for-low-precision","title":"Quantized Neural Networks for Low-Precision Accumulation with Guaranteed Overflow Avoidance","date":"2023-01-31","arxiv_id":"2301.13376","n_code_links":0,"syntology":null},{"paper":"/paper/clarinet-a-music-retrieval-system","slug":"clarinet-a-music-retrieval-system","title":"Clarinet: A Music Retrieval System","date":"2022-10-23","arxiv_id":"2210.12648","n_code_links":1,"syntology":null},{"paper":null,"slug":"a-variational-autoencoder-for-transformers","title":"A Variational AutoEncoder for Transformers with Nonparametric Variational Information Bottleneck","date":"2022-07-27","arxiv_id":"2207.13529","n_code_links":0,"syntology":null},{"paper":null,"slug":"wolonet-wave-outlooker-for-efficient-and-high","title":"WOLONet: Wave Outlooker for Efficient and High Fidelity Speech Synthesis","date":"2022-06-20","arxiv_id":"2206.09920","n_code_links":0,"syntology":null},{"paper":"/paper/canonical-convolutional-neural-networks","slug":"canonical-convolutional-neural-networks","title":"Canonical convolutional neural networks","date":"2022-06-03","arxiv_id":"2206.01509","n_code_links":1,"syntology":null},{"paper":"/paper/cmelgan-an-efficient-conditional-generative","slug":"cmelgan-an-efficient-conditional-generative","title":"cMelGAN: An Efficient Conditional Generative Model Based on Mel Spectrograms","date":"2022-05-15","arxiv_id":"2205.07319","n_code_links":1,"syntology":null},{"paper":"/paper/defending-variational-autoencoders-from","slug":"defending-variational-autoencoders-from","title":"Alleviating Adversarial Attacks on Variational Autoencoders with MCMC","date":"2022-03-18","arxiv_id":"2203.09940","n_code_links":1,"syntology":null},{"paper":"/paper/polarity-sampling-quality-and-diversity","slug":"polarity-sampling-quality-and-diversity","title":"Polarity Sampling: Quality and Diversity Control of Pre-Trained Generative Networks via Singular Values","date":"2022-03-03","arxiv_id":"2203.01993","n_code_links":1,"syntology":null},{"paper":"/paper/real-time-spectrogram-inversion-on-mobile","slug":"real-time-spectrogram-inversion-on-mobile","title":"Real time spectrogram inversion on mobile phone","date":"2022-03-01","arxiv_id":"2203.00756","n_code_links":1,"syntology":null},{"paper":"/paper/deep-hybrid-models-for-out-of-distribution","slug":"deep-hybrid-models-for-out-of-distribution","title":"Deep Hybrid Models for Out-of-Distribution Detection","date":"2022-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"estimating-parameters-of-the-tree-root-in","title":"Estimating Parameters of the Tree Root in Heterogeneous Soil Environments via Mask-Guided Multi-Polarimetric Integration Neural Network","date":"2021-12-27","arxiv_id":"2112.13494","n_code_links":0,"syntology":null},{"paper":null,"slug":"audio-deepfake-perceptions-in-college-going","title":"Audio Deepfake Perceptions in College Going Populations","date":"2021-12-06","arxiv_id":"2112.03351","n_code_links":0,"syntology":null},{"paper":"/paper/vocbench-a-neural-vocoder-benchmark-for","slug":"vocbench-a-neural-vocoder-benchmark-for","title":"VocBench: A Neural Vocoder Benchmark for Speech Synthesis","date":"2021-12-06","arxiv_id":"2112.03099","n_code_links":1,"syntology":null},{"paper":"/paper/aligned-structured-sparsity-learning-for","slug":"aligned-structured-sparsity-learning-for","title":"Aligned Structured Sparsity Learning for Efficient Image Super-Resolution","date":"2021-12-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"towards-stable-and-robust-addernets","title":"Towards Stable and Robust AdderNets","date":"2021-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/robust-and-provably-monotonic-networks","slug":"robust-and-provably-monotonic-networks","title":"Robust and Provably Monotonic Networks","date":"2021-11-30","arxiv_id":"2112.00038","n_code_links":0,"syntology":{"ran":5,"of":6,"n_ran_checked":5,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":null}},{"paper":null,"slug":"logit-attenuating-weight-normalization","title":"Logit Attenuating Weight Normalization","date":"2021-08-12","arxiv_id":"2108.05839","n_code_links":0,"syntology":null},{"paper":null,"slug":"improve-gan-based-neural-vocoder-using","title":"Improve GAN-based Neural Vocoder using Pointwise Relativistic LeastSquare GAN","date":"2021-03-26","arxiv_id":"2103.14245","n_code_links":0,"syntology":null},{"paper":null,"slug":"learnable-companding-quantization-for","title":"Learnable Companding Quantization for Accurate Low-bit Neural Networks","date":"2021-03-12","arxiv_id":"2103.07156","n_code_links":0,"syntology":null},{"paper":"/paper/towards-a-unified-framework-for-fair-and","slug":"towards-a-unified-framework-for-fair-and","title":"Towards a Unified Framework for Fair and Stable Graph Representation Learning","date":"2021-02-25","arxiv_id":"2102.13186","n_code_links":3,"syntology":{"ran":0,"of":1,"n_ran_checked":0,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"0 ran · 1 unverified","official":{"repos":["chirag126/nifty"],"state":"official: not harvested","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":[]}}},{"paper":null,"slug":"neural-sampling-machine-with-stochastic","title":"Neural Sampling Machine with Stochastic Synapse allows Brain-like Learning and Inference","date":"2021-02-20","arxiv_id":"2102.10477","n_code_links":0,"syntology":null},{"paper":null,"slug":"improved-training-of-sparse-coding","title":"Improved Training of Sparse Coding Variational Autoencoder via Weight Normalization","date":"2021-01-23","arxiv_id":"2101.09453","n_code_links":0,"syntology":null},{"paper":null,"slug":"nvae-gan-based-approach-for-unsupervised-time","title":"NVAE-GAN Based Approach for Unsupervised Time Series Anomaly Detection","date":"2021-01-08","arxiv_id":"2101.02908","n_code_links":0,"syntology":null},{"paper":null,"slug":"explicit-regularization-and-implicit-bias-in","title":"Explicit regularization and implicit bias in deep network classifiers trained with the square loss","date":"2020-12-31","arxiv_id":"2101.00072","n_code_links":0,"syntology":null},{"paper":null,"slug":"paranet-deep-regular-representation-for-3d","title":"ParaNet: Deep Regular Representation for 3D Point Clouds","date":"2020-12-05","arxiv_id":"2012.03028","n_code_links":0,"syntology":null},{"paper":"/paper/tfgan-time-and-frequency-domain-based","slug":"tfgan-time-and-frequency-domain-based","title":"TFGAN: Time and Frequency Domain Based Generative Adversarial Network for High-fidelity Speech Synthesis","date":"2020-11-24","arxiv_id":"2011.12206","n_code_links":1,"syntology":null},{"paper":"/paper/universal-melgan-a-robust-neural-vocoder-for","slug":"universal-melgan-a-robust-neural-vocoder-for","title":"Universal MelGAN: A Robust Neural Vocoder for High-Fidelity Waveform Generation in Multiple Domains","date":"2020-11-19","arxiv_id":"2011.09631","n_code_links":2,"syntology":null},{"paper":"/paper/stylemelgan-an-efficient-high-fidelity","slug":"stylemelgan-an-efficient-high-fidelity","title":"StyleMelGAN: An Efficient High-Fidelity Adversarial Vocoder with Temporal Adaptive Normalization","date":"2020-11-03","arxiv_id":"2011.01557","n_code_links":2,"syntology":{"ran":1,"of":2,"n_ran_checked":1,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":null}},{"paper":"/paper/inductive-bias-of-gradient-descent-for-1","slug":"inductive-bias-of-gradient-descent-for-1","title":"Inductive Bias of Gradient Descent for Weight Normalized Smooth Homogeneous Neural Nets","date":"2020-10-24","arxiv_id":"2010.12909","n_code_links":1,"syntology":null},{"paper":"/paper/speedyspeech-efficient-neural-speech","slug":"speedyspeech-efficient-neural-speech","title":"SpeedySpeech: Efficient Neural Speech Synthesis","date":"2020-08-09","arxiv_id":"2008.03802","n_code_links":3,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["janvainer/speedyspeech"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/learning-from-a-complementary-label-source","slug":"learning-from-a-complementary-label-source","title":"Learning from a Complementary-label Source Domain: Theory and Algorithms","date":"2020-08-04","arxiv_id":"2008.01454","n_code_links":1,"syntology":{"ran":3,"of":4,"n_ran_checked":1,"n_instrument":2,"unverified":1,"pointer_only":4,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":{"repos":["Yiyang98/BFUDA"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/vocgan-a-high-fidelity-real-time-vocoder-with","slug":"vocgan-a-high-fidelity-real-time-vocoder-with","title":"VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial Network","date":"2020-07-30","arxiv_id":"2007.15256","n_code_links":2,"syntology":null},{"paper":"/paper/clarinet-a-one-step-approach-towards-budget","slug":"clarinet-a-one-step-approach-towards-budget","title":"Clarinet: A One-step Approach Towards Budget-friendly Unsupervised Domain Adaptation","date":"2020-07-29","arxiv_id":"2007.14612","n_code_links":1,"syntology":{"ran":3,"of":4,"n_ran_checked":1,"n_instrument":2,"unverified":1,"pointer_only":4,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":{"repos":["Yiyang98/BFUDA"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/nvae-a-deep-hierarchical-variational","slug":"nvae-a-deep-hierarchical-variational","title":"NVAE: A Deep Hierarchical Variational Autoencoder","date":"2020-07-08","arxiv_id":"2007.03898","n_code_links":10,"syntology":{"ran":26,"of":41,"n_ran_checked":21,"n_instrument":5,"unverified":15,"pointer_only":23,"phrase":"26 ran (of which 15 constructed an object rather than computing a result; 21 with no instrument failure: 3 honoured, 0 violated, 18 with no contract checked; 5 where Syntology's instrument failed) · 15 unverified","official":{"repos":["NVlabs/NVAE"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":3,"n_ran_no_instrument_failure":6,"n_unverified":14,"ran_from_kinds":["listed","official"]}}},{"paper":"/paper/simple-and-principled-uncertainty-estimation","slug":"simple-and-principled-uncertainty-estimation","title":"Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awareness","date":"2020-06-17","arxiv_id":"2006.10108","n_code_links":4,"syntology":{"ran":2,"of":2,"n_ran_checked":1,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["google/uncertainty-baselines"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"paper":"/paper/adversarial-representation-learning-for-2","slug":"adversarial-representation-learning-for-2","title":"Adversarial representation learning for private speech generation","date":"2020-06-16","arxiv_id":"2006.09114","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":1,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["daverics/pcmelgan"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"new-interpretations-of-normalization-methods","title":"New Interpretations of Normalization Methods in Deep Learning","date":"2020-06-16","arxiv_id":"2006.09104","n_code_links":0,"syntology":null},{"paper":null,"slug":"weighted-optimization-better-generalization","title":"Overparameterization and generalization error: weighted trigonometric interpolation","date":"2020-06-15","arxiv_id":"2006.08495","n_code_links":0,"syntology":null},{"paper":"/paper/se-melgan-speaker-agnostic-rapid-speech","slug":"se-melgan-speaker-agnostic-rapid-speech","title":"SE-MelGAN -- Speaker Agnostic Rapid Speech Enhancement","date":"2020-06-13","arxiv_id":"2006.07637","n_code_links":0,"syntology":null},{"paper":null,"slug":"optimization-theory-for-relu-neural-networks","title":"Optimization Theory for ReLU Neural Networks Trained with Normalization Layers","date":"2020-06-11","arxiv_id":"2006.06878","n_code_links":0,"syntology":null},{"paper":"/paper/single-side-domain-generalization-for-face","slug":"single-side-domain-generalization-for-face","title":"Single-Side Domain Generalization for Face Anti-Spoofing","date":"2020-04-29","arxiv_id":"2004.14043","n_code_links":1,"syntology":null},{"paper":null,"slug":"parallel-neural-text-to-speech-1","title":"Parallel Neural Text-to-Speech","date":"2020-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"mean-shift-rejection-training-deep-neural","title":"Mean Shift Rejection: Training Deep Neural Networks Without Minibatch Statistics or Normalization","date":"2019-11-29","arxiv_id":"1911.13173","n_code_links":0,"syntology":null},{"paper":null,"slug":"implicit-regularization-of-normalization","title":"Implicit Regularization and Convergence for Weight Normalization","date":"2019-11-18","arxiv_id":"1911.07956","n_code_links":0,"syntology":null},{"paper":"/paper/understanding-the-disharmony-between-weight","slug":"understanding-the-disharmony-between-weight","title":"Understanding the Disharmony between Weight Normalization Family and Weight Decay: $ε-$shifted $L_2$ Regularizer","date":"2019-11-14","arxiv_id":"1911.05920","n_code_links":1,"syntology":null},{"paper":null,"slug":"systematic-comparison-of-the-influence-of","title":"Systematic Comparison of the Influence of Different Data Preprocessing Methods on the Performance of Gait Classifications Using Machine Learning","date":"2019-11-11","arxiv_id":"1911.04335","n_code_links":0,"syntology":null},{"paper":"/paper/inherent-weight-normalization-in-stochastic","slug":"inherent-weight-normalization-in-stochastic","title":"Inherent Weight Normalization in Stochastic Neural Networks","date":"2019-10-27","arxiv_id":"1910.12316","n_code_links":1,"syntology":null},{"paper":"/paper/melgan-generative-adversarial-networks-for","slug":"melgan-generative-adversarial-networks-for","title":"MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis","date":"2019-10-08","arxiv_id":"1910.06711","n_code_links":21,"syntology":{"ran":6,"of":7,"n_ran_checked":2,"n_instrument":4,"unverified":1,"pointer_only":1,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified","official":{"repos":["descriptinc/melgan-neurips"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"paper":"/paper/additive-powers-of-two-quantization-a-non","slug":"additive-powers-of-two-quantization-a-non","title":"Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks","date":"2019-09-28","arxiv_id":"1909.13144","n_code_links":1,"syntology":null},{"paper":"/paper/virtual-adversarial-lipschitz-regularization","slug":"virtual-adversarial-lipschitz-regularization","title":"Adversarial Lipschitz Regularization","date":"2019-07-12","arxiv_id":"1907.05681","n_code_links":2,"syntology":{"ran":2,"of":4,"n_ran_checked":1,"n_instrument":1,"unverified":2,"pointer_only":4,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","official":null}},{"paper":null,"slug":"multi-speaker-end-to-end-speech-synthesis","title":"Multi-Speaker End-to-End Speech Synthesis","date":"2019-07-09","arxiv_id":"1907.04462","n_code_links":0,"syntology":null},{"paper":null,"slug":"weight-normalization-based-quantization-for","title":"Weight Normalization based Quantization for Deep Neural Network Compression","date":"2019-07-01","arxiv_id":"1907.00593","n_code_links":0,"syntology":null},{"paper":"/paper/how-to-initialize-your-network-robust","slug":"how-to-initialize-your-network-robust","title":"How to Initialize your Network? Robust Initialization for WeightNorm & ResNets","date":"2019-06-05","arxiv_id":"1906.02341","n_code_links":2,"syntology":{"ran":10,"of":10,"n_ran_checked":10,"n_instrument":0,"unverified":0,"pointer_only":10,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["victorcampos7/weightnorm-init"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/on-asymptotic-behaviors-of-graph-cnns-from","slug":"on-asymptotic-behaviors-of-graph-cnns-from","title":"Graph Neural Networks Exponentially Lose Expressive Power for Node Classification","date":"2019-05-27","arxiv_id":"1905.10947","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["delta2323/gnn-asymptotics"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/parallel-neural-text-to-speech","slug":"parallel-neural-text-to-speech","title":"Non-Autoregressive Neural Text-to-Speech","date":"2019-05-21","arxiv_id":"1905.08459","n_code_links":2,"syntology":{"ran":6,"of":7,"n_ran_checked":4,"n_instrument":2,"unverified":1,"pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":null}},{"paper":null,"slug":"neural-source-filter-waveform-models-for","title":"Neural source-filter waveform models for statistical parametric speech synthesis","date":"2019-04-27","arxiv_id":"1904.12088","n_code_links":0,"syntology":null},{"paper":"/paper/waveglow-a-flow-based-generative-network-for","slug":"waveglow-a-flow-based-generative-network-for","title":"WaveGlow: A Flow-based Generative Network for Speech Synthesis","date":"2018-10-31","arxiv_id":"1811.00002","n_code_links":2,"syntology":{"ran":5,"of":7,"n_ran_checked":3,"n_instrument":2,"unverified":2,"pointer_only":2,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","official":null}},{"paper":null,"slug":"fine-tuning-on-clean-data-for-end-to-end","title":"Fine-tuning on Clean Data for End-to-End Speech Translation: FBK @ IWSLT 2018","date":"2018-10-16","arxiv_id":"1810.07652","n_code_links":0,"syntology":null},{"paper":null,"slug":"the-rwth-aachen-university-english-german-and","title":"The RWTH Aachen University English-German and German-English Unsupervised Neural Machine Translation Systems for WMT 2018","date":"2018-10-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/clarinet-parallel-wave-generation-in-end-to","slug":"clarinet-parallel-wave-generation-in-end-to","title":"ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech","date":"2018-07-19","arxiv_id":"1807.07281","n_code_links":5,"syntology":{"ran":10,"of":13,"n_ran_checked":10,"n_instrument":0,"unverified":3,"pointer_only":1,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","official":null}},{"paper":"/paper/orthogonal-weight-normalization-solution-to-1","slug":"orthogonal-weight-normalization-solution-to-1","title":"Orthogonal Weight Normalization: Solution to Optimization overMultiple Dependent Stiefel Manifolds in Deep Neural Networks","date":"2018-02-02","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"gradient-descent-learns-one-hidden-layer-cnn","title":"Gradient Descent Learns One-hidden-layer CNN: Don't be Afraid of Spurious Local Minima","date":"2017-12-03","arxiv_id":"1712.00779","n_code_links":0,"syntology":null},{"paper":"/paper/deep-voice-3-scaling-text-to-speech-with","slug":"deep-voice-3-scaling-text-to-speech-with","title":"Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning","date":"2017-10-20","arxiv_id":"1710.07654","n_code_links":7,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":null}},{"paper":"/paper/projection-based-weight-normalization-for","slug":"projection-based-weight-normalization-for","title":"Projection Based Weight Normalization for Deep Neural Networks","date":"2017-10-06","arxiv_id":"1710.02338","n_code_links":1,"syntology":null},{"paper":null,"slug":"comparison-of-batch-normalization-and-weight","title":"Comparison of Batch Normalization and Weight Normalization Algorithms for the Large-scale Image Classification","date":"2017-09-24","arxiv_id":"1709.08145","n_code_links":0,"syntology":null},{"paper":"/paper/orthogonal-weight-normalization-solution-to","slug":"orthogonal-weight-normalization-solution-to","title":"Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks","date":"2017-09-16","arxiv_id":"1709.06079","n_code_links":1,"syntology":null},{"paper":null,"slug":"churn-identification-in-microblogs-using","title":"Churn Identification in Microblogs using Convolutional Neural Networks with Structured Logical Knowledge","date":"2017-09-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/on-the-effects-of-batch-and-weight","slug":"on-the-effects-of-batch-and-weight","title":"On the Effects of Batch and Weight Normalization in Generative Adversarial Networks","date":"2017-04-13","arxiv_id":"1704.03971","n_code_links":3,"syntology":null},{"paper":"/paper/multiplicative-lstm-for-sequence-modelling","slug":"multiplicative-lstm-for-sequence-modelling","title":"Multiplicative LSTM for sequence modelling","date":"2016-09-26","arxiv_id":"1609.07959","n_code_links":1,"syntology":null},{"paper":"/paper/improved-techniques-for-training-gans","slug":"improved-techniques-for-training-gans","title":"Improved Techniques for Training GANs","date":"2016-06-10","arxiv_id":"1606.03498","n_code_links":46,"syntology":{"ran":1,"of":2,"n_ran_checked":0,"n_instrument":1,"unverified":1,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","official":{"repos":["openai/improved-gan","openai/improved_gan"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"paper":"/paper/density-estimation-using-real-nvp","slug":"density-estimation-using-real-nvp","title":"Density estimation using Real NVP","date":"2016-05-27","arxiv_id":"1605.08803","n_code_links":35,"syntology":{"ran":48,"of":70,"n_ran_checked":38,"n_instrument":10,"unverified":22,"pointer_only":33,"phrase":"48 ran (of which 26 constructed an object rather than computing a result; 38 with no instrument failure: 2 honoured, 0 violated, 36 with no contract checked; 10 where Syntology's instrument failed) · 22 unverified","official":null}},{"paper":"/paper/weight-normalization-a-simple","slug":"weight-normalization-a-simple","title":"Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks","date":"2016-02-25","arxiv_id":"1602.07868","n_code_links":9,"syntology":{"ran":10,"of":16,"n_ran_checked":9,"n_instrument":1,"unverified":6,"pointer_only":1,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified","official":{"repos":["TimSalimans/weight_norm"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}}],"papers_shown":88,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":88,"with_a_code_link":45,"where_syntology_ran_a_sample":22,"not_listed_spam_title":0,"listed":88,"listed_where_code_ran":22,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":18,"every_run_a_failure_of_syntologys_instrument":4,"listed_with_a_run_with_no_instrument_failure":18,"listed_every_run_a_failure_of_syntologys_instrument":4,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":22,"papers_where_code_ran_first_page":"/method/weight-normalization/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/weight-normalization/papers/ran/1","json":"/method/weight-normalization/papers/ran/1.json","rows":22}],"tasks":[{"task":"/task/speech-synthesis","name":"Speech Synthesis","papers":12},{"task":null,"name":"GPU","papers":7},{"task":"/task/image-classification","name":"Image Classification","papers":7},{"task":null,"name":"CPU","papers":6},{"task":"/task/image-generation","name":"Image Generation","papers":6},{"task":"/task/quantization","name":"Quantization","papers":6},{"task":"/task/text-to-speech","name":"Text to Speech","papers":6},{"task":"/task/text-to-speech-1","name":"text-to-speech","papers":6},{"task":"/task/decoder","name":"Decoder","papers":5},{"task":"/task/image-classification","name":"image-classification","papers":5},{"task":"/task/classification","name":"General Classification","papers":4},{"task":"/task/machine-learning","name":"BIG-bench Machine Learning","papers":3},{"task":"/task/machine-translation","name":"Machine Translation","papers":3},{"task":"/task/model-compression","name":"Model Compression","papers":3},{"task":"/task/representation-learning","name":"Representation Learning","papers":3},{"task":"/task/translation","name":"Translation","papers":3},{"task":"/task/audio-synthesis","name":"Audio Synthesis","papers":2},{"task":"/task/classification-1","name":"Classification","papers":2},{"task":"/task/density-estimation","name":"Density Estimation","papers":2},{"task":"/task/domain-adaptation","name":"Domain Adaptation","papers":2}],"tasks_shown":20,"n_tasks":101,"usage_by_year":[{"year":"2016","papers":4},{"year":"2017","papers":7},{"year":"2018","papers":5},{"year":"2019","papers":14},{"year":"2020","papers":19},{"year":"2021","papers":13},{"year":"2022","papers":9},{"year":"2023","papers":5},{"year":"2024","papers":10},{"year":"2025","papers":2}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/weight-normalization"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Weight%20Normalization","read_at":"2026-10-05T01:03:54+00:00","query":"Weight Normalization","kind":"paper","have":"unverified_code","tier":"harvested","verified_implementation":false,"level":1,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"arxiv_id":"1602.07868"},"resolution":"paper","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"same_paper","archive_paper_arxiv_id":"1602.07868","repositories":{"listed":9,"in_graph":9,"list_truncated":false,"strongest_link":"official"},"retrieve_with":"get_harvested_code_for_paper(arxiv_id='1602.07868')","name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"1602.07868","citations":2149},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'Weight Normalization'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"1602.07868","page":"/paper/weight-normalization-a-simple","syntology_url":"https://syntology.ai/paper/1602.07868","in_graph_layer":true,"samples":16,"ran":10,"n_ran_checked":9,"n_instrument":1,"unverified":6,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"harvested code stored, below machine verification (unverified_code; harvested), served level V1. Repositories: 9 listed of 9 in the graph, strongest link: official. The lookup matched a paper by its title, arXiv:1602.07868, not a method entry. This answer is about arXiv:1602.07868, the paper the archive credits with this method.","level_legend":{"state":"quoted","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","card_sha256":"479785a84658dd682a11b10237b3620d651d7f87799f5dc7add970aaa83f6d39","note":"Syntology's served verification levels, quoted verbatim from its MCP server card; a row is split where the card separates clauses with a double hyphen, and the separator is not reproduced","levels":[{"level":"V0","quoted":["imports"]},{"level":"V1","quoted":["executes against a synthesized fixture and returns a value of the recorded type"]},{"level":"V2","quoted":["two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs","neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)"]},{"level":"V3","quoted":["paper-derived property tests pass on both of those same two generations."]}],"no_rung":"No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results."}},"syntology_have_state":"loaded","record_sha256":"d94097145619aada01ccb38ed4208c87c3e36d506ed8735ae638b7e83f4bee0c","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}