Methods › General › Normalization › Conditional Batch Normalization
Conditional Batch Normalization
Introduced by Harm de Vries et al. in Modulating early visual processing by language
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Conditional Batch Normalization (CBN) is a class-conditional variant of batch normalization. The key idea is to predict the γ and β of the batch normalization from an embedding - e.g. a language embedding in VQA. CBN enables the linguistic embedding to manipulate entire feature maps by scaling them up or down, negating them, or shutting them off. CBN has also been used in GANs to allow class information to affect the batch normalization parameters.
Consider a single convolutional layer with batch normalization module BN(F_(i,c,h,w)|γ_c, β_c) for which pretrained scalars γ_c and β_c are available. We would like to directly predict these affine scaling parameters from, e.g., a language embedding e_q. When starting the training procedure, these parameters must be close to the pretrained values to recover the original ResNet model as a poor initialization could significantly deteriorate performance. Unfortunately, it is difficult to initialize a network to output the pretrained γ and β. For these reasons, the authors propose to predict a change δβ_c and δγ_c on the frozen original scalars, for which it is straightforward to initialize a neural network to produce an output with zero-mean and small variance.
The authors use a one-hidden-layer MLP to predict these deltas from a question embedding e_q for all feature maps within the layer:
Δβ= MLP(e_q)
Δγ= MLP(e_q)
So, given a feature map with C channels, these MLPs output a vector of size C. We then add these predictions to the β and γ parameters:
β̂_c = β_c + Δβ_c
γ̂_c = γ_c + Δγ_c
Finally, these updated β̂ and γ̂ are used as parameters for the batch normalization: BN(F_(i,c,h,w)|γ̂_̂ĉ, β̂_̂ĉ). The authors freeze all ResNet parameters, including γ and β, during training. A ResNet consists of four stages of computation, each subdivided in several residual blocks. In each block, the authors apply CBN to the three convolutional layers.
In Syntology for a different name, 'Batch Normalization', about another paper, arXiv:1502.03167: repository known, no verified implementation (declared_code; repositories: 5 listed of 66 in the graph, strongest link: mentioned on GitHub). The lookup matched a different name in Syntology's graph, 'Batch Normalization' (resolution: token_match); this answer is about that name. About another paper: this answer is about arXiv:1502.03167, while the archive credits arXiv:1707.00683.
Code Syntology holds under other names, as the lookup lists them (code_nearby); not a complete list, and none of them is this method.
- Batch and Match (BaM) · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='Batch and Match (BaM)') - Conditional DPG (CDPG) · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Conditional DPG (CDPG)') - Conditional Transport (CT) · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Conditional Transport (CT)') - Conditional Graph Logic Network · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Conditional Graph Logic Network') - Conditional Conjugate Integrators · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='Conditional Conjugate Integrators') - Batch Styles Standardization (BSS) · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='Batch Styles Standardization (BSS)')
Origin paper of this answer, arXiv:1502.03167 (its page on this site · its page on Syntology): Syntology's run record for its harvested code, 19 ran (of which 5 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 21 harvested samples) · 5 pointer-only (licence). The instrument figure counts failures of Syntology's instrument, not of the code. Ran means executed on a synthesized input, not that the code is correct.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
What each level means, quoted from Syntology's server card: V0 “imports”; V1 “executes against a synthesized fixture and returns a value of the recorded type”; V2 “two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs” “neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)”; V3 “paper-derived property tests pass on both of those same two generations.” The card adds: “No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results.” A level quoted in two parts is one definition the card writes as two clauses joined by a double hyphen, each clause quoted on its own (how these levels are quoted).
Papers archive 2025-07-28
archive papers tagged: 145 · with a code link: 79 · where Syntology ran a sample: 26 (22 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (26 of 145 tagged: 22 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 145, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
ParaGAN: A Scalable Distributed Training Framework for Generative Adversarial Networks 6 Nov 2024 · 0 repositories · arXiv:2411.03999
-
Unsupervised Panoptic Interpretation of Latent Spaces in GANs Using Space-Filling Vector Quantization 27 Oct 2024 · 1 repository · arXiv:2410.20573
-
RATLIP: Generative Adversarial CLIP Text-to-Image Synthesis Based on Recurrent Affine Transformations 13 May 2024 · 1 repository · arXiv:2405.08114
-
Data-driven Crop Growth Simulation on Time-varying Generated Images using Multi-conditional Generative Adversarial Networks 6 Dec 2023 · 1 repository · arXiv:2312.03443
-
On quantifying and improving realism of images generated with diffusion 26 Sep 2023 · 0 repositories · arXiv:2309.14756
-
Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flows 21 Sep 2023 · 0 repositories
-
A Strategic Framework for Optimal Decisions in Football 1-vs-1 Shot-Taking Situations: An Integrated Approach of Machine Learning, Theory-Based Modeling, and Game Theory 27 Jul 2023 · 2 repositories · arXiv:2307.14732
-
Pyrus Base: An Open Source Python Framework for the RoboCup 2D Soccer Simulation 22 Jul 2023 · 1 repository · arXiv:2307.16875
-
Diffusion Models Beat GANs on Image Classification 17 Jul 2023 · 1 repository · arXiv:2307.08702
-
Diversity is Strength: Mastering Football Full Game with Interactive Reinforcement Learning of Multiple AIs 28 Jun 2023 · 0 repositories · arXiv:2306.15903
-
Rosetta Neurons: Mining the Common Units in a Model Zoo 15 Jun 2023 · 0 repositories · arXiv:2306.09346
-
Toward more accurate and generalizable brain deformation estimators for traumatic brain injury detection with unsupervised domain adaptation 8 Jun 2023 · 0 repositories · arXiv:2306.05255
-
FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator 7 Jun 2023 · 0 repositories · arXiv:2306.07936
-
Action valuation of on- and off-ball soccer players based on multi-agent deep reinforcement learning 29 May 2023 · 0 repositories · arXiv:2305.17886
-
Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL? 27 May 2023 · 1 repository · arXiv:2305.17352Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Adaptive action supervision in reinforcement learning from real-world multi-agent demonstrations 22 May 2023 · 0 repositories · arXiv:2305.13030
-
An Empirical Study on Google Research Football Multi-agent Scenarios 16 May 2023 · 1 repository · arXiv:2305.09458
-
The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation 5 May 2023 · 1 repository · arXiv:2305.03369
-
SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenes 11 Apr 2023 · 1 repository · arXiv:2304.05170
-
VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Views 10 Apr 2023 · 1 repository · arXiv:2304.04617
-
Towards Active Learning for Action Spotting in Association Football Videos 9 Apr 2023 · 0 repositories · arXiv:2304.04220
-
Embedding Contextual Information through Reward Shaping in Multi-Agent Learning: A Case Study from Google Football 25 Mar 2023 · 0 repositories · arXiv:2303.15471
-
Deep Generative Multi-Agent Imitation Model as a Computational Benchmark for Evaluating Human Performance in Complex Interactive Tasks: A Case Study in Football 23 Mar 2023 · 0 repositories · arXiv:2303.13323
-
High Fidelity Image Synthesis With Deep VAEs In Latent Space 23 Mar 2023 · 2 repositories · arXiv:2303.13714Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images 13 Mar 2023 · 0 repositories · arXiv:2303.07274
-
NFL Career Success as Predicted by NFL Scouting Combine 10 Mar 2023 · 1 repository · arXiv:2303.05774
-
Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoning 7 Mar 2023 · 1 repository · arXiv:2303.08046
-
Identification of pattern mining algorithm for rugby league players positional groups separation based on movement patterns 25 Feb 2023 · 0 repositories · arXiv:2302.14058
-
Transformer-Based Neural Marked Spatio Temporal Point Process Model for Football Match Events Analysis 18 Feb 2023 · 1 repository · arXiv:2302.09276
-
TiZero: Mastering Multi-Agent Football with Curriculum Learning and Self-Play 15 Feb 2023 · 1 repository · arXiv:2302.07515
-
Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observations 13 Feb 2023 · 0 repositories · arXiv:2302.06569
-
Order Matters: Agent-by-agent Policy Optimization 13 Feb 2023 · 1 repository · arXiv:2302.06205Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Impact of velocity and impact angle on football shot accuracy during fundamental trainings 7 Feb 2023 · 0 repositories · arXiv:2302.03426
-
KDEformer: Accelerating Transformers via Kernel Density Estimation 5 Feb 2023 · 1 repository · arXiv:2302.02451Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples)
-
Design and Implementation of A Soccer Ball Detection System with Multiple Cameras 31 Jan 2023 · 0 repositories · arXiv:2302.00123
-
Potential Penetrative Pass (P3) 26 Jan 2023 · 0 repositories · arXiv:2302.10760
-
Event Detection in Football using Graph Convolutional Networks 24 Jan 2023 · 0 repositories · arXiv:2301.10052
-
A Machine Learning Approach for Player and Position Adjusted Expected Goals in Football (Soccer) 19 Jan 2023 · 0 repositories · arXiv:2301.13052
-
Sentiment Analysis for Measuring Hope and Fear from Reddit Posts During the 2022 Russo-Ukrainian Conflict 19 Jan 2023 · 0 repositories · arXiv:2301.08347
-
Impact of the Euro 2020 championship on the spread of COVID-19 18 Jan 2023 · 2 repositories · arXiv:2301.07659
-
Exploring Intra-Class Variation Factors With Learnable Cluster Prompts for Semi-Supervised Image Synthesis 1 Jan 2023 · 0 repositories
-
Denoising instrumented mouthguard measurements of head impact kinematics with a convolutional neural network 19 Dec 2022 · 0 repositories · arXiv:2212.09832
-
Hierarchical Strategies for Cooperative Multi-Agent Reinforcement Learning 14 Dec 2022 · 0 repositories · arXiv:2212.07397
-
Location analysis of players in UEFA EURO 2020 and 2022 using generalized valuation of defense by estimating probabilities 30 Nov 2022 · 1 repository · arXiv:2212.00021
-
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency 29 Nov 2022 · 1 repository · arXiv:2211.16068Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Pitfalls of Conditional Batch Normalization for Contextual Multi-Modal Learning 28 Nov 2022 · 0 repositories · arXiv:2211.15071
-
Predicting Football Match Outcomes with eXplainable Machine Learning and the Kelly Index 28 Nov 2022 · 0 repositories · arXiv:2211.15734
-
Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN 16 Nov 2022 · 0 repositories · arXiv:2211.08742
-
Gambling on Momentum 11 Nov 2022 · 0 repositories · arXiv:2211.06052
-
Going for GOAL: A Resource for Grounded Football Commentaries 8 Nov 2022 · 1 repository · arXiv:2211.04534
-
Graph-Based Multi-Camera Soccer Player Tracker 3 Nov 2022 · 0 repositories · arXiv:2211.02125
-
Teacher-student curriculum learning for reinforcement learning 31 Oct 2022 · 0 repositories · arXiv:2210.17368
-
Recursive Reasoning in Minimax Games: A Level k Gradient Play Method 29 Oct 2022 · 1 repository · arXiv:2210.16482
-
Group Distributionally Robust Reinforcement Learning with Hierarchical Latent Variables 21 Oct 2022 · 0 repositories · arXiv:2210.12262
-
PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning 17 Oct 2022 · 0 repositories · arXiv:2210.08872
-
Betting the system: Using lineups to predict football scores 12 Oct 2022 · 0 repositories · arXiv:2210.06327
-
ELIGN: Expectation Alignment as a Multi-Agent Intrinsic Reward 9 Oct 2022 · 1 repository · arXiv:2210.04365
-
Brain structure can mediate or moderate the relationship of behavior to brain function and transcriptome. A preliminary study 6 Oct 2022 · 0 repositories · arXiv:2210.03195
-
Towards Multimodal Prediction of Spontaneous Humour: A Novel Dataset and First Results 28 Sep 2022 · 2 repositories · arXiv:2209.14272
-
Identifying and Extracting Football Features from Real-World Media Sources using Only Synthetic Training Data 27 Sep 2022 · 0 repositories · arXiv:2209.13254
-
Observation Centric and Central Distance Recovery on Sports Player Tracking 27 Sep 2022 · 1 repository · arXiv:2209.13154
-
Hybrid Multimodal Fusion for Humor Detection 24 Sep 2022 · 0 repositories · arXiv:2209.11949
-
Lamarckian Platform: Pushing the Boundaries of Evolutionary Reinforcement Learning towards Asynchronous Commercial Games 21 Sep 2022 · 0 repositories · arXiv:2209.10055
-
Evaluation of 3D GANs for Lung Tissue Modelling in Pulmonary CT 17 Aug 2022 · 1 repository · arXiv:2208.08184
-
SKDCGN: Source-free Knowledge Distillation of Counterfactual Generative Networks using cGANs 8 Aug 2022 · 1 repository · arXiv:2208.04226
-
GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond 29 Jul 2022 · 1 repository · arXiv:2207.14812Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)
-
BigColor: Colorization using a Generative Color Prior for Natural Images 20 Jul 2022 · 1 repository · arXiv:2207.09685Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesis 19 Jun 2022 · 2 repositories · arXiv:2206.09479Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
OSSGAN: Open-Set Semi-Supervised Image Generation 29 Apr 2022 · 1 repository · arXiv:2204.14249Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Recurrent Affine Transformation for Text-to-image Synthesis 22 Apr 2022 · 2 repositories · arXiv:2204.10482
-
Interpreting Class Conditional GANs with Channel Awareness 21 Mar 2022 · 0 repositories · arXiv:2203.11173
-
Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance 5 Mar 2022 · 0 repositories · arXiv:2203.02770
-
Polarity Sampling: Quality and Diversity Control of Pre-Trained Generative Networks via Singular Values 3 Mar 2022 · 1 repository · arXiv:2203.01993
-
When do GANs replicate? On the choice of dataset size 23 Feb 2022 · 1 repository · arXiv:2202.11765
-
BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotations 12 Jan 2022 · 0 repositories · arXiv:2201.04684
-
Think Twice Before Detecting GAN-Generated Fake Images From Their Spectral Domain Imprints 1 Jan 2022 · 0 repositories
-
DGL-GAN: Discriminator Guided Learning for GAN Compression 13 Dec 2021 · 1 repository · arXiv:2112.06502
-
Scatterbrain: Unifying Sparse and Low-rank Attention Approximation 28 Oct 2021 · 1 repository · arXiv:2110.15343Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Sparse Unbalanced GAN Training with In-Time Over-Parameterization 29 Sep 2021 · 0 repositories
-
Aesthetics and neural network image representations 16 Sep 2021 · 0 repositories · arXiv:2109.08103
-
Instance-Conditioned GAN 10 Sep 2021 · 1 repository · arXiv:2109.05070
-
Improving generative adversarial network inversion via fine-tuning GAN encoders 23 Aug 2021 · 4 repositories · arXiv:2108.10201
-
Sinogram Denoise Based on Generative Adversarial Networks 9 Aug 2021 · 0 repositories · arXiv:2108.03903
-
Unrealistic Feature Suppression for Generative Adversarial Networks 23 Jul 2021 · 0 repositories · arXiv:2107.11047
-
Direct Reconstruction of Linear Parametric Images from Dynamic PET Using Nonlocal Deep Image Prior 18 Jun 2021 · 0 repositories · arXiv:2106.10359
-
Cascaded Diffusion Models for High Fidelity Image Generation 30 May 2021 · 0 repositories · arXiv:2106.15282
-
Scatterbrain: Unifying Sparse and Low-rank Attention 21 May 2021 · 1 repository
-
Efficient Subsampling of Realistic Images From GANs Conditional on a Class or a Continuous Variable 20 Mar 2021 · 1 repository · arXiv:2103.11166
-
Understanding Invariance via Feedforward Inversion of Discriminatively Trained Classifiers 15 Mar 2021 · 0 repositories · arXiv:2103.07470
-
Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective 28 Feb 2021 · 1 repository · arXiv:2103.00397
-
Complex Momentum for Optimization in Games 16 Feb 2021 · 0 repositories · arXiv:2102.08431
-
Efficient Conditional GAN Transfer with Knowledge Propagation across Classes 12 Feb 2021 · 1 repository · arXiv:2102.06696Syntology official (archive's flag): 10 ran · 11 ran (of which 5 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search 2 Feb 2021 · 3 repositories · arXiv:2102.01645
-
GAN Inversion: A Survey 14 Jan 2021 · 1 repository · arXiv:2101.05278
-
A Geometric Analysis of Deep Generative Image Models and Its Applications 1 Jan 2021 · 1 repository
-
Naturalistic Physical Adversarial Patch for Object Detectors 1 Jan 2021 · 1 repository
-
not-so-big-GAN: Generating High-Fidelity Images on Small Compute with Wavelet-based Super-Resolution 1 Jan 2021 · 0 repositories
-
Slimmable Generative Adversarial Networks 10 Dec 2020 · 1 repository · arXiv:2012.05660
-
Adaptive Weighted Discriminator for Training Generative Adversarial Networks 5 Dec 2020 · 3 repositories · arXiv:2012.03149
-
SMYRF - Efficient Attention using Asymmetric Clustering 1 Dec 2020 · 1 repository
Tasks archive 2025-07-28
20 shown of 145 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections