{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/adaptive-weighted-discriminator-for-training","title":"Adaptive Weighted Discriminator for Training Generative Adversarial Networks","arxiv_id":"2012.03149","date":"2020-12-05","proceeding":"CVPR 2021 1","authors":["Vasily Zadorozhnyy","Qiang Cheng","Qiang Ye"],"abstract":"Generative adversarial network (GAN) has become one of the most important neural network models for classical unsupervised machine learning. A variety of discriminator loss functions have been developed to train GAN's discriminators and they all have a common structure: a sum of real and fake losses that only depends on the actual and generated data respectively. One challenge associated with an equally weighted sum of two losses is that the training may benefit one loss but harm the other, which we show causes instability and mode collapse. In this paper, we introduce a new family of discriminator loss functions that adopts a weighted sum of real and fake parts, which we call adaptive weighted loss functions or aw-loss functions. Using the gradients of the real and fake parts of the loss, we can adaptively choose weights to train a discriminator in the direction that benefits the GAN's stability. Our method can be potentially applied to any discriminator model with a loss that is a sum of the real and fake parts. Experiments validated the effectiveness of our loss functions on an unconditional image generation task, improving the baseline results by a significant margin on CIFAR-10, STL-10, and CIFAR-100 datasets in Inception Scores and FID.","url_abs":"https://arxiv.org/abs/2012.03149v2","url_pdf":"https://arxiv.org/pdf/2012.03149v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"adaptive-weighted-discriminator-for-training","repo_url":"https://github.com/vasily789/adaptive-weighted-gans","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"adaptive-weighted-discriminator-for-training","repo_url":"https://github.com/MindSpore-scientific-2/code-5/tree/main/Adaptive-Weighted-Discriminator-for-Training-Generative-Adversarial-Networks","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"adaptive-weighted-discriminator-for-training","repo_url":"https://github.com/MindSpore-scientific-2/code-9/tree/main/Adaptive-Weighted-Discriminator-for-Training-Generative-Adversarial-Networks","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"conditional-image-generation","task_name":"Conditional Image Generation"},{"task_slug":null,"task_name":"Generative Adversarial Network"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"unconditional-image-generation","task_name":"Unconditional Image Generation"}],"methods":[{"method_slug":"1x1-convolution","method_name":"1x1 Convolution"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"autogan","method_name":"AutoGAN"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"biggan","method_name":"BigGAN"},{"method_slug":"conditional-batch-normalization","method_name":"Conditional Batch Normalization"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"early-stopping","method_name":"Early Stopping"},{"method_slug":"feedforward-network","method_name":"Feedforward Network"},{"method_slug":"gan-hinge-loss","method_name":"GAN Hinge Loss"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"non-local-block","method_name":"Non-Local Block"},{"method_slug":"non-local-operation","method_name":"Non-Local Operation"},{"method_slug":"off-diagonal-orthogonal-regularization","method_name":"Off-Diagonal Orthogonal Regularization"},{"method_slug":"projection-discriminator","method_name":"Projection Discriminator"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-block","method_name":"Residual Block"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"sagan","method_name":"SAGAN"},{"method_slug":"sngan","method_name":"SNGAN"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"spectral-normalization","method_name":"Spectral Normalization"},{"method_slug":"ttur","method_name":"TTUR"},{"method_slug":"truncation-trick","method_name":"Truncation Trick"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/conditional-image-generation-on-cifar-10","task":"Conditional Image Generation","dataset":"CIFAR-10","model":"aw-BigGAN","rank_in_archive_order":8,"of":25,"metrics":{"FID":"6.89","Inception score":"9.52"},"uses_additional_data":false},{"leaderboard":"/sota/conditional-image-generation-on-cifar-10","task":"Conditional Image Generation","dataset":"CIFAR-10","model":"aw-SN-GAN","rank_in_archive_order":10,"of":25,"metrics":{"FID":"8.03","Inception score":"9"},"uses_additional_data":false},{"leaderboard":"/sota/conditional-image-generation-on-cifar-100","task":"Conditional Image Generation","dataset":"CIFAR-100","model":"aw-BigGAN","rank_in_archive_order":5,"of":7,"metrics":{"FID":"10.23","Inception Score":"11.22"},"uses_additional_data":false},{"leaderboard":"/sota/conditional-image-generation-on-cifar-100","task":"Conditional Image Generation","dataset":"CIFAR-100","model":"aw-SN-GAN","rank_in_archive_order":6,"of":7,"metrics":{"FID":"14","Inception Score":"9.48"},"uses_additional_data":false},{"leaderboard":"/sota/image-generation-on-cifar-100","task":"Image Generation","dataset":"CIFAR-100","model":"aw-AutoGAN","rank_in_archive_order":6,"of":9,"metrics":{"FID":"19","Inception Score":"8.9"},"uses_additional_data":false},{"leaderboard":"/sota/image-generation-on-cifar-100","task":"Image Generation","dataset":"CIFAR-100","model":"aw-SN-GAN","rank_in_archive_order":7,"of":9,"metrics":{"FID":"19.08","Inception Score":"8.31"},"uses_additional_data":false},{"leaderboard":"/sota/image-generation-on-stl-10","task":"Image Generation","dataset":"STL-10","model":"aw-AutoGAN","rank_in_archive_order":20,"of":31,"metrics":{"FID":"26.32","Inception score":"9.59"},"uses_additional_data":false},{"leaderboard":"/sota/image-generation-on-stl-10","task":"Image Generation","dataset":"STL-10","model":"aw-SN-GAN","rank_in_archive_order":23,"of":31,"metrics":{"FID":"34.72","Inception score":"9.61"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2012.03149","atlas_url":"https://app.syntology.ai/?focus=2012.03149","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2012.03149"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2012.03149\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2012.03149"},"call":"get_concepts_for_paper(arxiv_id=\"2012.03149\")"}],"by_repo":[{"repo":"vasily789/adaptive-weighted-gans","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"MindSpore-scientific-2/code-5","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"MindSpore-scientific-2/code-9","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"07562014983cda0b929861e9279e74b50eaf9e3762aef6943c5a10916318c330","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}