{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/190411005","title":"Analytical Moment Regularizer for Gaussian Robust Networks","arxiv_id":"1904.11005","date":"2019-04-24","proceeding":null,"authors":["Modar Alfadly","Adel Bibi","Bernard Ghanem"],"abstract":"Despite the impressive performance of deep neural networks (DNNs) on numerous\nvision tasks, they still exhibit yet-to-understand uncouth behaviours. One\npuzzling behaviour is the subtle sensitive reaction of DNNs to various noise\nattacks. Such a nuisance has strengthened the line of research around\ndeveloping and training noise-robust networks. In this work, we propose a new\ntraining regularizer that aims to minimize the probabilistic expected training\nloss of a DNN subject to a generic Gaussian input. We provide an efficient and\nsimple approach to approximate such a regularizer for arbitrary deep networks.\nThis is done by leveraging the analytic expression of the output mean of a\nshallow neural network; avoiding the need for the memory and computationally\nexpensive data augmentation. We conduct extensive experiments on LeNet and\nAlexNet on various datasets including MNIST, CIFAR10, and CIFAR100\ndemonstrating the effectiveness of our proposed regularizer. In particular, we\nshow that networks that are trained with the proposed regularizer benefit from\na boost in robustness equivalent to performing 3-21 folds of data augmentation.","url_abs":"http://arxiv.org/abs/1904.11005v1","url_pdf":"http://arxiv.org/pdf/1904.11005v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"190411005","repo_url":"https://github.com/ModarTensai/gaussian-regularizer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"lenet","method_name":"LeNet"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"ModarTensai/gaussian-regularizer","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"cebafcd3bde098a0e3bf99501e40931566b13fe5d155502e55b770d0bc3c6b27","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}