{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/an-effective-baseline-for-robustness-to","title":"An Effective Baseline for Robustness to Distributional Shift","arxiv_id":"2105.07107","date":"2021-05-15","proceeding":null,"authors":["Sunil Thulasidasan","Sushil Thapa","Sayera Dhaubhadel","Gopinath Chennupati","Tanmoy Bhattacharya","Jeff Bilmes"],"abstract":"Refraining from confidently predicting when faced with categories of inputs different from those seen during training is an important requirement for the safe deployment of deep learning systems. While simple to state, this has been a particularly challenging problem in deep learning, where models often end up making overconfident predictions in such situations. In this work we present a simple, but highly effective approach to deal with out-of-distribution detection that uses the principle of abstention: when encountering a sample from an unseen class, the desired behavior is to abstain from predicting. Our approach uses a network with an extra abstention class and is trained on a dataset that is augmented with an uncurated set that consists of a large number of out-of-distribution (OoD) samples that are assigned the label of the abstention class; the model is then trained to learn an effective discriminator between in and out-of-distribution samples. We compare this relatively simple approach against a wide variety of more complex methods that have been proposed both for out-of-distribution detection as well as uncertainty modeling in deep learning, and empirically demonstrate its effectiveness on a wide variety of of benchmarks and deep architectures for image recognition and text classification, often outperforming existing approaches by significant margins. Given the simplicity and effectiveness of this method, we propose that this approach be used as a new additional baseline for future work in this domain.","url_abs":"https://arxiv.org/abs/2105.07107v1","url_pdf":"https://arxiv.org/pdf/2105.07107v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"an-effective-baseline-for-robustness-to","repo_url":"https://github.com/Sushil-Thapa/Abstention-OoD","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"deep-learning","task_name":"Deep Learning"},{"task_slug":"out-of-distribution-detection","task_name":"Out-of-Distribution Detection"},{"task_slug":"robust-classification","task_name":"Robust classification"},{"task_slug":"text-classification-1","task_name":"text-classification"}],"methods":[{"method_slug":"average-pooling","method_name":"Average Pooling"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"gru","method_name":"GRU"},{"method_slug":"global-average-pooling","method_name":"Global Average Pooling"},{"method_slug":"kaiming-initialization","method_name":"Kaiming Initialization"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"wide-residual-block","method_name":"Wide Residual Block"},{"method_slug":"wideresnet","method_name":"WideResNet"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/out-of-distribution-detection-on-20","task":"Out-of-Distribution Detection","dataset":"20 Newsgroups","model":"2-Layered GRU","rank_in_archive_order":1,"of":2,"metrics":{"AUROC":"99.6","FPR95":"1.78"},"uses_additional_data":true},{"leaderboard":"/sota/out-of-distribution-detection-on-cifar-10","task":"Out-of-Distribution Detection","dataset":"CIFAR-10","model":"Wide ResNet 40x2","rank_in_archive_order":2,"of":10,"metrics":{"AUROC":"99.9","FPR95":"2.0"},"uses_additional_data":true},{"leaderboard":"/sota/out-of-distribution-detection-on-cifar-100","task":"Out-of-Distribution Detection","dataset":"CIFAR-100","model":"Wide ResNet 40x2","rank_in_archive_order":1,"of":4,"metrics":{"AUROC":"97.7","FPR95":"23.4"},"uses_additional_data":true},{"leaderboard":"/sota/out-of-distribution-detection-on-sst","task":"Out-of-Distribution Detection","dataset":"SST","model":"2-Layered GRU","rank_in_archive_order":1,"of":1,"metrics":{"AUROC":"99.7","FPR95":"20.9"},"uses_additional_data":true},{"leaderboard":"/sota/out-of-distribution-detection-on-trec-news","task":"Out-of-Distribution Detection","dataset":"TREC-NEWS","model":"2-Layered GRU","rank_in_archive_order":1,"of":1,"metrics":{"AUROC":"99.9","FPR95":"4.7"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/2105.07107","atlas_url":"https://app.syntology.ai/?focus=2105.07107","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2105.07107"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2105.07107\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2105.07107"},"call":"get_concepts_for_paper(arxiv_id=\"2105.07107\")"}],"by_repo":[{"repo":"Sushil-Thapa/Abstention-OoD","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"32c8455aaec0c9fcadcc0e2132cbfd741abdff551f72d8e63b6f824696423cbd","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}