{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/calibrated-prediction-intervals-for-neural","title":"Calibrated Prediction Intervals for Neural Network Regressors","arxiv_id":"1803.09546","date":"2018-03-26","proceeding":null,"authors":["Gil Keren","NIcholas Cummins","Björn Schuller"],"abstract":"Ongoing developments in neural network models are continually advancing the\nstate of the art in terms of system accuracy. However, the predicted labels\nshould not be regarded as the only core output; also important is a\nwell-calibrated estimate of the prediction uncertainty. Such estimates and\ntheir calibration are critical in many practical applications. Despite their\nobvious aforementioned advantage in relation to accuracy, contemporary neural\nnetworks can, generally, be regarded as poorly calibrated and as such do not\nproduce reliable output probability estimates. Further, while post-processing\ncalibration solutions can be found in the relevant literature, these tend to be\nfor systems performing classification. In this regard, we herein present two\nnovel methods for acquiring calibrated predictions intervals for neural network\nregressors: empirical calibration and temperature scaling. In experiments using\ndifferent regression tasks from the audio and computer vision domains, we find\nthat both our proposed methods are indeed capable of producing calibrated\nprediction intervals for neural network regressors with any desired confidence\nlevel, a finding that is consistent across all datasets and neural network\narchitectures we experimented with. In addition, we derive an additional\npractical recommendation for producing more accurate calibrated prediction\nintervals. We release the source code implementing our proposed methods for\ncomputing calibrated predicted intervals. The code for computing calibrated\npredicted intervals is publicly available.","url_abs":"http://arxiv.org/abs/1803.09546v3","url_pdf":"http://arxiv.org/pdf/1803.09546v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"calibrated-prediction-intervals-for-neural","repo_url":"https://github.com/cruvadom/Prediction_Intervals","is_official":0,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"prediction-intervals","task_name":"Prediction Intervals"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"cruvadom/Prediction_Intervals","kind":"named_in_paper","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"01e9e2b90f13ca02619b21c7f199231e1e2a3f2574e3496dfa573f24de89159c","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}