{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/developing-bug-free-machine-learning-systems","title":"Developing Bug-Free Machine Learning Systems With Formal Mathematics","arxiv_id":"1706.08605","date":"2017-06-26","proceeding":"ICML 2017 8","authors":["Daniel Selsam","Percy Liang","David L. Dill"],"abstract":"Noisy data, non-convex objectives, model misspecification, and numerical\ninstability can all cause undesired behaviors in machine learning systems. As a\nresult, detecting actual implementation errors can be extremely difficult. We\ndemonstrate a methodology in which developers use an interactive proof\nassistant to both implement their system and to state a formal theorem defining\nwhat it means for their system to be correct. The process of proving this\ntheorem interactively in the proof assistant exposes all implementation errors\nsince any error in the program would cause the proof to fail. As a case study,\nwe implement a new system, Certigrad, for optimizing over stochastic\ncomputation graphs, and we generate a formal (i.e. machine-checkable) proof\nthat the gradients sampled by the system are unbiased estimates of the true\nmathematical gradients. We train a variational autoencoder using Certigrad and\nfind the performance comparable to training the same model in TensorFlow.","url_abs":"http://arxiv.org/abs/1706.08605v1","url_pdf":"http://arxiv.org/pdf/1706.08605v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"developing-bug-free-machine-learning-systems","repo_url":"https://github.com/dselsam/certigrad","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":"machine-learning","task_name":"BIG-bench Machine Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"dselsam/certigrad","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"adff6d17234be11b3869a08d55def71cec4e6dd9063d578165ef6ca3ac4415ae","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}