{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/non-stochastic-best-arm-identification-and","title":"Non-stochastic Best Arm Identification and Hyperparameter Optimization","arxiv_id":"1502.07943","date":"2015-02-27","proceeding":null,"authors":["Kevin Jamieson","Ameet Talwalkar"],"abstract":"Motivated by the task of hyperparameter optimization, we introduce the\nnon-stochastic best-arm identification problem. Within the multi-armed bandit\nliterature, the cumulative regret objective enjoys algorithms and analyses for\nboth the non-stochastic and stochastic settings while to the best of our\nknowledge, the best-arm identification framework has only been considered in\nthe stochastic setting. We introduce the non-stochastic setting under this\nframework, identify a known algorithm that is well-suited for this setting, and\nanalyze its behavior. Next, by leveraging the iterative nature of standard\nmachine learning algorithms, we cast hyperparameter optimization as an instance\nof non-stochastic best-arm identification, and empirically evaluate our\nproposed algorithm on this task. Our empirical results show that, by allocating\nmore resources to promising hyperparameter settings, we typically achieve\ncomparable test accuracies an order of magnitude faster than baseline methods.","url_abs":"http://arxiv.org/abs/1502.07943v1","url_pdf":"http://arxiv.org/pdf/1502.07943v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"non-stochastic-best-arm-identification-and","repo_url":"https://github.com/mlr-org/mlr3hyperband","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"LGPL-3.0"}}],"tasks":[{"task_slug":"hyperparameter-optimization","task_name":"Hyperparameter Optimization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1502.07943","atlas_url":"https://app.syntology.ai/?focus=1502.07943","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1502.07943"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1502.07943\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1502.07943"},"call":"get_concepts_for_paper(arxiv_id=\"1502.07943\")"}],"by_repo":[{"repo":"mlr-org/mlr3hyperband","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"20367ed614386100fb1b311a381768928625112c61b307173b77163b9e09af2e","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}