{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/population-based-training-of-neural-networks","title":"Population Based Training of Neural Networks","arxiv_id":"1711.09846","date":"2017-11-27","proceeding":null,"authors":["Max Jaderberg","Valentin Dalibard","Simon Osindero","Wojciech M. Czarnecki","Jeff Donahue","Ali Razavi","Oriol Vinyals","Tim Green","Iain Dunning","Karen Simonyan","Chrisantha Fernando","Koray Kavukcuoglu"],"abstract":"Neural networks dominate the modern machine learning landscape, but their\ntraining and success still suffer from sensitivity to empirical choices of\nhyperparameters such as model architecture, loss function, and optimisation\nalgorithm. In this work we present \\emph{Population Based Training (PBT)}, a\nsimple asynchronous optimisation algorithm which effectively utilises a fixed\ncomputational budget to jointly optimise a population of models and their\nhyperparameters to maximise performance. Importantly, PBT discovers a schedule\nof hyperparameter settings rather than following the generally sub-optimal\nstrategy of trying to find a single fixed set to use for the whole course of\ntraining. With just a small modification to a typical distributed\nhyperparameter training framework, our method allows robust and reliable\ntraining of models. We demonstrate the effectiveness of PBT on deep\nreinforcement learning problems, showing faster wall-clock convergence and\nhigher final performance of agents by optimising over a suite of\nhyperparameters. In addition, we show the same method can be applied to\nsupervised learning for machine translation, where PBT is used to maximise the\nBLEU score directly, and also to training of Generative Adversarial Networks to\nmaximise the Inception score of generated images. In all cases PBT results in\nthe automatic discovery of hyperparameter schedules and model selection which\nresults in stable training and better final performance.","url_abs":"http://arxiv.org/abs/1711.09846v2","url_pdf":"http://arxiv.org/pdf/1711.09846v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/AlexHeyman/PopulationBasedTraining","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}},{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/JonasLeininger/ray-population-based-training","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/MattKleinsmith/pbt","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/cogsys-tuebingen/uninas","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/facebookresearch/how-to-autorl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/ir2718/semantic-similarity-scoring","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/kklipski/ALHE-projekt","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/mle-infrastructure/mle-hyperopt","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}},{"paper_slug":"population-based-training-of-neural-networks","repo_url":"https://github.com/voiler/populationbasedtraining","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"model-selection","task_name":"Model Selection"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"}],"methods":[{"method_slug":"population-based-training","method_name":"Population Based Training"}],"datasets_introduced":[],"methods_introduced":[{"slug":"population-based-training","name":"Population Based Training","full_name":"Population Based Training"}],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1711.09846","atlas_url":"https://app.syntology.ai/?focus=1711.09846","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1711.09846"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1711.09846\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1711.09846"},"call":"get_concepts_for_paper(arxiv_id=\"1711.09846\")"}],"by_repo":[{"repo":"AlexHeyman/PopulationBasedTraining","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"JonasLeininger/ray-population-based-training","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"MattKleinsmith/pbt","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"cogsys-tuebingen/uninas","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"facebookresearch/how-to-autorl","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2306.01324"],"harvested_for_calls":[{"arxiv_id":"2306.01324","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2306.01324"},"call":"get_harvested_code_for_paper(arxiv_id=\"2306.01324\")"}]},{"repo":"ir2718/semantic-similarity-scoring","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"kklipski/ALHE-projekt","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"mle-infrastructure/mle-hyperopt","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"voiler/populationbasedtraining","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"98bc706420e9db2850bcbe1e32259331e02e2700b8380b4337a98beccfa063f2","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}