{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/population-based-training","slug":"population-based-training","name":"Population Based Training","full_name":"Population Based Training","full_name_withheld":false,"description_markdown":"**Population Based Training**, or **PBT**, is an optimization method for finding parameters and hyperparameters, and extends upon parallel search methods and sequential optimisation methods.\r\nIt leverages information sharing across a population of concurrently running optimisation processes, and allows for online propagation/transfer of parameters and hyperparameters between members of the population based on their performance. Furthermore, unlike most other adaptation schemes, the method is capable of performing online adaptation of hyperparameters -- which can be particularly important in problems with highly non-stationary learning dynamics, such as reinforcement learning settings. PBT is decentralised and asynchronous, although it could also be executed semi-serially or with partial synchrony if there is a binding budget constraint.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Population Based Training of Neural Networks","paper":"/paper/population-based-training-of-neural-networks","first_author":"Max Jaderberg","n_authors":12,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/population-based-training-of-neural-networks"},"source":{"url":"http://arxiv.org/abs/1711.09846v2","title":"Population Based Training of Neural Networks","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/elsheikh21/population-based-training-of-NNs/blob/8337041e31e1a1be9b1cc36bdf79fe7921881116/pbt_img_classification/main.py#L163","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Hyperparameter Search","url":"/methods/category/hyperparameter-search","pwc_aliases":[]},{"area":"General","area_id":"general","collection":"Optimization","url":"/methods/category/optimization","pwc_aliases":[]}],"n_papers_tagged":18,"archive_num_papers":18,"papers_newest_first":[{"paper":"/paper/shrink-perturb-improves-architecture-mixing","slug":"shrink-perturb-improves-architecture-mixing","title":"Shrink-Perturb Improves Architecture Mixing during Population Based Training for Neural Architecture Search","date":"2023-07-28","arxiv_id":"2307.15621","n_code_links":1,"syntology":null},{"paper":"/paper/multi-objective-population-based-training","slug":"multi-objective-population-based-training","title":"Multi-Objective Population Based Training","date":"2023-06-02","arxiv_id":"2306.01436","n_code_links":1,"syntology":{"ran":0,"of":1,"n_ran_checked":0,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"0 ran · 1 unverified","official":{"repos":["arkadiyd/mo-pbt"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}},{"paper":"/paper/reducing-exploitability-with-population-based","slug":"reducing-exploitability-with-population-based","title":"Reducing Exploitability with Population Based Training","date":"2022-08-10","arxiv_id":"2208.05083","n_code_links":1,"syntology":{"ran":5,"of":5,"n_ran_checked":5,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["humancompatibleai/reducing-exploitability"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"faster-improvement-rate-population-based","title":"Faster Improvement Rate Population Based Training","date":"2021-09-28","arxiv_id":"2109.13800","n_code_links":0,"syntology":null},{"paper":null,"slug":"automated-graph-learning-via-population-based","title":"Automated Graph Learning via Population Based Self-Tuning GCN","date":"2021-07-09","arxiv_id":"2107.04713","n_code_links":0,"syntology":null},{"paper":null,"slug":"tuning-mixed-input-hyperparameters-on-the-fly","title":"Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRL","date":"2021-06-30","arxiv_id":"2106.15883","n_code_links":0,"syntology":null},{"paper":null,"slug":"training-learned-optimizers-with-randomly","title":"Training Learned Optimizers with Randomly Initialized Learned Optimizers","date":"2021-01-14","arxiv_id":"2101.07367","n_code_links":0,"syntology":null},{"paper":null,"slug":"population-based-training-for-data","title":"Population Based Training for Data Augmentation and Regularization in Speech Recognition","date":"2020-10-08","arxiv_id":"2010.03899","n_code_links":0,"syntology":null},{"paper":null,"slug":"improving-3d-object-detection-through","title":"Improving 3D Object Detection through Progressive Population Based Augmentation","date":"2020-04-02","arxiv_id":"2004.00831","n_code_links":0,"syntology":null},{"paper":"/paper/accelerating-and-improving-alphazero-using","slug":"accelerating-and-improving-alphazero-using","title":"Accelerating and Improving AlphaZero Using Population Based Training","date":"2020-03-13","arxiv_id":"2003.06212","n_code_links":1,"syntology":null},{"paper":"/paper/dada-differentiable-automatic-data","slug":"dada-differentiable-automatic-data","title":"DADA: Differentiable Automatic Data Augmentation","date":"2020-03-08","arxiv_id":"2003.03780","n_code_links":1,"syntology":{"ran":8,"of":9,"n_ran_checked":5,"n_instrument":3,"unverified":1,"pointer_only":5,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified","official":{"repos":["VDIGPKU/DADA"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"data-efficient-training-for-reinforcement","title":"Data Efficient Training for Reinforcement Learning with Adaptive Behavior Policy Sharing","date":"2020-02-12","arxiv_id":"2002.05229","n_code_links":0,"syntology":null},{"paper":"/paper/one-shot-bayes-opt-with-probabilistic","slug":"one-shot-bayes-opt-with-probabilistic","title":"Provably Efficient Online Hyperparameter Optimization with Population-Based Bandits","date":"2020-02-06","arxiv_id":"2002.02518","n_code_links":2,"syntology":{"ran":5,"of":5,"n_ran_checked":3,"n_instrument":2,"unverified":0,"pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":{"repos":["jparkerholder/PB2"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/fast-efficient-hyperparameter-tuning-for-1","slug":"fast-efficient-hyperparameter-tuning-for-1","title":"Fast Efficient Hyperparameter Tuning for Policy Gradient Methods","date":"2019-12-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/190505393","slug":"190505393","title":"Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules","date":"2019-05-14","arxiv_id":"1905.05393","n_code_links":3,"syntology":{"ran":11,"of":18,"n_ran_checked":11,"n_instrument":0,"unverified":7,"pointer_only":18,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified","official":{"repos":["arcelien/pba"],"state":"official (archive's flag): 11 ran","n_ran":11,"n_constructed":0,"n_ran_no_instrument_failure":11,"n_unverified":6,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"semi-supervised-and-population-based-training","title":"Semi-supervised and Population Based Training for Voice Commands Recognition","date":"2019-05-10","arxiv_id":"1905.04230","n_code_links":0,"syntology":null},{"paper":"/paper/fast-efficient-hyperparameter-tuning-for","slug":"fast-efficient-hyperparameter-tuning-for","title":"Fast Efficient Hyperparameter Tuning for Policy Gradients","date":"2019-02-18","arxiv_id":"1902.06583","n_code_links":1,"syntology":{"ran":0,"of":1,"n_ran_checked":0,"n_instrument":0,"unverified":1,"pointer_only":1,"phrase":"0 ran · 1 unverified","official":null}},{"paper":"/paper/population-based-training-of-neural-networks","slug":"population-based-training-of-neural-networks","title":"Population Based Training of Neural Networks","date":"2017-11-27","arxiv_id":"1711.09846","n_code_links":9,"syntology":null}],"papers_shown":18,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":18,"with_a_code_link":10,"where_syntology_ran_a_sample":4,"not_listed_spam_title":0,"listed":18,"listed_where_code_ran":4,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":4,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":4,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":4,"papers_where_code_ran_first_page":"/method/population-based-training/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/population-based-training/papers/ran/1","json":"/method/population-based-training/papers/ran/1.json","rows":4}],"tasks":[{"task":"/task/data-augmentation","name":"Data Augmentation","papers":5},{"task":"/task/hyperparameter-optimization","name":"Hyperparameter Optimization","papers":5},{"task":"/task/reinforcement-learning","name":"Reinforcement Learning","papers":4},{"task":"/task/reinforcement-learning-1","name":"Reinforcement Learning (RL)","papers":4},{"task":"/task/classification-1","name":"Classification","papers":2},{"task":"/task/deep-reinforcement-learning","name":"Deep Reinforcement Learning","papers":2},{"task":"/task/policy-gradient-methods","name":"Policy Gradient Methods","papers":2},{"task":"/task/3d-object-detection","name":"3D Object Detection","papers":1},{"task":"/task/adversarial-robustness","name":"Adversarial Robustness","papers":1},{"task":"/task/atari-games","name":"Atari Games","papers":1},{"task":"/task/decision-making","name":"Decision Making","papers":1},{"task":"/task/diversity","name":"Diversity","papers":1},{"task":"/task/fairness","name":"Fairness","papers":1},{"task":"/task/classification","name":"General Classification","papers":1},{"task":"/task/graph-classification","name":"Graph Classification","papers":1},{"task":"/task/graph-learning","name":"Graph Learning","papers":1},{"task":"/task/image-augmentation","name":"Image Augmentation","papers":1},{"task":"/task/image-generation","name":"Image Generation","papers":1},{"task":"/task/link-prediction","name":"Link Prediction","papers":1},{"task":"/task/machine-translation","name":"Machine Translation","papers":1}],"tasks_shown":20,"n_tasks":32,"usage_by_year":[{"year":"2017","papers":1},{"year":"2019","papers":4},{"year":"2020","papers":6},{"year":"2021","papers":4},{"year":"2022","papers":1},{"year":"2023","papers":2}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/population-based-training"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Population%20Based%20Training","read_at":"2026-10-05T01:00:32+00:00","query":"Population Based Training","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"Population Based Training","origin_arxiv_id":"2003.06212"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"different_paper","archive_paper_arxiv_id":"1711.09846","repositories":{"listed":1,"in_graph":1,"list_truncated":false,"strongest_link":"mentioned_in_github"},"retrieve_with":null,"name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"2003.06212","citations":20},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'Population Based Training'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[{"name":"Population Transformer (PopT)","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='Population Transformer (PopT)')","origin_arxiv_id":"2406.03044"},{"name":"Maximum Entropy Population-Based Training","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='Maximum Entropy Population-Based Training')","origin_arxiv_id":"2112.11701"},{"name":"Neural-Guided Genetic Programming Population Seeding","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='Neural-Guided Genetic Programming Population Seeding')","origin_arxiv_id":"2111.00053"},{"name":"Shapley Population Variable Importance Measure estimator","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='Shapley Population Variable Importance Measure estimator')","origin_arxiv_id":"2006.09481"}],"code_nearby_caption":"Code Syntology holds under other names, as the lookup lists them (code_nearby); not a complete list, and none of them is this method.","origin_paper":{"arxiv_id":"2003.06212","page":"/paper/accelerating-and-improving-alphazero-using","syntology_url":"https://syntology.ai/paper/2003.06212","in_graph_layer":false,"samples":0},"line":"about another paper, arXiv:2003.06212: repository known, no verified implementation (declared_code; repositories: 1 listed of 1 in the graph, strongest link: mentioned on GitHub). About another paper: this answer is about arXiv:2003.06212, while the archive credits arXiv:1711.09846.","level_legend":{"state":"quoted","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","card_sha256":"479785a84658dd682a11b10237b3620d651d7f87799f5dc7add970aaa83f6d39","note":"Syntology's served verification levels, quoted verbatim from its MCP server card; a row is split where the card separates clauses with a double hyphen, and the separator is not reproduced","levels":[{"level":"V0","quoted":["imports"]},{"level":"V1","quoted":["executes against a synthesized fixture and returns a value of the recorded type"]},{"level":"V2","quoted":["two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs","neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)"]},{"level":"V3","quoted":["paper-derived property tests pass on both of those same two generations."]}],"no_rung":"No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results."}},"syntology_have_state":"loaded","record_sha256":"467354843bdd52466f06091aa7b0efc703a30264e3d23ecb417e7f3be78a7a05","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}