{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/learning-concise-representations-for","title":"Learning concise representations for regression by evolving networks of trees","arxiv_id":"1807.00981","date":"2018-07-03","proceeding":"ICLR 2019 5","authors":["William La Cava","Tilak Raj Singh","James Taggart","Srinivas Suri","Jason H. Moore"],"abstract":"We propose and study a method for learning interpretable representations for\nthe task of regression. Features are represented as networks of multi-type\nexpression trees comprised of activation functions common in neural networks in\naddition to other elementary functions. Differentiable features are trained via\ngradient descent, and the performance of features in a linear model is used to\nweight the rate of change among subcomponents of each representation. The\nsearch process maintains an archive of representations with accuracy-complexity\ntrade-offs to assist in generalization and interpretation. We compare several\nstochastic optimization approaches within this framework. We benchmark these\nvariants on 100 open-source regression problems in comparison to\nstate-of-the-art machine learning approaches. Our main finding is that this\napproach produces the highest average test scores across problems while\nproducing representations that are orders of magnitude smaller than the next\nbest performing method (gradient boosting). We also report a negative result in\nwhich attempts to directly optimize the disentanglement of the representation\nresult in more highly correlated features.","url_abs":"http://arxiv.org/abs/1807.00981v3","url_pdf":"http://arxiv.org/pdf/1807.00981v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-concise-representations-for","repo_url":"https://github.com/lacava/feat","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"GPL-3.0"}},{"paper_slug":"learning-concise-representations-for","repo_url":"https://github.com/by1tTZ4IsQkAO80F/iclr_2019","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"learning-concise-representations-for","repo_url":"https://github.com/lacava/iclr_2019","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"learning-concise-representations-for","repo_url":"https://github.com/cavalab/feat","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"GPL-3.0"}},{"paper_slug":"learning-concise-representations-for","repo_url":"https://github.com/galdeia/feat","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"disentanglement","task_name":"Disentanglement"},{"task_slug":"stochastic-optimization","task_name":"Stochastic Optimization"},{"task_slug":"regression-1","task_name":"regression"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1807.00981","atlas_url":"https://app.syntology.ai/?focus=1807.00981","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1807.00981"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1807.00981\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1807.00981"},"call":"get_concepts_for_paper(arxiv_id=\"1807.00981\")"}],"by_repo":[{"repo":"lacava/feat","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"by1tTZ4IsQkAO80F/iclr_2019","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"lacava/iclr_2019","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"cavalab/feat","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"galdeia/feat","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"977cb6b1a9753c862aa35a85f0df71b7f457f9325a47bc2316e916b1b0cf6b5b","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}