{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/reset-free-trial-and-error-learning-for-robot","title":"Reset-free Trial-and-Error Learning for Robot Damage Recovery","arxiv_id":"1610.04213","date":"2016-10-13","proceeding":null,"authors":["Konstantinos Chatzilygeroudis","Vassilis Vassiliades","Jean-Baptiste Mouret"],"abstract":"The high probability of hardware failures prevents many advanced robots\n(e.g., legged robots) from being confidently deployed in real-world situations\n(e.g., post-disaster rescue). Instead of attempting to diagnose the failures,\nrobots could adapt by trial-and-error in order to be able to complete their\ntasks. In this situation, damage recovery can be seen as a Reinforcement\nLearning (RL) problem. However, the best RL algorithms for robotics require the\nrobot and the environment to be reset to an initial state after each episode,\nthat is, the robot is not learning autonomously. In addition, most of the RL\nmethods for robotics do not scale well with complex robots (e.g., walking\nrobots) and either cannot be used at all or take too long to converge to a\nsolution (e.g., hours of learning). In this paper, we introduce a novel\nlearning algorithm called \"Reset-free Trial-and-Error\" (RTE) that (1) breaks\nthe complexity by pre-generating hundreds of possible behaviors with a dynamics\nsimulator of the intact robot, and (2) allows complex robots to quickly recover\nfrom damage while completing their tasks and taking the environment into\naccount. We evaluate our algorithm on a simulated wheeled robot, a simulated\nsix-legged robot, and a real six-legged walking robot that are damaged in\nseveral ways (e.g., a missing leg, a shortened leg, faulty motor, etc.) and\nwhose objective is to reach a sequence of targets in an arena. Our experiments\nshow that the robots can recover most of their locomotion abilities in an\nenvironment with obstacles, and without any human intervention.","url_abs":"http://arxiv.org/abs/1610.04213v4","url_pdf":"http://arxiv.org/pdf/1610.04213v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"reset-free-trial-and-error-learning-for-robot","repo_url":"https://github.com/resibots/chatzilygeroudis_2018_rte","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}}],"tasks":[{"task_slug":"rte","task_name":"RTE"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1610.04213","atlas_url":"https://app.syntology.ai/?focus=1610.04213","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1610.04213"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1610.04213\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1610.04213"},"call":"get_concepts_for_paper(arxiv_id=\"1610.04213\")"}],"by_repo":[{"repo":"resibots/chatzilygeroudis_2018_rte","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"972ad397de11f65fbcc6fea56f5a914fde4d9b03a9d3c33a39fb88ed97cb02e8","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}