{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/octo-an-open-source-generalist-robot-policy","title":"Octo: An Open-Source Generalist Robot Policy","arxiv_id":"2405.12213","date":"2024-05-20","proceeding":null,"authors":["Octo Model Team","Dibya Ghosh","Homer Walke","Karl Pertsch","Kevin Black","Oier Mees","Sudeep Dasari","Joey Hejna","Tobias Kreiman","Charles Xu","Jianlan Luo","You Liang Tan","Lawrence Yunliang Chen","Pannag Sanketi","Quan Vuong","Ted Xiao","Dorsa Sadigh","Chelsea Finn","Sergey Levine"],"abstract":"Large policies pretrained on diverse robot datasets have the potential to transform robotic learning: instead of training new policies from scratch, such generalist robot policies may be finetuned with only a little in-domain data, yet generalize broadly. However, to be widely applicable across a range of robotic learning scenarios, environments, and tasks, such policies need to handle diverse sensors and action spaces, accommodate a variety of commonly used robotic platforms, and finetune readily and efficiently to new domains. In this work, we aim to lay the groundwork for developing open-source, widely applicable, generalist policies for robotic manipulation. As a first step, we introduce Octo, a large transformer-based policy trained on 800k trajectories from the Open X-Embodiment dataset, the largest robot manipulation dataset to date. It can be instructed via language commands or goal images and can be effectively finetuned to robot setups with new sensory inputs and action spaces within a few hours on standard consumer GPUs. In experiments across 9 robotic platforms, we demonstrate that Octo serves as a versatile policy initialization that can be effectively finetuned to new observation and action spaces. We also perform detailed ablations of design decisions for the Octo model, from architecture to training data, to guide future research on building generalist robot models.","url_abs":"https://arxiv.org/abs/2405.12213v2","url_pdf":"https://arxiv.org/pdf/2405.12213v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"robot-manipulation","task_name":"Robot Manipulation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/robot-manipulation-on-simpler-env","task":"Robot Manipulation","dataset":"SimplerEnv-Google Robot","model":"Octo-Base","rank_in_archive_order":9,"of":9,"metrics":{"Variant Aggregation":"0.012","Variant Aggregation-Move Near":"0.031","Variant Aggregation-Open/Close Drawer":"0.011","Variant Aggregation-Pick Coke Can":"0.006","Visual Matching":"0.168","Visual Matching-Move Near":"0.042","Visual Matching-Open/Close Drawer":"0.227","Visual Matching-Pick Coke Can":"0.170"},"uses_additional_data":true},{"leaderboard":"/sota/robot-manipulation-on-simplerenv-widow-x","task":"Robot Manipulation","dataset":"SimplerEnv-Widow X","model":"Octo-Small","rank_in_archive_order":3,"of":7,"metrics":{"Average":"0.300","Put Carrot on Plate":"0.097","Put Spoon on Towel":"0.472","Stack Green Block on Yellow Block":"0.042"},"uses_additional_data":true},{"leaderboard":"/sota/robot-manipulation-on-simplerenv-widow-x","task":"Robot Manipulation","dataset":"SimplerEnv-Widow X","model":"Octo-Base","rank_in_archive_order":4,"of":7,"metrics":{"Average":"0.160","Put Carrot on Plate":"0.083","Put Spoon on Towel":"0.125","Stack Green Block on Yellow Block":"0.000"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/2405.12213","atlas_url":"https://app.syntology.ai/?focus=2405.12213","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2405.12213"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2405.12213\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2405.12213"},"call":"get_concepts_for_paper(arxiv_id=\"2405.12213\")"}],"by_repo":[],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":"the archive holds no code link for this paper","arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"96f48c2f741b5faf8c36be9e4b99cbb3fbfa1f2f423820a742e1becfb701b688","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}