{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/deep-reinforcement-learning-on-a-budget-3d","title":"Deep Reinforcement Learning on a Budget: 3D Control and Reasoning Without a Supercomputer","arxiv_id":"1904.01806","date":"2019-04-03","proceeding":null,"authors":["Edward Beeching","Christian Wolf","Jilles Dibangoye","Olivier Simonin"],"abstract":"An important goal of research in Deep Reinforcement Learning in mobile\nrobotics is to train agents capable of solving complex tasks, which require a\nhigh level of scene understanding and reasoning from an egocentric perspective.\nWhen trained from simulations, optimal environments should satisfy a currently\nunobtainable combination of high-fidelity photographic observations, massive\namounts of different environment configurations and fast simulation speeds. In\nthis paper we argue that research on training agents capable of complex\nreasoning can be simplified by decoupling from the requirement of high fidelity\nphotographic observations. We present a suite of tasks requiring complex\nreasoning and exploration in continuous, partially observable 3D environments.\nThe objective is to provide challenging scenarios and a robust baseline agent\narchitecture that can be trained on mid-range consumer hardware in under 24h.\nOur scenarios combine two key advantages: (i) they are based on a simple but\nhighly efficient 3D environment (ViZDoom) which allows high speed simulation\n(12000fps); (ii) the scenarios provide the user with a range of difficulty\nsettings, in order to identify the limitations of current state of the art\nalgorithms and network architectures. We aim to increase accessibility to the\nfield of Deep-RL by providing baselines for challenging scenarios where new\nideas can be iterated on quickly. We argue that the community should be able to\naddress challenging problems in reasoning of mobile agents without the need for\na large compute infrastructure.","url_abs":"http://arxiv.org/abs/1904.01806v1","url_pdf":"http://arxiv.org/pdf/1904.01806v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deep-reinforcement-learning-on-a-budget-3d","repo_url":"https://github.com/edbeeching/3d_control_deep_rl","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"scene-understanding","task_name":"Scene Understanding"}],"methods":[{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"edbeeching/3d_control_deep_rl","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"5832d37ebbab101eb2ab58bc96a4702be89afbe7f33fc9c147675584322ca63e","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}