{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/building-generalizable-agents-with-a","title":"Building Generalizable Agents with a Realistic and Rich 3D Environment","arxiv_id":"1801.02209","date":"2018-01-07","proceeding":"ICLR 2018 1","authors":["Yi Wu","Yuxin Wu","Georgia Gkioxari","Yuandong Tian"],"abstract":"Teaching an agent to navigate in an unseen 3D environment is a challenging\ntask, even in the event of simulated environments. To generalize to unseen\nenvironments, an agent needs to be robust to low-level variations (e.g. color,\ntexture, object changes), and also high-level variations (e.g. layout changes\nof the environment). To improve overall generalization, all types of variations\nin the environment have to be taken under consideration via different level of\ndata augmentation steps. To this end, we propose House3D, a rich, extensible\nand efficient environment that contains 45,622 human-designed 3D scenes of\nvisually realistic houses, ranging from single-room studios to multi-storied\nhouses, equipped with a diverse set of fully labeled 3D objects, textures and\nscene layouts, based on the SUNCG dataset (Song et.al.). The diversity in\nHouse3D opens the door towards scene-level augmentation, while the label-rich\nnature of House3D enables us to inject pixel- & task-level augmentations such\nas domain randomization (Toubin et. al.) and multi-task training. Using a\nsubset of houses in House3D, we show that reinforcement learning agents trained\nwith an enhancement of different levels of augmentations perform much better in\nunseen environments than our baselines with raw RGB input by over 8% in terms\nof navigation success rate. House3D is publicly available at\nhttp://github.com/facebookresearch/House3D.","url_abs":"http://arxiv.org/abs/1801.02209v2","url_pdf":"http://arxiv.org/pdf/1801.02209v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"building-generalizable-agents-with-a","repo_url":"https://github.com/facebookresearch/House3D","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"building-generalizable-agents-with-a","repo_url":"https://github.com/abhshkdz/House3D","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"building-generalizable-agents-with-a","repo_url":"https://github.com/jxwuyi/House3D","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}},{"paper_slug":"building-generalizable-agents-with-a","repo_url":"https://github.com/jxwuyi/HouseNavAgent","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"building-generalizable-agents-with-a","repo_url":"https://github.com/kibeomKim/House3D_baseline","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"}],"methods":[],"datasets_introduced":[{"slug":"house3d-environment","name":"House3D Environment","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1801.02209","atlas_url":"https://app.syntology.ai/?focus=1801.02209","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1801.02209"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1801.02209\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1801.02209"},"call":"get_concepts_for_paper(arxiv_id=\"1801.02209\")"}],"by_repo":[{"repo":"facebookresearch/House3D","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["1810.11181"],"harvested_for_calls":[{"arxiv_id":"1810.11181","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1810.11181"},"call":"get_harvested_code_for_paper(arxiv_id=\"1810.11181\")"}]},{"repo":"abhshkdz/House3D","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["1810.11181"],"harvested_for_calls":[{"arxiv_id":"1810.11181","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1810.11181"},"call":"get_harvested_code_for_paper(arxiv_id=\"1810.11181\")"}]},{"repo":"jxwuyi/House3D","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"jxwuyi/HouseNavAgent","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"kibeomKim/House3D_baseline","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"2284b007e7200139735375f574dbd00c6be301f4938e523ef5ee8ad2fd8bf649","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}