{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/playing-for-data-ground-truth-from-computer","title":"Playing for Data: Ground Truth from Computer Games","arxiv_id":"1608.02192","date":"2016-08-07","proceeding":null,"authors":["Stephan R. Richter","Vibhav Vineet","Stefan Roth","Vladlen Koltun"],"abstract":"Recent progress in computer vision has been driven by high-capacity models\ntrained on large datasets. Unfortunately, creating large datasets with\npixel-level labels has been extremely costly due to the amount of human effort\nrequired. In this paper, we present an approach to rapidly creating\npixel-accurate semantic label maps for images extracted from modern computer\ngames. Although the source code and the internal operation of commercial games\nare inaccessible, we show that associations between image patches can be\nreconstructed from the communication between the game and the graphics\nhardware. This enables rapid propagation of semantic labels within and across\nimages synthesized by the game, with no access to the source code or the\ncontent. We validate the presented approach by producing dense pixel-level\nsemantic annotations for 25 thousand images synthesized by a photorealistic\nopen-world computer game. Experiments on semantic segmentation datasets show\nthat using the acquired data to supplement real-world images significantly\nincreases accuracy and that the acquired data enables reducing the amount of\nhand-labeled real-world data: models trained with game data and just 1/3 of the\nCamVid training set outperform models trained on the complete CamVid training\nset.","url_abs":"http://arxiv.org/abs/1608.02192v1","url_pdf":"http://arxiv.org/pdf/1608.02192v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"playing-for-data-ground-truth-from-computer","repo_url":"https://bitbucket.org/visinf/projects-2016-playing-for-data","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"playing-for-data-ground-truth-from-computer","repo_url":"https://github.com/slevin48/gta","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[{"slug":"gta5","name":"GTA5","full_name":"Grand Theft Auto 5"}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1608.02192","atlas_url":"https://app.syntology.ai/?focus=1608.02192","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1608.02192"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1608.02192\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1608.02192"},"call":"get_concepts_for_paper(arxiv_id=\"1608.02192\")"}],"by_repo":[{"repo":"bitbucket.org/visinf/projects-2016-playing-for-data","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"slevin48/gta","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"08957ea42ffe202cb439327905239b7ddb93ce3ea81026bff2099bd89fa95dc4","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}