{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/shallow-decision-making-analysis-in-general","title":"Shallow decision-making analysis in General Video Game Playing","arxiv_id":"1806.01151","date":"2018-06-04","proceeding":null,"authors":["Ivan Bravi","Jialin Liu","Diego Perez-Liebana","Simon Lucas"],"abstract":"The General Video Game AI competitions have been the testing ground for\nseveral techniques for game playing, such as evolutionary computation\ntechniques, tree search algorithms, hyper heuristic based or knowledge based\nalgorithms. So far the metrics used to evaluate the performance of agents have\nbeen win ratio, game score and length of games. In this paper we provide a\nwider set of metrics and a comparison method for evaluating and comparing\nagents. The metrics and the comparison method give shallow introspection into\nthe agent's decision making process and they can be applied to any agent\nregardless of its algorithmic nature. In this work, the metrics and the\ncomparison method are used to measure the impact of the terms that compose a\ntree policy of an MCTS based agent, comparing with several baseline agents. The\nresults clearly show how promising such general approach is and how it can be\nuseful to understand the behaviour of an AI agent, in particular, how the\ncomparison with baseline agents can help understanding the shape of the agent\ndecision landscape. The presented metrics and comparison method represent a\nstep toward to more descriptive ways of logging and analysing agent's\nbehaviours.","url_abs":"http://arxiv.org/abs/1806.01151v1","url_pdf":"http://arxiv.org/pdf/1806.01151v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"shallow-decision-making-analysis-in-general","repo_url":"https://github.com/ivanbravi/ShadowingAgentForGVGAI","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"ai-agent","task_name":"AI Agent"},{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"descriptive","task_name":"Descriptive"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"ivanbravi/ShadowingAgentForGVGAI","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"5a0a786d7e22479b8846d316ab0da44a01b4859fa3f99b5e761322b2172f5019","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}