{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/strategic-dialogue-management-via-deep","title":"Strategic Dialogue Management via Deep Reinforcement Learning","arxiv_id":"1511.08099","date":"2015-11-25","proceeding":null,"authors":["Heriberto Cuayáhuitl","Simon Keizer","Oliver Lemon"],"abstract":"Artificially intelligent agents equipped with strategic skills that can\nnegotiate during their interactions with other natural or artificial agents are\nstill underdeveloped. This paper describes a successful application of Deep\nReinforcement Learning (DRL) for training intelligent agents with strategic\nconversational skills, in a situated dialogue setting. Previous studies have\nmodelled the behaviour of strategic agents using supervised learning and\ntraditional reinforcement learning techniques, the latter using tabular\nrepresentations or learning with linear function approximation. In this study,\nwe apply DRL with a high-dimensional state space to the strategic board game of\nSettlers of Catan---where players can offer resources in exchange for others\nand they can also reply to offers made by other players. Our experimental\nresults report that the DRL-based learnt policies significantly outperformed\nseveral baselines including random, rule-based, and supervised-based\nbehaviours. The DRL-based policy has a 53% win rate versus 3 automated players\n(`bots'), whereas a supervised player trained on a dialogue corpus in this\nsetting achieved only 27%, versus the same 3 bots. This result supports the\nclaim that DRL is a promising framework for training dialogue systems, and\nstrategic agents with negotiation abilities.","url_abs":"http://arxiv.org/abs/1511.08099v1","url_pdf":"http://arxiv.org/pdf/1511.08099v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"strategic-dialogue-management-via-deep","repo_url":"https://github.com/cuayahuitl/SimpleDS","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"dialogue-management","task_name":"Dialogue Management"},{"task_slug":"management","task_name":"Management"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1511.08099","atlas_url":"https://app.syntology.ai/?focus=1511.08099","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1511.08099"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1511.08099\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1511.08099"},"call":"get_concepts_for_paper(arxiv_id=\"1511.08099\")"}],"by_repo":[{"repo":"cuayahuitl/SimpleDS","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"899c70f70338dbf8edf3e3dd3e70fd544e4d52e361c6825c53ad82648578b922","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}