{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/actor-mimic-deep-multitask-and-transfer","title":"Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning","arxiv_id":"1511.06342","date":"2015-11-19","proceeding":null,"authors":["Emilio Parisotto","Jimmy Lei Ba","Ruslan Salakhutdinov"],"abstract":"The ability to act in multiple environments and transfer previous knowledge\nto new situations can be considered a critical aspect of any intelligent agent.\nTowards this goal, we define a novel method of multitask and transfer learning\nthat enables an autonomous agent to learn how to behave in multiple tasks\nsimultaneously, and then generalize its knowledge to new domains. This method,\ntermed \"Actor-Mimic\", exploits the use of deep reinforcement learning and model\ncompression techniques to train a single policy network that learns how to act\nin a set of distinct tasks by using the guidance of several expert teachers. We\nthen show that the representations learnt by the deep policy network are\ncapable of generalizing to new tasks with no prior expert guidance, speeding up\nlearning in novel environments. Although our method can in general be applied\nto a wide range of problems, we use Atari games as a testing environment to\ndemonstrate these methods.","url_abs":"http://arxiv.org/abs/1511.06342v4","url_pdf":"http://arxiv.org/pdf/1511.06342v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"actor-mimic-deep-multitask-and-transfer","repo_url":"https://github.com/andris955/diplomaterv","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"GPL-3.0"}},{"paper_slug":"actor-mimic-deep-multitask-and-transfer","repo_url":"https://github.com/eparisotto/ActorMimic","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"torch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"actor-mimic-deep-multitask-and-transfer","repo_url":"https://github.com/tophatraptor/si-transfer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"atari-games","task_name":"Atari Games"},{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"model-compression","task_name":"Model Compression"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"},{"task_slug":"transfer-reinforcement-learning","task_name":"Transfer Reinforcement Learning"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1511.06342","atlas_url":"https://app.syntology.ai/?focus=1511.06342","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1511.06342"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1511.06342\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1511.06342"},"call":"get_concepts_for_paper(arxiv_id=\"1511.06342\")"}],"by_repo":[{"repo":"andris955/diplomaterv","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"eparisotto/ActorMimic","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"tophatraptor/si-transfer","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"e0ef8c630f4fa3ea0bc73b91a9dcd1bd5b4c450c4c351ce4ba90f6c30dd3325b","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}