{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/a-tree-search-algorithm-for-sequence-labeling","title":"A Tree Search Algorithm for Sequence Labeling","arxiv_id":"1804.10911","date":"2018-04-29","proceeding":null,"authors":["Yadi Lao","Jun Xu","Yanyan Lan","Jiafeng Guo","Sheng Gao","Xue-Qi Cheng"],"abstract":"In this paper we propose a novel reinforcement learning based model for\nsequence tagging, referred to as MM-Tag. Inspired by the success and\nmethodology of the AlphaGo Zero, MM-Tag formalizes the problem of sequence\ntagging with a Monte Carlo tree search (MCTS) enhanced Markov decision process\n(MDP) model, in which the time steps correspond to the positions of words in a\nsentence from left to right, and each action corresponds to assign a tag to a\nword. Two long short-term memory networks (LSTM) are used to summarize the past\ntag assignments and words in the sentence. Based on the outputs of LSTMs, the\npolicy for guiding the tag assignment and the value for predicting the whole\ntagging accuracy of the whole sentence are produced. The policy and value are\nthen strengthened with MCTS, which takes the produced raw policy and value as\ninputs, simulates and evaluates the possible tag assignments at the subsequent\npositions, and outputs a better search policy for assigning tags. A\nreinforcement learning algorithm is proposed to train the model parameters. Our\nwork is the first to apply the MCTS enhanced MDP model to the sequence tagging\ntask. We show that MM-Tag can accurately predict the tags thanks to the\nexploratory decision making mechanism introduced by MCTS. Experimental results\nshow based on a chunking benchmark showed that MM-Tag outperformed the\nstate-of-the-art sequence tagging baselines including CRF and CRF with LSTM.","url_abs":"http://arxiv.org/abs/1804.10911v2","url_pdf":"http://arxiv.org/pdf/1804.10911v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-tree-search-algorithm-for-sequence-labeling","repo_url":"https://github.com/YadiLao/MM-Tag","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":"chunking","task_name":"Chunking"},{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"tag","task_name":"TAG"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[{"method_slug":"crf","method_name":"CRF"},{"method_slug":"lstm","method_name":"LSTM"},{"method_slug":"sigmoid-activation","method_name":"Sigmoid Activation"},{"method_slug":"tanh-activation","method_name":"Tanh Activation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"YadiLao/MM-Tag","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"491956654c07054c80f0a4bff8ae1accf77b8168e7477f59ebdcdaa4b247eb0b","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}