{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/text-is-no-more-enough-a-benchmark-for","title":"Text is no more Enough! A Benchmark for Profile-based Spoken Language Understanding","arxiv_id":"2112.11953","date":"2021-12-22","proceeding":null,"authors":["Xiao Xu","Libo Qin","Kaiji Chen","Guoxing Wu","Linlin Li","Wanxiang Che"],"abstract":"Current researches on spoken language understanding (SLU) heavily are limited to a simple setting: the plain text-based SLU that takes the user utterance as input and generates its corresponding semantic frames (e.g., intent and slots). Unfortunately, such a simple setting may fail to work in complex real-world scenarios when an utterance is semantically ambiguous, which cannot be achieved by the text-based SLU models. In this paper, we first introduce a new and important task, Profile-based Spoken Language Understanding (ProSLU), which requires the model that not only relies on the plain text but also the supporting profile information to predict the correct intents and slots. To this end, we further introduce a large-scale human-annotated Chinese dataset with over 5K utterances and their corresponding supporting profile information (Knowledge Graph (KG), User Profile (UP), Context Awareness (CA)). In addition, we evaluate several state-of-the-art baseline models and explore a multi-level knowledge adapter to effectively incorporate profile information. Experimental results reveal that all existing text-based SLU models fail to work when the utterances are semantically ambiguous and our proposed framework can effectively fuse the supporting information for sentence-level intent detection and token-level slot filling. Finally, we summarize key challenges and provide new points for future directions, which hopes to facilitate the research.","url_abs":"https://arxiv.org/abs/2112.11953v3","url_pdf":"https://arxiv.org/pdf/2112.11953v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"text-is-no-more-enough-a-benchmark-for","repo_url":"https://github.com/looperxx/proslu","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-2.0"}}],"tasks":[{"task_slug":"intent-detection","task_name":"Intent Detection"},{"task_slug":"semantic-frame-parsing","task_name":"Semantic Frame Parsing"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"slot-filling","task_name":"Slot Filling"},{"task_slug":"spoken-language-understanding","task_name":"Spoken Language Understanding"},{"task_slug":"slot-filling-1","task_name":"slot-filling"}],"methods":[{"method_slug":"adapter","method_name":"Adapter"}],"datasets_introduced":[{"slug":"proslu","name":"ProSLU","full_name":"Profile-based Spoken Language Understanding"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/intent-detection-on-proslu","task":"Intent Detection","dataset":"ProSLU","model":"General SLU Model w/ Profile","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"0.8531"},"uses_additional_data":false},{"leaderboard":"/sota/slot-filling-on-proslu","task":"Slot Filling","dataset":"ProSLU","model":"General SLU Model w/ Profile","rank_in_archive_order":1,"of":1,"metrics":{"F1":"0.8327"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2112.11953","atlas_url":"https://app.syntology.ai/?focus=2112.11953","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2112.11953"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2112.11953\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2112.11953"},"call":"get_concepts_for_paper(arxiv_id=\"2112.11953\")"}],"by_repo":[{"repo":"looperxx/proslu","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"e039ceaa0b82366f47be0971767b2f6079d9982fd572acf38397863f1b619bbf","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}