{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/knowledge-enhanced-masked-language-model-for","title":"Knowledge Enhanced Masked Language Model for Stance Detection","arxiv_id":null,"date":"2021-05-26","proceeding":"NAACL 2021 4","authors":["Kornraphop Kawintiranon","Lisa Singh"],"abstract":"Detecting stance on Twitter is especially challenging because of the short length of each tweet, the continuous coinage of new terminology and hashtags, and the deviation of sentence structure from standard prose. Fine-tuned language models using large-scale in-domain data have been shown to be the new state-of-the-art for many NLP tasks, including stance detection. In this paper, we propose a novel BERT-based fine-tuning method that enhances the masked language model for stance detection. Instead of random token masking, we propose using a weighted log-odds-ratio to identify words with high stance distinguishability and then model an attention mechanism that focuses on these words. We show that our proposed approach outperforms the state of the art for stance detection on Twitter data about the 2020 US Presidential election.","url_abs":"https://aclanthology.org/2021.naacl-main.376","url_pdf":"https://aclanthology.org/2021.naacl-main.376.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"knowledge-enhanced-masked-language-model-for","repo_url":"https://github.com/GU-DataLab/stance-detection-KE-MLM","is_official":0,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"stance-detection","task_name":"Stance Detection"},{"task_slug":"stance-detection-us-election-2020-biden","task_name":"Stance Detection (US Election 2020 - Biden)"},{"task_slug":"stance-detection-us-election-2020-trump","task_name":"Stance Detection (US Election 2020 - Trump)"}],"methods":[{"method_slug":"ke-mlm","method_name":"KE-MLM"}],"datasets_introduced":[{"slug":"twitter-stance-election-2020","name":"Twitter Stance Election 2020","full_name":""}],"methods_introduced":[{"slug":"ke-mlm","name":"KE-MLM","full_name":"Knowledge Enhanced Masked Language Model"}],"results":[{"leaderboard":"/sota/stance-detection-us-election-2020-biden-on","task":"Stance Detection (US Election 2020 - Biden)","dataset":"Twitter Stance Election 2020","model":"KE-MLM","rank_in_archive_order":1,"of":1,"metrics":{"Average F1":"0.7577"},"uses_additional_data":true},{"leaderboard":"/sota/stance-detection-us-election-2020-trump-on","task":"Stance Detection (US Election 2020 - Trump)","dataset":"Twitter Stance Election 2020","model":"KE-MLM","rank_in_archive_order":1,"of":1,"metrics":{"Average F1":"0.7877"},"uses_additional_data":true}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"no_arxiv_id","checked_against":null,"by_repo":[{"repo":"GU-DataLab/stance-detection-KE-MLM","kind":"named_in_paper","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"570381190e1e0e7ed7123812a66fdaf58d6cb1f74cf7303a9cf561c50f9132ee","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}