{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/negation-detection","name":"Negation Detection","slug":"negation-detection","description_markdown":"Negation detection is the task of identifying negation cues in text.","categories":[{"name":"Natural Language Processing","url":"/area/natural-language-processing"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":55,"papers_with_code":11,"benchmarks":0,"benchmark_tables_in_archive":0,"benchmark_tables_shown":0,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":4,"subtasks":1,"parent_tasks":0},"benchmarks":[],"datasets":[{"url":"/dataset/share-clef-2014-task-2-disorders","name":"ShARe/CLEF 2014: Task 2 Disorders","full_name":"","num_papers_in_archive":3},{"url":"/dataset/thyme-2016","name":"THYME-2016","full_name":"","num_papers_in_archive":2},{"url":"/dataset/emc-dutch-clinical-corpus","name":"EMC Dutch Clinical Corpus","full_name":"","num_papers_in_archive":1},{"url":"/dataset/this-is-not-a-dataset","name":"This is not a Dataset","full_name":"This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models","num_papers_in_archive":1}],"subtasks":[{"url":"/task/negation-scope-resolution","name":"Negation Scope Resolution"}],"parent_tasks":[],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":1,"rows_per_page":100,"shown":55,"of":55,"of_with_code":11,"tagged_in_all":55,"counts":{"archive_papers_tagged":55,"with_a_code_link":11,"where_syntology_ran_a_sample":0,"not_listed_spam_title":0,"listed":55,"listed_where_code_ran":0,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":0,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":0,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/negation-detection-in-dutch-clinical-texts-an","slug":"negation-detection-in-dutch-clinical-texts-an","title":"Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods","date":"2022-09-01","arxiv_id":"2209.00470","repositories_listed":1,"syntology":null},{"url":"/paper/radiology-text-analysis-system-radtext","slug":"radiology-text-analysis-system-radtext","title":"Radiology Text Analysis System (RadText): Architecture and Evaluation","date":"2022-03-19","arxiv_id":"2204.09599","repositories_listed":1,"syntology":null},{"url":"/paper/nade-a-benchmark-for-robust-adverse-drug","slug":"nade-a-benchmark-for-robust-adverse-drug","title":"NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations","date":"2021-09-21","arxiv_id":"2109.10080","repositories_listed":1,"syntology":null},{"url":"/paper/semeval-2021-task-10-source-free-domain","slug":"semeval-2021-task-10-source-free-domain","title":"SemEval-2021 Task 10: Source-Free Domain Adaptation for Semantic Processing","date":"2021-08-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/multitask-learning-of-negation-and","slug":"multitask-learning-of-negation-and","title":"Multitask Learning of Negation and Speculation using Transformers","date":"2020-11-20","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/not-a-cute-stroke-analysis-of-rule-and-neural","slug":"not-a-cute-stroke-analysis-of-rule-and-neural","title":"Not a cute stroke: Analysis of Rule- and Neural Network-based Information Extraction Systems for Brain Radiology Reports","date":"2020-11-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/clinical-text-summarization-with-syntax-based","slug":"clinical-text-summarization-with-syntax-based","title":"Clinical Text Summarization with Syntax-Based Negation and Semantic Concept Identification","date":"2020-02-29","arxiv_id":"2003.00353","repositories_listed":1,"syntology":null},{"url":"/paper/resolving-the-scope-of-speculation-and","slug":"resolving-the-scope-of-speculation-and","title":"Resolving the Scope of Speculation and Negation using Transformer-Based Architectures","date":"2020-01-09","arxiv_id":"2001.02885","repositories_listed":1,"syntology":null},{"url":"/paper/negbert-a-transfer-learning-approach-for","slug":"negbert-a-transfer-learning-approach-for","title":"NegBERT: A Transfer Learning Approach for Negation Detection and Scope Resolution","date":"2019-11-11","arxiv_id":"1911.04211","repositories_listed":1,"syntology":null},{"url":"/paper/hpi-dhc-at-trec-2018-precision-medicine-track","slug":"hpi-dhc-at-trec-2018-precision-medicine-track","title":"HPI-DHC at TREC 2018 Precision Medicine Track","date":"2018-11-14","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/dont-let-notes-be-misunderstood-a-negation","slug":"dont-let-notes-be-misunderstood-a-negation","title":"Don't Let Notes Be Misunderstood: A Negation Detection Method for Assessing Risk of Suicide in Mental Health Records","date":"2016-06-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":null,"slug":"rexvqa-a-large-scale-visual-question","title":"ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understanding","date":"2025-06-04","arxiv_id":"2506.04353","repositories_listed":0,"syntology":null},{"url":null,"slug":"beyond-negation-detection-comprehensive","title":"Beyond Negation Detection: Comprehensive Assertion Detection Models for Clinical NLP","date":"2025-03-21","arxiv_id":"2503.17425","repositories_listed":0,"syntology":null},{"url":null,"slug":"revisiting-subword-tokenization-a-case-study","title":"Revisiting subword tokenization: A case study on affixal negation in large language models","date":"2024-04-03","arxiv_id":"2404.02421","repositories_listed":0,"syntology":null},{"url":null,"slug":"effective-matching-of-patients-to-clinical","title":"Effective Matching of Patients to Clinical Trials using Entity Extraction and Neural Re-ranking","date":"2023-07-01","arxiv_id":"2307.00381","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-negation-detection-assessment-of-gpts","title":"A negation detection assessment of GPTs: analysis with the xNot360 dataset","date":"2023-06-29","arxiv_id":"2306.16638","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-semantic-approach-to-negation-detection-and","title":"A Semantic Approach to Negation Detection and Word Disambiguation with Natural Language Processing","date":"2023-02-05","arxiv_id":"2302.02291","repositories_listed":0,"syntology":null},{"url":null,"slug":"negation-detection-in-dutch-spoken-human","title":"Negation Detection in Dutch Spoken Human-Computer Conversations","date":"2022-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"improving-negation-detection-with-negation-1","title":"Improving negation detection with negation-focused pre-training","date":"2022-05-09","arxiv_id":"2205.04012","repositories_listed":0,"syntology":null},{"url":null,"slug":"improving-negation-detection-with-negation","title":"Improving negation detection with negation-focused pre-training","date":"2022-01-16","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"flat-and-nested-negation-and-uncertainty","title":"Flat and Nested Negation and Uncertainty Detection with PubMed BERT","date":"2021-12-17","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"scope-resolution-of-predicted-negation-cues-a","title":"Scope resolution of predicted negation cues: A two-step neural network-based approach","date":"2021-09-15","arxiv_id":"2109.07264","repositories_listed":0,"syntology":null},{"url":null,"slug":"iitk-at-semeval-2021-task-10-source-free","title":"IITK at SemEval-2021 Task 10: Source-Free Unsupervised Domain Adaptation using Class Prototypes","date":"2021-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"medai-at-semeval-2021-task-10-negation-aware","title":"MedAI at SemEval-2021 Task 10: Negation-aware Pre-training for Source-free Negation Detection Domain Adaptation","date":"2021-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"the-university-of-arizona-at-semeval-2021","title":"The University of Arizona at SemEval-2021 Task 10: Applying Self-training, Active Learning and Data Augmentation to Source-free Domain Adaptation","date":"2021-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"entitybert-entity-centric-masking-strategy","title":"EntityBERT: Entity-centric Masking Strategy for Model Pretraining for the Clinical Domain","date":"2021-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"negation-typology-and-general-representation","title":"Negation typology and general representation models for cross-lingual zero-shot negation scope resolution in Russian, French, and Spanish.","date":"2021-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"domain-adaptation-in-practice-lessons-from-a","title":"Domain adaptation in practice: Lessons from a real-world information extraction pipeline","date":"2021-04-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"automatic-extraction-of-ranked-snp-phenotype","title":"Automatic Extraction of Ranked SNP-Phenotype Associations from Literature through Detecting Neural Candidates, Negation and Modality Markers","date":"2020-12-02","arxiv_id":"2012.00902","repositories_listed":0,"syntology":null},{"url":null,"slug":"negation-detection-for-clinical-text-mining","title":"Negation Detection for Clinical Text Mining in Russian","date":"2020-04-10","arxiv_id":"2004.04980","repositories_listed":0,"syntology":null},{"url":null,"slug":"speculation-and-negation-detection-in-french","title":"Speculation and Negation detection in French biomedical corpora","date":"2019-09-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"a-study-of-the-effect-of-resolving-negation","title":"A Study of the Effect of Resolving Negation and Sentiment Analysis in Recognizing Text Entailment for Arabic","date":"2019-07-05","arxiv_id":"1907.03871","repositories_listed":0,"syntology":null},{"url":null,"slug":"end-to-end-joint-entity-extraction-and","title":"Joint Entity Extraction and Assertion Detection for Clinical Text","date":"2018-12-13","arxiv_id":"1812.05270","repositories_listed":0,"syntology":null},{"url":null,"slug":"improving-hospital-mortality-prediction-with","title":"Improving Hospital Mortality Prediction with Medical Named Entities and Multimodal Learning","date":"2018-11-29","arxiv_id":"1811.12276","repositories_listed":0,"syntology":null},{"url":null,"slug":"improving-feature-extraction-for-pathology","title":"Improving Feature Extraction for Pathology Reports with Precise Negation Scope Detection","date":"2018-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"negpar-a-parallel-corpus-annotated-for","title":"NegPar: A parallel corpus annotated for negation","date":"2018-05-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"unsupervised-domain-adaptation-for-clinical","title":"Unsupervised Domain Adaptation for Clinical Negation Detection","date":"2017-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"an-open-source-tool-for-negation-detection-a","title":"An open-source tool for negation detection: a maximum-margin approach","date":"2017-04-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"annotation-of-negation-in-the-iula-spanish","title":"Annotation of negation in the IULA Spanish Clinical Record Corpus","date":"2017-04-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"negation-detection-in-clinical-reports","title":"Negation Detection in Clinical Reports Written in German","date":"2016-12-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"problematic-cases-in-the-annotation-of","title":"Problematic Cases in the Annotation of Negation in Spanish","date":"2016-12-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"modelling-radiological-language-with","title":"Modelling Radiological Language with Bidirectional Long Short-Term Memory Networks","date":"2016-09-27","arxiv_id":"1609.08409","repositories_listed":0,"syntology":null},{"url":null,"slug":"syntactic-methods-for-negation-detection-in","title":"Syntactic methods for negation detection in radiology reports in Spanish","date":"2016-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"sergiojimenez-at-semeval-2016-task-1","title":"SERGIOJIMENEZ at SemEval-2016 Task 1: Effectively Combining Paraphrase Database, String Matching, WordNet, and Word Embedding for Semantic Textual Similarity","date":"2016-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"negation-scope-detection-for-twitter","title":"Negation Scope Detection for Twitter Sentiment Analysis","date":"2015-09-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"extending-negex-with-kernel-methods-for","title":"Extending NegEx with Kernel Methods for Negation Detection in Clinical Text","date":"2015-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"learning-structures-of-negations-from-flat","title":"Learning Structures of Negations from Flat Annotations","date":"2015-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"swatac-a-sentiment-analyzer-using-one-vs-rest","title":"SWATAC: A Sentiment Analyzer using One-Vs-Rest Logistic Regression","date":"2015-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"exploiting-the-scope-of-negations-and","title":"Exploiting the Scope of Negations and Heterogeneous Features for Relation Extraction: A Case Study for Drug-Drug Interaction Extraction","date":"2013-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"negation-scope-delimitation-in-clinical-text","title":"Negation Scope Delimitation in Clinical Text Using Three Approaches: NegEx, PyConTextNLP and SynNeg","date":"2013-05-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"uabcoral-a-preliminary-study-for-resolving","title":"UABCoRAL: A Preliminary study for Resolving the Scope of Negation","date":"2012-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"ucm-2-a-rule-based-approach-to-infer-the","title":"UCM-2: a Rule-Based Approach to Infer the Scope of Negation via Dependency Parsing","date":"2012-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"ugroningen-negation-detection-with-discourse","title":"UGroningen: Negation detection with Discourse Representation Structures","date":"2012-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"unified-extraction-of-health-condition","title":"Unified Extraction of Health Condition Descriptions","date":"2012-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"a-review-corpus-annotated-for-negation","title":"A review corpus annotated for negation, speculation and their scope","date":"2012-05-01","arxiv_id":null,"repositories_listed":0,"syntology":null}],"syntology_records":0,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_where_code_ran":0,"papers_where_code_ran_first_page":null,"papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[],"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"de12abb5d588428c6f2b72439e57e2da91c5c8f17eacafa5df2e0addb4e01045","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}