Datasets › OntoNotes 5.0

OntoNotes 5.0

Introduced by Sameer Pradhan et al. in Towards Robust Linguistic Analysis using OntoNotes1 Aug 2013 archive 2025-07-28

OntoNotes 5.0 is a large corpus comprising various genres of text (news, conversational telephone speech, weblogs, usenet newsgroups, broadcast, talk shows) in three languages (English, Chinese, and Arabic) with structural information (syntax and predicate argument structure) and shallow semantics (word sense linked to an ontology and coreference).

OntoNotes Release 5.0 contains the content of earlier releases - and adds source data from and/or additional annotations for, newswire, broadcast news, broadcast conversation, telephone conversation and web data in English and Chinese and newswire data in Arabic.

Source: https://catalog.ldc.upenn.edu/LDC2013T19

Benchmarks archive 2025-07-28

All 12 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Named Entity Recognition (NER) Ontonotes v5 (English) BERT-MRC+DSC F1 92.07 Dice Loss for Data-imbalanced NLP Tasks ShannonAI/dice_loss_for_NLP +3 28 Compare
Coreference Resolution OntoNotes Maverick_mes F1 83.6 Maverick: Efficient and Accurate Coreference Resolution... sapienzanlp/maverick-coref 26 Compare
Semantic Role Labeling OntoNotes HeSyFu F1 88.59 Better Combine Them Together! Integrating Syntactic... scofield7419/hesyfu 17 Compare
Entity Typing Ontonotes v5 (English) MLMET F1 49.1 Ultra-Fine Entity Typing with Weak Supervision from a... HKUST-KnowComp/MLMET 4 Compare
Named Entity Recognition (NER) OntoNotes DeepStruct multi-task w/ finetune F1 87.8 DeepStruct: Pretraining of Language Models for Structure... cgraywang/deepstruct 3 Compare
Named Entity Recognition (NER) OntoNotes 5.0 HGN Average F1 90.92 Hero-Gang Neural Model For Named Entity Recognition jinpeng01/hgn 2 Compare
Chinese Named Entity Recognition OntoNotes 5.0 DGLSTM-CRF F1 79.92 Dependency-Guided LSTM-CRF for Named Entity Recognition allanj/ner_with_dependency 1 Compare
Entity Typing OntoNotes LITE Macro F1 86.6 Ultra-fine Entity Typing with Indirect Supervision from... luka-group/lite 1 Compare
FG-1-PG-1 OntoNotes 5.0 CFNER F1 (macro) 0.4222 Distilling Causal Effect from Miscellaneous Other-Class... zzz47zzz/CFNER 1 Compare
Generalized Zero-Shot Learning OntoNotes ZSL-KG F1 45.21 Zero-Shot Learning with Common Sense Knowledge Graphs BatsResearch/zsl-kg +2 1 Compare
UIE OntoNotes 5.0 KnowCoder-7b-IE F1 score 88.2 KnowCoder: Coding Structured Knowledge into LLMs for... ICT-GoKnow/KnowCoder 1 Compare
coreference-resolution OntoNotes no rows — — 0 Compare

Papers archive 2025-07-28

papers with a benchmark row: 66 · with a code link: 63 · where Syntology ran a sample: 16 (15 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (16 of 66 with a benchmark row: 15 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 66 of 66 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 254. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends 1 1 31 Jul 2024 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (11 pointer-only for licence)
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction 1 1 12 Mar 2024 not harvested
NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data 1 1 23 Feb 2024 not harvested
CAW-coref: Conjunction-Aware Word-level Coreference Resolution 1 1 9 Oct 2023 not harvested
Label Supervised LLaMA Finetuning 2 1 2 Oct 2023 not harvested
Augmenting Transformers with Recursively Composed Multi-grained Representations 1 1 28 Sep 2023 official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
DiffusionNER: Boundary Diffusion for Named Entity Recognition 3 1 22 May 2023 not harvested
Coreference Resolution through a seq2seq Transition-Based System 1 1 22 Nov 2022 not harvested
Autoregressive Structured Prediction with Language Models 1 1 26 Oct 2022 not harvested
Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition 1 1 8 Oct 2022 not harvested
Efficient and Interpretable Neural Models for Entity Tracking 0 1 30 Aug 2022 not harvested
Syntax-driven Approach for Semantic Role Labeling 1 1 1 Jun 2022 not harvested
LingMess: Linguistically Informed Multi Expert Scorers for Coreference Resolution 2 1 25 May 2022 official (archive's flag): 6 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)
DeepStruct: Pretraining of Language Models for Structure Prediction 1 3 21 May 2022 official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (3 pointer-only for licence)
Hero-Gang Neural Model For Named Entity Recognition 1 2 15 May 2022 not harvested
Boundary Smoothing for Named Entity Recognition 1 1 26 Apr 2022 not harvested
Graph Refinement for Coreference Resolution 1 2 30 Mar 2022 not harvested
Parallel Instance Query Network for Named Entity Recognition 1 1 20 Mar 2022 not harvested
Ultra-fine Entity Typing with Indirect Supervision from Natural Language Inference 1 1 12 Feb 2022 not harvested
Unified Named Entity Recognition as Word-Word Relation Classification 1 1 19 Dec 2021 not harvested
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments 1 3 13 Oct 2021 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
On Generalization in Coreference Resolution 2 3 20 Sep 2021 not harvested
An MRC Framework for Semantic Role Labeling 1 1 14 Sep 2021 not harvested
Packed Levitated Marker for Entity and Relation Extraction 2 1 13 Sep 2021 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (3 pointer-only for licence)
Word-Level Coreference Resolution 1 1 9 Sep 2021 not harvested
Better Combine Them Together! Integrating Syntactic Constituency and Dependency Representations for Semantic Role Labeling 1 1 1 Aug 2021 not harvested
Constraining Linear-chain CRFs to Regular Languages 1 2 14 Jun 2021 not harvested
Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model 1 1 8 Jun 2021 not harvested
A Unified Generative Framework for Various NER Subtasks 1 1 2 Jun 2021 not harvested
Better Feature Integration for Named Entity Recognition 1 2 12 Apr 2021 not harvested
Improving Named Entity Recognition with Attentive Ensemble of Syntactic Information 1 1 29 Oct 2020 not harvested
Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networks 3 1 6 Oct 2020 not harvested
Zero-Shot Learning with Common Sense Knowledge Graphs 3 1 18 Jun 2020 not harvested
Named Entity Recognition as Dependency Parsing 1 1 14 May 2020 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (2 pointer-only for licence)
Dice Loss for Data-imbalanced NLP Tasks 4 1 7 Nov 2019 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Hierarchical Contextualized Representation for Named Entity Recognition 1 2 6 Nov 2019 official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
A Unified MRC Framework for Named Entity Recognition 8 1 25 Oct 2019 official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (2 pointer-only for licence)
Dependency-Guided LSTM-CRF for Named Entity Recognition 1 3 23 Sep 2019 not harvested
Why Attention? Analyze BiLSTM Deficiency and Its Remedies in the Case of NER 3 1 29 Aug 2019 not harvested
BERT for Coreference Resolution: Baselines and Analysis 2 2 24 Aug 2019 not harvested
Hierarchically-Refined Label Attention Network for Sequence Labeling 2 1 23 Aug 2019 not harvested
SpanBERT: Improving Pre-training by Representing and Predicting Spans 6 1 24 Jul 2019 official (archive's flag): 2 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (6 pointer-only for licence)
GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognition 1 1 12 Jul 2019 not harvested
Coreference Resolution with Entity Equalization 1 1 1 Jul 2019 not harvested
End-to-end Deep Reinforcement Learning Based Coreference Resolution 0 1 1 Jul 2019 not harvested
Towards Improving Neural Named Entity Recognition with Gazetteers 1 1 1 Jul 2019 not harvested
Learning to Denoise Distantly-Labeled Data for Entity Typing 1 1 4 May 2019 not harvested
Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typing 1 1 6 Mar 2019 not harvested
Dependency or Span, End-to-End Uniform Semantic Role Labeling 1 1 16 Jan 2019 not harvested
A Span Selection Model for Semantic Role Labeling 2 2 4 Oct 2018 not harvested
Learning Word Representations with Cross-Sentence Dependency for End-to-End Co-reference Resolution 1 1 1 Oct 2018 not harvested
Semi-Supervised Sequence Modeling with Cross-View Training 2 1 22 Sep 2018 not harvested
Ultra-Fine Entity Typing 1 1 13 Jul 2018 not harvested
Robust Lexical Features for Improved Neural Network Named-Entity Recognition 1 1 9 Jun 2018 not harvested
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling 1 2 12 May 2018 not harvested
Higher-order Coreference Resolution with Coarse-to-fine Inference 5 2 15 Apr 2018 official (archive's flag): 5 ran · 17 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (3 pointer-only for licence)
Deep contextualized word representations 46 2 15 Feb 2018 30 ran (of which 12 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 0 violated, 22 with no contract checked; 6 where Syntology's instrument failed) · 28 unverified (25 pointer-only for licence)
Deep Semantic Role Labeling with Self-Attention 1 1 5 Dec 2017 not harvested
End-to-end Neural Coreference Resolution 4 1 21 Jul 2017 community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
Deep Semantic Role Labeling: What Works and What's Next 1 1 1 Jul 2017 not harvested
Fast and Accurate Entity Recognition with Iterated Dilated Convolutions 4 2 7 Feb 2017 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
Deep Reinforcement Learning for Mention-Ranking Coreference Models 1 1 27 Sep 2016 official: harvested, nothing ran · 0 ran · 1 unverified (1 pointer-only for licence)
Improving Coreference Resolution by Learning Entity-Level Distributed Representations 1 1 4 Jun 2016 official: harvested, nothing ran · 0 ran · 1 unverified (1 pointer-only for licence)
Learning Global Features for Coreference Resolution 1 1 11 Apr 2016 not harvested
Named Entity Recognition with Bidirectional LSTM-CNNs 14 1 26 Nov 2015 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (4 pointer-only for licence)
A Joint Model for Entity Analysis: Coreference, Typing, and Linking 0 1 1 Jan 2014 not harvested

Dataset loaders archive 2025-07-28

3 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • Ontonotes v5 (English)
  • OntoNotes
  • OntoNotes 5.0

3 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections