Browse State-of-the-Art › Relation Extraction
Relation Extraction
735 papers with code · 50 benchmarks · 82 datasets archive 2025-07-28
Relation Extraction is the task of predicting attributes and relations for entities in a sentence. For example, given a sentence “Barack Obama was born in Honolulu, Hawaii.”, a relation classifier aims at predicting the relation of “bornInCity”. Relation Extraction is the key component for building relation knowledge graphs, and it is of crucial significance to natural language processing applications such as structured search, sentiment analysis, question answering, and summarization.
Source: Deep Residual Learning for Weakly-Supervised Relation Extraction
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
51 leaderboard tables shown for this task, 50 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 51 until expanded.
Syntology 5 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): DocRED (2 judged, 0 placed), SemEval-2010 Task-8 (1 judged, 0 placed), FUNSD (1 judged, 0 placed), ReDocRED (1 judged, 0 placed), SciERC (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
82 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 82 until expanded.
Subtasks archive 2025-07-28
15 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 1,977 · with a code link: 735 · where Syntology ran a sample: 111 (93 with a run with no instrument failure, 18 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (111 of 1,977 tagged: 93 with a run with no instrument failure, 18 where every run was a failure of Syntology's instrument)
Page 1 of 20: papers 1 to 100 of 1,977, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
31 Dec 2019 19 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)In this paper, we propose the LayoutLM to jointly model interactions between text and layout information across scanned document images, which is beneficial for a great number of real-world document image understanding…
-
25 Jan 2019 19 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 15 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified (of 25 harvested samples) · 3 pointer-only (licence)Biomedical text mining is becoming increasingly important as the number of biomedical documents rapidly grows.
-
7 Jun 2019 13 repositories listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 14 harvested samples) · 1 pointer-only (licence)General purpose relation extractors, which can model arbitrary relations, are a core aspiration in information extraction.
-
26 May 2022 10 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 13 ran (of which 4 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 19 harvested samples) · 13 pointer-only (licence)Recently, there has been a surge of Transformer-based solutions for the long-term time series forecasting (LTSF) task.
-
29 Dec 2020 9 repositories listedPre-training of text and layout has proved effective in a variety of visually-rich document understanding tasks due to its effective model architecture and the advantage of large-scale unlabeled scanned/digital-born…
-
2 Oct 2020 9 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 10 harvested samples)In this paper, we propose new pretrained contextualized representations of words and entities based on the bidirectional transformer.
-
19 Feb 2019 7 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 2 pointer-only (licence)Graph Convolutional Networks (GCNs) and their variants have experienced significant attention and have become the de facto methods for learning graph representations.
-
24 Jul 2019 6 repositories listed Syntology official (archive's flag): 2 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 15 harvested samples) · 6 pointer-only (licence)We present SpanBERT, a pre-training method that is designed to better represent and predict spans of text.
-
20 May 2019 6 repositories listed Syntology 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)In this paper, we propose a model that both leverages the pre-trained BERT language model and incorporates information from the target entities to tackle the relation classification task.
-
26 Mar 2019 6 repositories listedObtaining large-scale annotated data for NLP tasks in the scientific domain is challenging and expensive.
-
20 Jun 2018 6 repositories listed Syntology official (archive's flag): 9 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples) · 4 pointer-only (licence)Though designed for decaNLP, MQAN also achieves state of the art results on the WikiSQL semantic parsing task in the single-task setting.
-
20 Apr 2018 6 repositories listedState-of-the-art models for joint entity recognition and relation extraction strongly rely on external natural language processing (NLP) tools such as POS (part-of-speech) taggers and dependency parsers.
-
29 Oct 2020 5 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining.
-
16 Mar 2020 5 repositories listed Syntology community repositories only · 16 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 6 where Syntology's instrument failed) · 14 unverified (of 30 harvested samples) · 28 pointer-only (licence)We introduce Stanza, an open-source Python natural language processing toolkit supporting 66 human languages.
-
7 Sep 2019 5 repositories listedExtracting relational triples from unstructured text is crucial for large-scale knowledge graph construction.
-
19 Apr 2018 5 repositories listedRelation extraction is the problem of classifying the relationship between two entities in a given sentence.
-
19 Oct 2022 4 repositories listedPre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain.
-
18 Apr 2022 4 repositories listedIn this paper, we propose LayoutLMv3 to pre-train multimodal Transformers for Document AI with unified text and image masking.
-
10 Feb 2022 4 repositories listed Syntology official (archive's flag): 1 ran · 4 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 11 unverified (of 15 harvested samples)To test our hypothesis that these computations correspond to factual association recall, we modify feed-forward weights to update specific factual associations using Rank-One Model Editing (ROME).
-
20 May 2021 4 repositories listedWe introduce Korean Language Understanding Evaluation (KLUE) benchmark.
-
8 Sep 2019 4 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)We examine the capabilities of a unified, multi-task framework for three information extraction tasks: named entity recognition, relation extraction, and event extraction.
-
14 Jun 2019 4 repositories listedMultiple entities in a document generally exhibit complex inter-sentence relations, and cannot be well handled by existing relation extraction (RE) methods that typically focus on extracting intra-sentence relations for…
-
13 Jun 2019 4 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
25 May 2022 3 repositories listedWe analyze the causes and effects of the overwhelming false negative problem in the DocRED dataset.
-
20 Feb 2021 3 repositories listedOur experiments demonstrate the usefulness of the proposed entity structure and the effectiveness of SSAN.
-
22 Sep 2020 3 repositories listedDespite efforts to distinguish three different evaluation setups (Bekoulis et al., 2018), numerous end-to-end Relation Extraction (RE) articles present unreliable performance comparison to previous work.
-
17 Apr 2020 3 repositories listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 5 pointer-only (licence)We present the first human-annotated dialogue-based relation extraction (RE) dataset DialogRE, aiming to support the prediction of relation(s) between two arguments that appear in a dialogue.
-
10 Nov 2019 3 repositories listedNatural language processing covers a wide variety of tasks predicting syntax, semantics, and information content, and usually each type of output is generated with specially designed architectures.
-
17 Sep 2019 3 repositories listedThe model is trained using strong within-sentence negative samples, which are efficiently extracted in a single BERT pass.
-
10 Apr 2019 3 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)We present simple BERT-based models for relation extraction and semantic role labeling.
-
5 Apr 2019 3 repositories listed
-
23 Jan 2019 3 repositories listed
-
30 Oct 2017 3 repositories listed
-
27 Oct 2016 3 repositories listed
-
1 Apr 2025 2 repositories listed
-
31 Jul 2024 2 repositories listed
-
27 May 2024 2 repositories listed
-
17 May 2024 2 repositories listed
-
21 Mar 2024 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
13 Dec 2023 2 repositories listed
-
10 Nov 2023 2 repositories listed
-
17 Oct 2023 2 repositories listed
-
2 May 2023 2 repositories listed
-
14 Nov 2022 2 repositories listed
-
29 Oct 2022 2 repositories listed
-
19 Oct 2022 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 5 unverified (of 13 harvested samples) · 2 pointer-only (licence)
-
12 Oct 2022 2 repositories listed
-
29 May 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
4 May 2022 2 repositories listed
-
13 Apr 2022 2 repositories listed
-
3 Apr 2022 2 repositories listed
-
17 Mar 2022 2 repositories listed Syntology official (archive's flag): 4 ran · 15 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 4 honoured, 0 violated, 3 with no contract checked; 8 where Syntology's instrument failed) · 11 unverified (of 26 harvested samples) · 16 pointer-only (licence)
-
26 Oct 2021 2 repositories listed
-
7 Oct 2021 2 repositories listed
-
17 Sep 2021 2 repositories listed
-
13 Sep 2021 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
10 Aug 2021 2 repositories listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples)
-
7 Jun 2021 2 repositories listed
-
3 Jun 2021 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 6 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
-
19 Apr 2021 2 repositories listed
-
25 Jan 2021 2 repositories listed
-
14 Jan 2021 2 repositories listed
-
6 Jan 2021 2 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
30 Dec 2020 2 repositories listed
-
16 Dec 2020 2 repositories listed
-
24 Oct 2020 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
24 Oct 2020 2 repositories listed
-
20 Oct 2020 2 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 4 pointer-only (licence)
-
8 Oct 2020 2 repositories listed
-
8 Oct 2020 2 repositories listed Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
29 Sep 2020 2 repositories listed
-
26 Sep 2020 2 repositories listed Syntology official (archive's flag): 3 ran · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 4 pointer-only (licence)
-
31 Jul 2020 2 repositories listed
-
13 May 2020 2 repositories listed Syntology official (archive's flag): 4 ran · 5 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 6 pointer-only (licence)
-
5 May 2020 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
17 Apr 2020 2 repositories listed
-
15 Apr 2020 2 repositories listed
-
5 Feb 2020 2 repositories listed Syntology 11 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 2 pointer-only (licence)
-
24 Nov 2019 2 repositories listed
-
10 Nov 2019 2 repositories listed
-
8 Nov 2019 2 repositories listed
-
1 Oct 2019 2 repositories listed
-
5 Sep 2019 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)
-
26 Jun 2019 2 repositories listed
-
18 Jun 2019 2 repositories listed Syntology official (archive's flag): 12 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples) · 1 pointer-only (licence)
-
18 Jun 2019 2 repositories listed
-
17 May 2019 2 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
6 Mar 2019 2 repositories listed
-
28 Dec 2018 2 repositories listed
-
9 Nov 2018 2 repositories listed
-
21 Sep 2018 2 repositories listed
-
28 Aug 2018 2 repositories listed
-
10 May 2018 2 repositories listed
-
18 Apr 2018 2 repositories listed
-
19 Nov 2017 2 repositories listed
-
1 Sep 2017 2 repositories listed
-
13 Jun 2017 2 repositories listed
-
7 Jun 2017 2 repositories listed
-
19 Apr 2017 2 repositories listed
Syntology lines on 35 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections