Browse State-of-the-Art › Machine Reading Comprehension
Machine Reading Comprehension
206 papers with code · 4 benchmarks · 43 datasets archive 2025-07-28
Machine Reading Comprehension is one of the key problems in Natural Language Understanding, where the task is to read and comprehend a given text passage, and then answer questions based on it.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| DREAM (3 rows) | ASA + RoBERTa | Adversarial Self-Attention for Language Understanding | code | — | Compare |
| ReClor (3 rows) | XLNet-large | ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning | code | Syntology official: harvested, nothing ran · 0 ran · 2 unverified | Compare |
| UQuAD (2 rows) | BERT | UQuAD1.0: Development of an Urdu Question Answering Training Data... | — | — | Compare |
| BIOMRC (1 row) | MLP-based-weighting (on BIOMRC Lite) | Contextual embedding and model weighting by fusing domain... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
43 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 43 until expanded.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 555 · with a code link: 206 · where Syntology ran a sample: 33 (26 with a run with no instrument failure, 7 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (33 of 555 tagged: 26 with a run with no instrument failure, 7 where every run was a failure of Syntology's instrument)
Page 1 of 6: papers 1 to 100 of 555, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
28 Nov 2016 14 repositories listed Syntology 28 ran (of which 0 constructed an object rather than computing a result; 23 with no instrument failure: 0 honoured, 0 violated, 23 with no contract checked; 5 where Syntology's instrument failed) · 5 unverified (of 33 harvested samples)The size of the dataset and the fact that the questions are derived from real user search queries distinguishes MS MARCO from other well-known publicly available datasets for machine reading comprehension and…
-
25 Oct 2019 8 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 2 pointer-only (licence)Instead of treating the task of NER as a sequence labeling problem, we propose to formulate it as a machine reading comprehension (MRC) task.
-
10 Dec 2018 6 repositories listedConversational question answering (CQA) is a novel QA task that requires understanding of dialogue context.
-
10 Dec 2017 6 repositories listedWe propose a simple yet robust stochastic answer network (SAN) that simulates multi-step reasoning in machine reading comprehension.
-
24 Sep 2018 5 repositories listedThis paper presents an extension of the Stochastic Answer Network (SAN), one of the state-of-the-art machine reading comprehension models, to be able to judge whether a question is unanswerable or not.
-
18 Sep 2018 5 repositories listedWe propose a multi-task learning framework to learn a joint Machine Reading Comprehension (MRC) model that can be applied to a wide range of MRC tasks in different domains.
-
20 May 2021 4 repositories listedWe introduce Korean Language Understanding Evaluation (KLUE) benchmark.
-
7 Nov 2019 4 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Many NLP tasks such as tagging and machine reading comprehension are faced with the severe data imbalance issue: negative examples significantly outnumber positive examples, and the huge number of background examples…
-
30 Jun 2021 3 repositories listedRecent pretraining models in Chinese neglect two important aspects specific to the Chinese language: glyph and pinyin, which carry significant syntax and semantic information for language understanding.
-
23 Apr 2020 3 repositories listedMachine reading comprehension (MRC) is a crucial task in natural language processing and has achieved remarkable advancements.
-
13 Apr 2020 3 repositories listedThe advent of natural language understanding (NLU) benchmarks for English, such as GLUE and SuperGLUE allows new NLU models to be evaluated across a diverse set of tasks.
-
26 Jan 2020 3 repositories listedMulti-choice Machine Reading Comprehension (MRC) requires model to decide the correct answer from a set of answer options when given a passage and a question.
-
14 Nov 2017 3 repositories listedExperiments show that human performance is well above current state-of-the-art baseline systems, leaving plenty of room for the community to make improvements.
-
8 May 2017 3 repositories listedIn this paper, we introduce the Reinforced Mnemonic Reader for machine reading comprehension tasks, which enhances previous attentive readers in two aspects.
-
31 Aug 2023 2 repositories listed Syntology official: harvested, nothing ran · 0 ran · 6 unverified (of 6 harvested samples) · 6 pointer-only (licence)We use this dataset to evaluate the capabilities of multilingual masked language models (MLMs) and large language models (LLMs).
-
19 Dec 2022 2 repositories listedMulti-Hop Question Answering (MHQA) is a significant area in question answering, requiring multiple reasoning components, including document retrieval, supporting sentence prediction, and answer span extraction.
-
18 Nov 2022 2 repositories listedWe introduce GENIUS: a conditional text generation model using sketches as input, which can fill in the missing contexts for a given sketch (key information consisting of textual spans, phrases, or words, concatenated…
-
21 May 2021 2 repositories listedRecent years have witnessed an increasing interest in training machines with reasoning ability, which deeply relies on accurately and clearly presented clue forms.
-
17 May 2021 2 repositories listedThe proposed method has the following merits: (1) it addresses the fundamental problem that edges in a dependency tree should be constructed between subtrees; (2) the MRC framework allows the method to retrieve missing…
-
13 Mar 2021 2 repositories listedAspect sentiment triplet extraction (ASTE), which aims to identify aspects from review sentences along with their corresponding opinion expressions and sentiments, is an emerging task in fine-grained opinion mining.
-
30 Dec 2020 2 repositories listedWhile pre-trained language models (PTLMs) have achieved noticeable success on many NLP tasks, they still struggle for tasks that require event temporal reasoning, which is essential for event-centric applications.
-
16 Jul 2020 2 repositories listedMachine reading is a fundamental task for testing the capability of natural language understanding, which is closely related to human cognition in many aspects.
-
2 May 2020 2 repositories listed Syntology official (archive's flag): 9 ran · 10 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 4 honoured, 1 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 10 pointer-only (licence)Advances in machine reading comprehension (MRC) rely heavily on the collection of large scale human-annotated examples in the form of (question, paragraph, answer) triples.
-
27 Jan 2020 2 repositories listed Syntology official (archive's flag): 6 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 2 pointer-only (licence)In this paper, we propose Answer-Clue-Style-aware Question Generation (ACS-QG), which aims at automatically generating high-quality and diverse question-answer pairs from unlabeled text corpus at scale by imitating the…
-
27 Jan 2020 2 repositories listedInspired by how humans solve reading comprehension questions, we proposed a retrospective reader (Retro-Reader) that integrates two stages of reading and verification strategies: 1) sketchy reading that briefly…
-
15 Oct 2019 2 repositories listedNumerical reasoning, such as addition, subtraction, sorting and counting is a critical skill in human's reading comprehension, which has not been well considered in existing machine reading comprehension (MRC) systems.
-
1 Oct 2019 2 repositories listedMachine Reading Comprehension (MRC) for question answering (QA), which aims to answer a question given the relevant context passages, is an important way to test the ability of intelligence systems to understand human…
-
19 Jun 2019 2 repositories listedTo demonstrate the effectiveness of these models, we create a series of Chinese pre-trained language models as our baselines, including BERT, RoBERTa, ELECTRA, RBT, etc.
-
4 Mar 2016 2 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 10 harvested samples) · 1 pointer-only (licence)Several large cloze-style context-question-answer datasets have been introduced recently: the CNN and Daily Mail news data and the Children's Book Test.
-
10 Mar 2025 1 repository listedExisting MRC datasets primarily assess specific aspects of reading comprehension (RC), lacking a comprehensive MRC benchmark.
-
17 Feb 2025 1 repository listed
-
28 Oct 2024 1 repository listed
-
5 Aug 2024 1 repository listed
-
17 Jul 2024 1 repository listed
-
26 Apr 2024 1 repository listed
-
8 Apr 2024 1 repository listed
-
26 Mar 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
26 Mar 2024 1 repository listed
-
24 Mar 2024 1 repository listed
-
VlogQA: Task, Dataset, and Baseline Models for Vietnamese Spoken-Based Machine Reading Comprehension5 Feb 2024 1 repository listed
-
15 Jan 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
20 Nov 2023 1 repository listed
-
9 Nov 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
27 Oct 2023 1 repository listed
-
24 Oct 2023 1 repository listed
-
20 Oct 2023 1 repository listed
-
17 Oct 2023 1 repository listed
-
20 Sep 2023 1 repository listed
-
12 Aug 2023 1 repository listed
-
8 Aug 2023 1 repository listed
-
18 Jul 2023 1 repository listed
-
27 Jun 2023 1 repository listed
-
25 Jun 2023 1 repository listed
-
21 Jun 2023 1 repository listed
-
21 Jun 2023 1 repository listed
-
15 Jun 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
7 Jun 2023 1 repository listed
-
1 Jun 2023 1 repository listed
-
24 May 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
23 May 2023 1 repository listed
-
15 May 2023 1 repository listed
-
6 May 2023 1 repository listed
-
5 May 2023 1 repository listed
-
3 May 2023 1 repository listed
-
3 Apr 2023 1 repository listed
-
31 Mar 2023 1 repository listed
-
20 Mar 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
27 Feb 2023 1 repository listed
-
26 Feb 2023 1 repository listed
-
17 Feb 2023 1 repository listed
-
9 Dec 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
25 Oct 2022 1 repository listed
-
21 Oct 2022 1 repository listed
-
14 Oct 2022 1 repository listed
-
1 Oct 2022 1 repository listed
-
23 Sep 2022 1 repository listed
-
16 Sep 2022 1 repository listed
-
30 Aug 2022 1 repository listed
-
4 Aug 2022 1 repository listed
-
13 Jul 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
Contextual embedding and model weighting by fusing domain knowledge on Biomedical Question Answering26 Jun 2022 1 repository listed
-
25 Jun 2022 1 repository listed
-
1 Jun 2022 1 repository listed
-
31 May 2022 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
12 May 2022 1 repository listed
-
6 May 2022 1 repository listed
-
2 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
13 Apr 2022 1 repository listed
-
10 Apr 2022 1 repository listed
-
3 Apr 2022 1 repository listed
-
26 Mar 2022 1 repository listed
-
16 Mar 2022 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
-
26 Feb 2022 1 repository listed
-
26 Feb 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
Syntology lines on 17 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections