Browse State-of-the-Art › Generative Question Answering
Generative Question Answering
12 papers with code · 2 benchmarks · 6 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 1 newer paper was judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): CoQA (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| CICERO (4 rows) | T5-large pre-trained on GLUCOSE | CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues | code | — | Compare |
| CoQA (3 rows) | ERNIE-GEN | ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
6 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 45 · with a code link: 12 · where Syntology ran a sample: 2 (1 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2 of 45 tagged: 1 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 45 of 45, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
8 May 2019 9 repositories listedThis paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned for both natural language understanding and generation tasks.
-
26 Jan 2020 5 repositories listedCurrent pre-training works in natural language generation pay little attention to the problem of exposure bias on downstream tasks.
-
21 Aug 2018 4 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Humans gather information by engaging in conversations involving a series of interconnected questions and answers.
-
6 Sep 2021 2 repositories listedDespite the successes of pretrained language models, there are still few high-quality, general-purpose QA systems that are freely available.
-
14 Apr 2020 2 repositories listedAn extensive set of experiments show that PALM achieves new state-of-the-art results on a variety of language generation benchmarks covering generative question answering (Rank 1 on the official MARCO leaderboard)…
-
30 May 2024 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 9 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 7 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)Reducing the `hallucination' problem of Large Language Models (LLMs) is crucial for their wide applications.
-
27 Mar 2024 1 repository listedWe propose a pipeline to extract information from free-text radiology reports, that fits with the items of the reference SR registry proposed by a national society of interventional and medical radiology, focusing on CT…
-
9 Feb 2024 1 repository listedIn this paper, we present the current progress of the project Verif. ai, an open-source scientific generative question-answering system with referenced and verified answers.
-
20 Sep 2023 1 repository listedIn recent years, significant advancements in pre-trained language models have driven the creation of numerous non-English language variants, with a particular emphasis on encoder-only and decoder-only architectures.
-
14 Nov 2022 1 repository listedWe propose a retrieval-augmented generative QA model (R-GQA) for event argument extraction.
-
1 May 2020 1 repository listedTo evaluate our metric, we create high-quality human judgments of correctness on two GenQA datasets.
-
4 Dec 2015 1 repository listedEmpirical study shows the proposed model can effectively deal with the variations of questions and answers, and generate right and natural answers by referring to the facts in the knowledge-base.
-
Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs18 Feb 2025 0 repositories listedPrevious approaches to persona simulation large language models (LLMs) have typically relied on learning basic biographical information, or using limited role-play dialogue datasets to capture a character's responses.
-
EvidenceMap: Learning Evidence Analysis to Unleash the Power of Small Language Models for Biomedical Question Answering22 Jan 2025 0 repositories listedWhen addressing professional questions in the biomedical domain, humans typically acquire multiple pieces of information as evidence and engage in multifaceted evidence analysis to provide high-quality answers.
-
Evidence-Enhanced Triplet Generation Framework for Hallucination Alleviation in Generative Question Answering27 Aug 2024 0 repositories listedTo address the hallucination in generative question answering (GQA) where the answer can not be derived from the document, we propose a novel evidence-enhanced triplet generation framework, EATQA, encouraging the model…
-
Towards a Generative Approach for Emotion Detection and Reasoning9 Aug 2024 0 repositories listedLarge language models (LLMs) have demonstrated impressive performance in mathematical and commonsense reasoning tasks using chain-of-thought (CoT) prompting techniques.
-
ChatSOS: Vector Database Augmented Generative Question Answering Assistant in Safety Engineering8 May 2024 0 repositories listedWith the rapid advancement of natural language processing technologies, generative artificial intelligence techniques, represented by large language models (LLMs), are gaining increasing prominence and demonstrating…
-
Mitigating LLM Hallucinations via Conformal Abstention4 Apr 2024 0 repositories listedWe develop a principled procedure for determining when a large language model (LLM) should abstain from responding (e.g., by saying "I don't know") in a general domain, instead of resorting to possibly "hallucinating" a…
-
26 Feb 2024 0 repositories listedTemporal knowledge graph question answering (TKGQA) poses a significant challenge task, due to the temporal constraints hidden in questions and the answers sought from dynamic structured knowledge.
-
Does the Generator Mind its Contexts? An Analysis of Generative Model Faithfulness under Context Transfer22 Feb 2024 0 repositories listedThe present study introduces the knowledge-augmented generator, which is specifically designed to produce information that remains grounded in contextual knowledge, regardless of alterations in the context.
-
A Search for Prompts: Generating Structured Answers from Contracts16 Oct 2023 0 repositories listedIn many legal processes being able to action on the concrete implication of a legal question can be valuable to automating human review or signalling certain conditions (e.g., alerts around automatic renewal).
-
Training Generative Question-Answering on Synthetic Data Obtained from an Instruct-tuned Model12 Oct 2023 0 repositories listedThis paper presents a simple and cost-effective method for synthesizing data to train question-answering systems.
-
Retrieving Supporting Evidence for Generative Question Answering20 Sep 2023 0 repositories listedCurrent large language models (LLMs) can exhibit near-human levels of performance on many natural language-based tasks, including open-domain question answering.
-
Benchmarks for Pirá 2.0, a Reading Comprehension Dataset about the Ocean, the Brazilian Coast, and Climate Change19 Sep 2023 0 repositories listedPirá is a reading comprehension dataset focused on the ocean, the Brazilian coast, and climate change, built from a collection of scientific abstracts and reports on these topics.
-
Prompt Generate Train (PGT): Few-shot Domain Adaption of Retrieval Augmented Generation Models for Open Book Question-Answering12 Jul 2023 0 repositories listedWe propose a framework - Prompt, Generate, Train (PGT) - to efficiently develop a generative question-answering model for open-book question-answering over a proprietary collection of text documents.
-
Evaluation of medium-large Language Models at zero-shot closed book generative question answering19 May 2023 0 repositories listedLarge language models (LLMs) have garnered significant attention, but the definition of "large" lacks clarity.
-
Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering9 Oct 2022 0 repositories listedGenerative question answering (QA) models generate answers to questions either solely based on the parameters of the model (the closed-book setting) or additionally retrieving relevant evidence (the open-book setting).
-
HIT&QMUL at SemEval-2022 Task 9: Label-Enclosed Generative Question Answering (LEG-QA)1 Jul 2022 0 repositories listedThis paper presents the second place system for the R2VQ: competence-based multimodal question answering shared task.
-
Few-shot Question Generation for Personalized Feedback in Intelligent Tutoring Systems8 Jun 2022 0 repositories listedExisting work on generating hints in Intelligent Tutoring Systems (ITS) focuses mostly on manual and non-personalized feedback.
-
Modeling Multi-hop Question Answering as Single Sequence Prediction18 May 2022 0 repositories listedFusion-in-decoder (Fid) (Izacard and Grave, 2020) is a generative question answering (QA) model that leverages passage retrieval with a pre-trained transformer and pushed the state of the art on single-hop QA.
-
Towards Answering Open-ended Ethical Quandary Questions12 May 2022 0 repositories listed
-
A Theoretically Grounded Benchmark for Evaluating Machine Commonsense23 Mar 2022 0 repositories listed
-
Survey of Hallucination in Natural Language Generation8 Feb 2022 0 repositories listed
-
A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering14 Jan 2022 0 repositories listed
-
1 Jan 2022 0 repositories listed
-
Automated Story Generation as Question-Answering7 Dec 2021 0 repositories listed
-
Modeling Multi-hop Question Answering as Single Sequence Prediction16 Nov 2021 0 repositories listed
-
Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation14 Oct 2021 0 repositories listed
-
Addressing Semantic Drift in Generative Question Answering with Auxiliary Extraction1 Aug 2021 0 repositories listed
-
Zero-shot Generalization in Dialog State Tracking through Generative Question Answering20 Jan 2021 0 repositories listed
-
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation1 Nov 2020 0 repositories listed
-
Incorporating External Knowledge into Machine Reading for Generative Question Answering6 Sep 2019 0 repositories listed
-
Generative Question Answering: Learning to Answer the Whole Question1 May 2019 0 repositories listed
-
A Generative Approach to Question Answering16 Nov 2017 0 repositories listed
-
Flexible End-to-End Dialogue System for Knowledge Grounded Conversation13 Sep 2017 0 repositories listed
Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections