Browse State-of-the-Art › Conversational Response Selection
Conversational Response Selection
36 papers with code · 14 benchmarks · 12 datasets archive 2025-07-28
Conversational response selection refers to the task of identifying the most relevant response to a given input sentence from a collection of sentences.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
14 leaderboard tables shown for this task, 14 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 14 until expanded.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
12 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 46 · with a code link: 36 · where Syntology ran a sample: 9 (9 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (9 of 46 tagged: 9 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 46 of 46, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
11 Oct 2018 534 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified (of 659 harvested samples) · 164 pointer-only (licence)We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.
-
15 Feb 2018 46 repositories listed Syntology 30 ran (of which 12 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 0 violated, 22 with no contract checked; 6 where Syntology's instrument failed) · 28 unverified (of 58 harvested samples) · 25 pointer-only (licence)We introduce a new type of deep contextualized word representation that models both (1) complex characteristics of word use (e. g., syntax and semantics), and (2) how these uses vary across linguistic contexts (i. e.…
-
29 Mar 2018 24 repositories listed Syntology 18 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 22 harvested samples) · 1 pointer-only (licence)For both variants, we investigate and report the relationship between model complexity, resource consumption, the availability of transfer task training data, and task performance.
-
The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems30 Jun 2015 21 repositories listed Syntology community repositories only · 15 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified (of 26 harvested samples) · 5 pointer-only (licence)This paper introduces the Ubuntu Dialogue Corpus, a dataset containing almost 1 million multi-turn dialogues, with a total of over 7 million utterances and 100 million words.
-
22 Jan 2018 15 repositories listed Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)Chit-chat models are known to have several problems: they lack specificity, do not display a consistent personality and are often not very captivating.
-
22 Apr 2019 7 repositories listedThe use of deep pre-trained bidirectional transformers has led to remarkable progress in a number of applications (Devlin et al., 2018).
-
9 Nov 2019 5 repositories listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)General-purpose pretrained sentence encoders such as BERT are not ideal for real-world conversational AI applications; they are computationally heavy, slow, and expensive to train.
-
9 Jan 2019 4 repositories listedThe noetic end-to-end response selection challenge as one track in Dialog System Technology Challenges 7 (DSTC7) aims to push the state of the art of utterance classification for real world goal-oriented dialog systems…
-
13 Apr 2019 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Progress in Machine Learning is often driven by the availability of large datasets, and consistent evaluation metrics for comparing modeling approaches.
-
6 Dec 2016 3 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Existing work either concatenates utterances in context or matches a response with a highly abstract context vector finally, which may lose relationships among utterances or important contextual information.
-
15 Sep 2020 2 repositories listed Syntology 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Particularly, our ranker outperforms the conventional dialog perplexity baseline with a large margin on predicting Reddit feedback.
-
7 Apr 2020 2 repositories listedIn this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots.
-
16 Aug 2024 1 repository listedRecent studies have demonstrated significant improvements in selection tasks, and a considerable portion of this success is attributed to incorporating informative negative samples during training.
-
10 Oct 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)Our system can function as a standard open-domain chatbot if persona information is not available.
-
27 Jul 2023 1 repository listedThen, SemSol improves the accuracy of the response by exploiting the semantic information in a knowledge graph in accordance with the dialogue context.
-
7 Jun 2023 1 repository listedDialogue response selection aims to select an appropriate response from several candidates based on a given user and system utterance history.
-
26 May 2022 1 repository listedIn this paper, we introduce Dialogue Sentence Embedding (DSE), a self-supervised contrastive learning method that learns effective dialogue representations suitable for a wide range of dialogue tasks.
-
15 Mar 2022 1 repository listedTo address these problems, we introduce a new task BBAI: Black-Box Agent Integration, focusing on combining the capabilities of multiple black-box CAs at scale.
-
13 Oct 2021 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)In this study, we present a solution to directly select proper responses from a large corpus or even a nonparallel corpus that only consists of unpaired sentences, using a dense retrieval model.
-
17 Aug 2021 1 repository listedTo tackle these challenges, we propose a representation[K]-interaction[L]-matching framework that explores multiple types of deep interactive representations to build context-response matching models for response…
-
3 Jun 2021 1 repository listedRecently, various neural models for multi-party conversation (MPC) have achieved impressive improvements on a variety of tasks such as addressee recognition, speaker identification and response prediction.
-
2 Jun 2021 1 repository listedThe current state-of-the-art ranking methods mainly use an encoding paradigm called Cross-Encoder, which separately encodes each context-candidate pair and ranks the candidates according to their fitness scores.
-
24 May 2021 1 repository listedDuring the multi-turn response selection, BERT focuses on training the relationship between the context with multiple utterances and the response.
-
26 Feb 2021 1 repository listedSearching for new information requires talking to the system.
-
29 Dec 2020 1 repository listedAs for IC, it progressively strengthens the model's ability in identifying the mismatching information between the dialogue context and a response candidate.
-
10 Sep 2020 1 repository listedIn this paper, we study the task of selecting the optimal response given a user and system utterance history in retrieval-based multi-turn dialog systems.
-
16 Nov 2019 1 repository listedThe distances between context and response utterances are employed as a prior component when calculating the attention weights.
-
1 Nov 2019 1 repository listedExisting works mainly focus on matching candidate responses with every context utterance on multiple levels of granularity, which ignore the side effect of using excessive context information.
-
13 Aug 2019 1 repository listedWe focus on multi-turn response selection in a retrieval-based dialog system.
-
1 Jul 2019 1 repository listedCurrently, researchers have paid great attention to retrieval-based dialogues in open-domain.
-
7 Jan 2019 1 repository listed
-
3 Dec 2018 1 repository listed
-
1 Jul 2018 1 repository listed
-
24 Jun 2018 1 repository listed
-
12 Sep 2017 1 repository listed
-
1 Nov 2016 1 repository listed
-
1 Mar 2022 0 repositories listed
-
19 Nov 2021 0 repositories listed
-
14 Sep 2020 0 repositories listed
-
6 Apr 2020 0 repositories listed
-
1 Nov 2019 0 repositories listed
-
24 Sep 2019 0 repositories listed
-
26 Aug 2019 0 repositories listed
-
1 Aug 2019 0 repositories listed
-
1 Nov 2016 0 repositories listed
-
13 Oct 2015 0 repositories listed
Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections