Browse State-of-the-Art › Spoken Dialogue Systems

Spoken Dialogue Systems

26 papers with code · 0 benchmarks · 3 datasets archive 2025-07-28

Speech

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

3 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Papers archive 2025-07-28

archive papers tagged: 254 · with a code link: 26 · where Syntology ran a sample: 4 (3 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (4 of 254 tagged: 3 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 1 of 3: papers 1 to 100 of 254, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.

  • 17 Jan 2020 4 repositories listed
    Plato has been designed to be easy to understand and debug and is agnostic to the underlying learning frameworks that train each component.
  • 1 Jun 2018 2 repositories listed
    Attention-based recurrent neural network models for joint intent detection and slot filling have achieved the state-of-the-art performance, while they have independent attention weights.
  • Natural language generation (NLG) is a critical component of spoken dialogue and it has a significant impact both on usability and perceived quality.
  • 14 May 2025 1 repository listed
    To address this gap, we propose WavReward, a reward feedback model based on audio language models that can evaluate both the IQ and EQ of spoken dialogue systems with speech input.
  • 8 Jan 2025 1 repository listed
    Recent advancements in large language models (LLMs) have led to significant progress in text-based dialogue systems.
  • 20 Dec 2024 1 repository listed
    Recent advancements highlight the potential of end-to-end real-time spoken dialogue systems, showcasing their low latency and high quality.
  • 15 Nov 2024 1 repository listed
    Recent advancements in spoken dialogue models, exemplified by systems like GPT-4o, have captured significant attention in the speech domain.
  • 23 Oct 2024 1 repository listed
    However, achieving low latency and natural interactions in full-duplex dialogue systems remains a significant challenge, especially considering human conversation dynamics such as interruptions, backchannels, and…
  • 13 Aug 2024 1 repository listed
    We propose the construction methodology of SaSLaW and display the analysis result of the corpus.
  • However, current models face two major challenges in response generation latency: (1) generating a spoken response requires the prior generation of a written response, and (2) speech sequences are significantly longer…
  • 20 Sep 2023 1 repository listed
    This paper explores the potential of constructing an AI spoken dialogue system that "thinks how to respond" and "thinks how to speak" simultaneously, which more closely aligns with the human speech production process…
  • 20 Apr 2023 1 repository listed
    Though Dialogue State Tracking (DST) is a core component of spoken dialogue systems, recent work on this task mostly deals with chat corpora, disregarding the discrepancies between spoken and written language.
  • Current spoken dialogue systems initiate their turns after a long period of silence (700-1000ms), which leads to little real-time feedback, sluggish responses, and an overall stilted conversational flow.
  • 28 Apr 2022 1 repository listed
    Knowledge-based authentication is crucial for task-oriented spoken dialogue systems that offer personalised and privacy-focused services.
  • 28 Sep 2021 1 repository listed
    Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets.
  • 3 Feb 2020 1 repository listed
    Spoken dialogue systems typically use a list of top-N ASR hypotheses for inferring the semantic meaning and tracking the state of the dialogue.
  • We present a new neural architecture for wide-coverage Natural Language Understanding in Spoken Dialogue Systems.
  • 28 Mar 2019 1 repository listed
    In this paper, we describe our methodology for creating the query reformulation extension to the dialog corpus, and present an initial set of experiments to establish a baseline for the CQR task.
  • 20 Dec 2018 1 repository listed
    Cross-domain natural language generation (NLG) is still a difficult task within spoken dialogue modelling.
  • 2 Oct 2018 1 repository listed
    This paper summarises the experimental setup and results of the first shared task on end-to-end (E2E) natural language generation (NLG) in spoken dialogue systems.
  • 8 Aug 2018 1 repository listed
    Natural language generation (NLG) is a critical component in spoken dialogue systems.
  • 1 Jun 2018 1 repository listed
    Spoken language understanding (SLU) is an essential component in conversational systems.
  • 31 Mar 2018 1 repository listed
    Recent statistical approaches have improved the robustness and scalability of spoken dialogue systems.
  • 1 Sep 2016 1 repository listed
  • 25 Aug 2016 1 repository listed
    We present a novel natural language generation system for spoken dialogue systems capable of entraining (adapting) to users' way of speaking, providing contextually appropriate responses.
  • 1 Aug 2016 1 repository listed
  • Prompt-Guided Turn-Taking Prediction
    26 Jun 2025 0 repositories listed
    Turn-taking prediction models are essential components in spoken dialogue systems and conversational robots.
  • Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model
    4 Jun 2025 0 repositories listed
    Speech language models (Speech LMs) enable end-to-end speech-text modelling within a single model, offering a promising direction for spoken dialogue systems.
  • Towards a Japanese Full-duplex Spoken Dialogue System
    3 Jun 2025 0 repositories listed
    Full-duplex spoken dialogue systems, which can model simultaneous bidirectional features of human conversations such as speech overlaps and backchannels, have attracted significant attention recently.
  • Chain-of-Thought Training for Open E2E Spoken Dialogue Systems
    31 May 2025 0 repositories listed
    Unlike traditional cascaded pipelines, end-to-end (E2E) spoken dialogue systems preserve full differentiability and capture non-phonemic information, making them well-suited for modeling spoken interactions.
  • Speculative End-Turn Detector for Efficient Speech Chatbot Assistant
    30 Mar 2025 0 repositories listed
  • ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems
    11 Mar 2025 0 repositories listed
  • Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics
    3 Mar 2025 0 repositories listed
  • FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systems
    19 Feb 2025 0 repositories listed
  • LLM-Enhanced Dialogue Management for Full-Duplex Spoken Dialogue Systems
    19 Feb 2025 0 repositories listed
  • Multimodal Transformer Models for Turn-taking Prediction: Effects on Conversational Dynamics of Human-Agent Interaction during Cooperative Gameplay
    5 Feb 2025 0 repositories listed
  • An LLM Benchmark for Addressee Recognition in Multi-modal Multi-party Dialogue
    28 Jan 2025 0 repositories listed
  • OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarios
    2 Jan 2025 0 repositories listed
  • Large Language Models Know What To Say But Not When To Speak
    21 Oct 2024 0 repositories listed
  • Data Augmentation Integrating Dialogue Flow and Style to Adapt Spoken Dialogue Systems to Low-Resource User Groups
    20 Aug 2024 0 repositories listed
  • Evaluation of a semi-autonomous attentive listening system with takeover prompting
    21 Feb 2024 0 repositories listed
  • An Analysis of User Behaviors for Objectively Evaluating Spoken Dialogue Systems
    10 Jan 2024 0 repositories listed
  • An Analysis of Dialogue Repair in Voice Assistants
    7 Nov 2023 0 repositories listed
  • Dialogue Systems Can Generate Appropriate Responses without the Use of Question Marks? -- Investigation of the Effects of Question Marks on Dialogue Systems
    7 Aug 2023 0 repositories listed
  • Unified Conversational Models with System-Initiated Transitions between Chit-Chat and Task-Oriented Dialogues
    4 Jul 2023 0 repositories listed
  • What Types of Questions Require Conversation to Answer? A Case Study of AskReddit Questions
    30 Mar 2023 0 repositories listed
  • Transformers in Speech Processing: A Survey
    21 Mar 2023 0 repositories listed
  • Analysis and Utilization of Entrainment on Acoustic and Emotion Features in User-agent Dialogue
    7 Dec 2022 0 repositories listed
  • A Transformer-Based User Satisfaction Prediction for Proactive Interaction Mechanism in DuerOS
    5 Dec 2022 0 repositories listed
  • Interactivism in Spoken Dialogue Systems
    27 Sep 2022 0 repositories listed
  • Simultaneous Job Interview System Using Multiple Semi-autonomous Agents
    1 Sep 2022 0 repositories listed
  • Symbol and Communicative Grounding through Object Permanence with a Mobile Robot
    1 Sep 2022 0 repositories listed
  • Using Transition Duration to Improve Turn-taking in Conversational Agents
    1 Sep 2022 0 repositories listed
  • Acoustic Modeling for End-to-End Empathetic Dialogue Speech Synthesis Using Linguistic and Prosodic Contexts of Dialogue History
    16 Jun 2022 0 repositories listed
  • Towards Speech-only Opinion-level Sentiment Analysis
    1 Jun 2022 0 repositories listed
  • Understanding How People Rate Their Conversations
    1 Jun 2022 0 repositories listed
  • Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systems
    30 May 2022 0 repositories listed
  • NLU for Game-based Learning in Real: Initial Evaluations
    27 May 2022 0 repositories listed
  • Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue System
    9 May 2022 0 repositories listed
  • Gated Multimodal Fusion with Contrastive Learning for Turn-taking Prediction in Human-robot Dialogue
    18 Apr 2022 0 repositories listed
  • Dialogue Strategy Adaptation to New Action Sets Using Multi-dimensional Modelling
    14 Apr 2022 0 repositories listed
  • A Cross-Domain Approach for Continuous Impression Recognition from Dyadic Audio-Visual-Physio Signals
    25 Mar 2022 0 repositories listed
  • EVI: Multilingual Spoken Dialogue Tasks and Dataset for Knowledge-Based Enrolment, Verification, and Identification
    16 Jan 2022 0 repositories listed
  • TOD-DA: Towards Boosting the Robustness of Task-oriented Dialogue Modeling on Spoken Conversations
    23 Dec 2021 0 repositories listed
  • A Review of Dialogue Systems: From Trained Monkeys to Stochastic Parrots
    2 Nov 2021 0 repositories listed
  • Code-switched inspired losses for spoken dialog representations
    1 Nov 2021 0 repositories listed
  • Discourse-Driven Integrated Dialogue Development Environment for Open-Domain Dialogue Systems
    1 Nov 2021 0 repositories listed
  • Modeling Performance in Open-Domain Dialogue with PARADISE
    21 Oct 2021 0 repositories listed
  • Why Should I Turn Left? Towards Active Explainability for Spoken Dialogue Systems.
    1 Oct 2021 0 repositories listed
  • The State of SLIVAR: What's next for robots, human-robot interaction, and (spoken) dialogue systems?
    24 Aug 2021 0 repositories listed
  • Projection of Turn Completion in Incremental Spoken Dialogue Systems
    1 Jul 2021 0 repositories listed
  • Word-Free Spoken Language Understanding for Mandarin-Chinese
    1 Jul 2021 0 repositories listed
  • End-to-end ASR to jointly predict transcriptions and linguistic annotations
    1 Jun 2021 0 repositories listed
  • Intelligent Conversational Android ERICA Applied to Attentive Listening and Job Interview
    2 May 2021 0 repositories listed
  • Semi-supervised Interactive Intent Labeling
    27 Apr 2021 0 repositories listed
  • Cross-Lingual Pretraining Methods for Spoken Dialog
    17 Mar 2021 0 repositories listed
  • Open-domain Topic Identification of Out-of-domain Utterances using Wikipedia
    26 Jan 2021 0 repositories listed
  • Actor-Double-Critic: Incorporating Model-Based Critic for Task-Oriented Dialogue Systems
    1 Nov 2020 0 repositories listed
  • Ethically Collecting Multi-Modal Spontaneous Conversations with People that have Cognitive Impairments
    30 Sep 2020 0 repositories listed
  • Deep Reinforcement Learning for On-line Dialogue State Tracking
    22 Sep 2020 0 repositories listed
  • It’s About Time: Turn-Entry Timing For Situated Human-Robot Dialogue
    1 Jul 2020 0 repositories listed
  • Retico: An incremental framework for spoken dialogue systems
    1 Jul 2020 0 repositories listed
  • Transfer Learning for British Sign Language Modelling
    3 Jun 2020 0 repositories listed
  • Estimating User Communication Styles for Spoken Dialogue Systems
    1 May 2020 0 repositories listed
  • Improving Interaction Quality Estimation with BiLSTMs and the Impact on Dialogue Policy Learning
    21 Jan 2020 0 repositories listed
  • Talking with Robots: Opportunities and Challenges
    1 Dec 2019 0 repositories listed
  • PyOpenDial: A Python-based Domain-Independent Toolkit for Developing Spoken Dialogue Systems with Probabilistic Rules
    1 Nov 2019 0 repositories listed
  • Current Challenges in Spoken Dialogue Systems and Why They Are Critical for Those Living with Dementia
    14 Sep 2019 0 repositories listed
  • 25 Jul 2019 0 repositories listed
  • Incrementalizing RASA's Open-Source Natural Language Understanding Pipeline
    11 Jul 2019 0 repositories listed
  • Improving Long Distance Slot Carryover in Spoken Dialogue Systems
    4 Jun 2019 0 repositories listed
  • AgentGraph: Towards Universal Dialogue Management with Structured Deep Reinforcement Learning
    27 May 2019 0 repositories listed
  • HUMBO: Bridging Response Generation and Facial Expression Synthesis
    24 May 2019 0 repositories listed
  • Addressing Objects and Their Relations: The Conversational Entity Dialogue Model
    5 Jan 2019 0 repositories listed
  • Scalable language model adaptation for spoken dialogue systems
    11 Dec 2018 0 repositories listed
  • Automation and Optimisation of Humor Trait Generation in a Vocal Dialogue System
    1 Nov 2018 0 repositories listed
  • Learning from limited datasets: Implications for Natural Language Generation and Human-Robot Interaction
    1 Nov 2018 0 repositories listed
  • A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding
    1 Oct 2018 0 repositories listed
  • Adversarial Training for Multi-task and Multi-lingual Joint Modeling of Utterance Intent Classification
    1 Oct 2018 0 repositories listed
  • Adversarial Domain Adaptation for Variational Neural Language Generation in Dialogue Systems
    8 Aug 2018 0 repositories listed

Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections