English
Related papers

Related papers: LD-SDS: Towards an Expressive Spoken Dialogue Syst…

200 papers

In this paper, we propose a novel system that integrates state-of-the-art, domain-specific large language models with advanced information retrieval techniques to deliver comprehensive and context-aware responses. Our approach facilitates…

The greatest challenges in building sophisticated open-domain conversational agents arise directly from the potential for ongoing mixed-initiative multi-turn dialogues, which do not follow a particular plan or pursue a particular fixed…

Computation and Language · Computer Science 2019-08-14 Kevin K. Bowden , Shereen Oraby , Jiaqi Wu , Amita Misra , Marilyn Walker

This study focuses on emotion-sensitive spoken dialogue in human-machine speech interaction. With the advancement of Large Language Models (LLMs), dialogue systems can handle multimodal data, including audio. Recent models have enhanced the…

Sound · Computer Science 2024-07-30 Hongfei Xue , Yuhao Liang , Bingshen Mu , Shiliang Zhang , Mengzhe Chen , Qian Chen , Lei Xie

Building dialogue systems that naturally converse with humans is being an attractive and an active research domain. Multiple systems are being designed everyday and several datasets are being available. For this reason, it is being hard to…

Computation and Language · Computer Science 2019-07-31 Basma El Amel Boussaha , Nicolas Hernandez , Christine Jacquin , Emmanuel Morin

The advances in language-based Artificial Intelligence (AI) technologies applied to build educational applications can present AI for social-good opportunities with a broader positive impact. Across many disciplines, enhancing the quality…

Computation and Language · Computer Science 2022-11-08 Eda Okur , Saurav Sahay , Roddy Fuentes Alba , Lama Nachman

The use of natural language interfaces in the field of human-computer interaction is undergoing intense study through dedicated scientific and industrial research. The latest contributions in the field, including deep learning approaches…

Computation and Language · Computer Science 2024-02-07 Quim Motger , Xavier Franch , Jordi Marco

Data discovery in data lakes with ever increasing datasets has long been recognized as a big challenge in the realm of data management, especially for semantic search of and hierarchical global catalog generation of tables. While large…

Databases · Computer Science 2025-02-24 Qi An , Chihua Ying , Yuqing Zhu , Yihao Xu , Manwei Zhang , Jianmin Wang

The blocks world is a classic toy domain that has long been used to build and test spatial reasoning systems. Despite its relative simplicity, tackling this domain in its full complexity requires the agent to exhibit a rich set of…

Artificial Intelligence · Computer Science 2019-11-07 Georgiy Platonov , Benjamin Kane , Aaron Gindi , Lenhart K. Schubert

Software Development (SD) is remarkably dynamic and is critically dependent on the knowledge acquired by the project's software developers as the project progresses. Software developers need to understand large amounts of information…

Software Engineering · Computer Science 2023-05-02 Glaucia Melo , Luis Fernando Lins , Paulo Alencar , Donald Cowan

Spoken dialogue generation is crucial for applications like podcasts, dynamic commentary, and entertainment content, but poses significant challenges compared to single-utterance text-to-speech (TTS). Key requirements include accurate…

This work investigates the embeddings for representing dialog history in spoken language understanding (SLU) systems. We focus on the scenario when the semantic information is extracted directly from the speech signal by means of a single…

Computation and Language · Computer Science 2020-05-04 Natalia Tomashenko , Christian Raymond , Antoine Caubriere , Renato De Mori , Yannick Esteve

Large language models (LLMs) can reshape information processing by handling data analysis, visualization, and interpretation in an interactive, context-aware dialogue with users, including voice interaction, while maintaining high…

Artificial Intelligence · Computer Science 2025-11-25 Mohammad Nour Al Awad , Sergey Ivanov , Olga Tikhonova , Ivan Khodnenko

Spoken Language Understanding (SLU) is one essential step in building a dialogue system. Due to the expensive cost of obtaining the labeled data, SLU suffers from the data scarcity problem. Therefore, in this paper, we focus on data…

Computation and Language · Computer Science 2021-09-03 Haitao Lin , Lu Xiang , Yu Zhou , Jiajun Zhang , Chengqing Zong

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

As task-oriented dialog systems are becoming increasingly popular in our lives, more realistic tasks have been proposed and explored. However, new practical challenges arise. For instance, current dialog systems cannot effectively handle…

Computation and Language · Computer Science 2021-12-16 Kun Qian , Ahmad Beirami , Satwik Kottur , Shahin Shayandeh , Paul Crook , Alborz Geramifard , Zhou Yu , Chinnadhurai Sankar

High-quality datasets are typically required for accomplishing data-driven tasks, such as training medical diagnosis models, predicting real-time traffic conditions, or conducting experiments to validate research hypotheses. Consequently,…

Information Retrieval · Computer Science 2025-09-03 Pengyue Li , Sheng Wang , Hua Dai , Zhiyu Chen , Zhifeng Bao , Brian D. Davison

We describe a system for building task-oriented dialogue systems combining the in-context learning abilities of large language models (LLMs) with the deterministic execution of business logic. LLMs are used to translate between the surface…

Computation and Language · Computer Science 2024-02-20 Tom Bocklisch , Thomas Werkmeister , Daksh Varshneya , Alan Nichol

Spoken Dialogue Models (SDMs) have recently attracted significant attention for their ability to generate voice responses directly to users' spoken queries. Despite their increasing popularity, there exists a gap in research focused on…

Computation and Language · Computer Science 2025-10-07 Chengqian Ma , Wei Tao , Yiwen Guo

This paper proposes to refer to the field of software engineering related to the life cycle of dialogue systems as Dialogue Systems Engineering, and surveys this field while also discussing its future directions. With the advancement of…

Software Engineering · Computer Science 2025-08-05 Mikio Nakano , Hironori Takeuchi , Sadahiro Yoshikawa , Yoichi Matsuyama , Kazunori Komatani

Statistical spoken dialogue systems usually rely on a single- or multi-domain dialogue model that is restricted in its capabilities of modelling complex dialogue structures, e.g., relations. In this work, we propose a novel dialogue model…

Computation and Language · Computer Science 2019-01-09 Stefan Ultes , Paweł\ Budzianowski , Iñigo Casanueva , Lina Rojas-Barahona , Bo-Hsiang Tseng , Yen-Chen Wu , Steve Young , Milica Gašić