English
Related papers

Related papers: Exploring the Viability of Synthetic Audio Data fo…

200 papers

Recent efforts in Spoken Dialogue Modeling aim to synthesize spoken dialogue without the need for direct transcription, thereby preserving the wealth of non-textual information inherent in speech. However, this approach faces a challenge…

Computation and Language · Computer Science 2024-07-03 Yu-Kuan Fu , Cheng-Kuang Lee , Hsiu-Hsuan Wang , Hung-yi Lee

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on previously learnt services. Motivated by the insight that…

Computation and Language · Computer Science 2025-09-30 Hyundong Cho , Andrea Madotto , Zhaojiang Lin , Khyathi Raghavi Chandu , Satwik Kottur , Jing Xu , Jonathan May , Chinnadhurai Sankar

Recent advances in foundation models have enabled audio-generative models that produce high-fidelity sounds associated with music, events, and human actions. Despite the success achieved in modern audio-generative models, the conventional…

Sound · Computer Science 2024-08-30 Tiantian Feng , Dimitrios Dimitriadis , Shrikanth Narayanan

End-to-end spoken dialogue state tracking (DST) is made difficult by the tandem of having to handle speech input and data scarcity. Combining speech foundation encoders and large language models has been proposed in recent work as to…

Computation and Language · Computer Science 2025-12-01 Katia Vendrame , Bolaji Yusuf , Santosh Kesiraju , Šimon Sedláček , Oldřich Plchot , Jan Černocký

Dialogue State Tracking (DST) is designed to monitor the evolving dialogue state in the conversations and plays a pivotal role in developing task-oriented dialogue systems. However, obtaining the annotated data for the DST task is usually a…

Computation and Language · Computer Science 2024-05-24 Cheng Niu , Xingguang Wang , Xuxin Cheng , Juntong Song , Tong Zhang

In-context learning with Large Language Models (LLMs) has emerged as a promising avenue of research in Dialog State Tracking (DST). However, the best-performing in-context learning methods involve retrieving and adding similar examples to…

Computation and Language · Computer Science 2024-02-06 Atharva Kulkarni , Bo-Hsiang Tseng , Joel Ruben Antony Moniz , Dhivya Piraviperumal , Hong Yu , Shruti Bhargava

This paper introduces a novel approach to Dialogue State Tracking (DST) that leverages Large Language Models (LLMs) to generate natural language descriptions of dialogue states, moving beyond traditional slot-value representations.…

Computation and Language · Computer Science 2025-03-13 Rafael Carranza , Mateo Alejandro Rojas

Dialogue State Tracking (DST) is core research in dialogue systems and has received much attention. In addition, it is necessary to define a new problem that can deal with dialogue between users as a step toward the conversational AI that…

Computation and Language · Computer Science 2023-01-19 Hyungtak Choi , Hyeonmok Ko , Gurpreet Kaur , Lohith Ravuru , Kiranmayi Gandikota , Manisha Jhawar , Simma Dharani , Pranamya Patil

Synthetic data sets are used across linguistic domains and NLP tasks, particularly in scenarios where authentic data is limited (or even non-existent). One such domain is that of clinical (healthcare) contexts, where there exist significant…

Computation and Language · Computer Science 2026-03-17 Steven Bedrick , A. Seza Doğruöz , Sergiu Nisioi

While communicating with a user, a task-oriented dialogue system has to track the user's needs at each turn according to the conversation history. This process called dialogue state tracking (DST) is crucial because it directly informs the…

Computation and Language · Computer Science 2022-08-01 Léo Jacqmin , Lina M. Rojas-Barahona , Benoit Favre

A dialog state tracker is an important component in modern spoken dialog systems. We present an incremental dialog state tracker, based on LSTM networks. It directly uses automatic speech recognition hypotheses to track the state. We also…

Computation and Language · Computer Science 2015-07-14 Lukas Zilka , Filip Jurcicek

The primary purpose of dialogue state tracking (DST), a critical component of an end-to-end conversational system, is to build a model that responds well to real-world situations. Although we often change our minds from time to time during…

Computation and Language · Computer Science 2022-10-13 Takyoung Kim , Yukyung Lee , Hoonsang Yoon , Pilsung Kang , Junseong Bang , Misuk Kim

Dialogue State Tracking (DST) is a key part of task-oriented dialogue systems, identifying important information in conversations. However, its accuracy drops significantly in spoken dialogue environments due to named entity errors from…

Computation and Language · Computer Science 2025-10-31 Jihyun Lee , Solee Im , Wonjun Lee , Gary Geunbae Lee

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

Computation and Language · Computer Science 2024-06-14 James D. Finch , Jinho D. Choi

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

Computation and Language · Computer Science 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog. By formulating DST as a semantic parsing task over hierarchical representations, we can incorporate semantic…

The growing sophistication of speech generated by Artificial Intelligence (AI) has introduced new challenges in audio deepfake detection. Text-to-speech (TTS) and voice conversion (VC) technologies can create highly convincing synthetic…

Sound · Computer Science 2026-03-17 Vamshi Nallaguntla , Aishwarya Fursule , Shruti Kshirsagar , Anderson R. Avila

A key component of modern conversational systems is the Dialogue State Tracker (or DST), which models a user's goals and needs. Toward building more robust and reliable DSTs, we introduce a prompt-based learning approach to automatically…

Computation and Language · Computer Science 2023-06-08 Xiangjue Dong , Yun He , Ziwei Zhu , James Caverlee

Dialogue state tracking (DST) aims to convert the dialogue history into dialogue states which consist of slot-value pairs. As condensed structural information memorizing all history information, the dialogue state in the last turn is…

Computation and Language · Computer Science 2023-06-21 Haoning Zhang , Junwei Bao , Haipeng Sun , Youzheng Wu , Wenye Li , Shuguang Cui , Xiaodong He

With the rapid development of large language models, researchers have created increasingly advanced spoken dialogue systems that can naturally converse with humans. However, these systems still struggle to handle the full complexity of…

Computation and Language · Computer Science 2025-01-03 Xize Cheng , Dongjie Fu , Xiaoda Yang , Minghui Fang , Ruofan Hu , Jingyu Lu , Bai Jionghao , Zehan Wang , Shengpeng Ji , Rongjie Huang , Linjun Li , Yu Chen , Tao Jin , Zhou Zhao
‹ Prev 1 2 3 10 Next ›