English
Related papers

Related papers: Joint Speech and Text Training for LLM-Based End-t…

200 papers

Dialogue State Tracking (DST) is a key part of task-oriented dialogue systems, identifying important information in conversations. However, its accuracy drops significantly in spoken dialogue environments due to named entity errors from…

Computation and Language · Computer Science 2025-10-31 Jihyun Lee , Solee Im , Wonjun Lee , Gary Geunbae Lee

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's requests (\textit{a.k.a} dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform this update in three…

Computation and Language · Computer Science 2024-07-02 Lucas Druart , Valentin Vielzeuf , Yannick Estève

An important yet rarely tackled problem in dialogue state tracking (DST) is scalability for dynamic ontology (e.g., movie, restaurant) and unseen slot values. We focus on a specific condition, where the ontology is unknown to the state…

Computation and Language · Computer Science 2019-07-09 Guan-Lin Chao , Ian Lane

Dialog state tracking (DST) is a crucial component in a task-oriented dialog system for conversational information access. A common practice in current dialog systems is to define the dialog state by a set of slot-value pairs. Such…

Computation and Language · Computer Science 2018-11-06 Yinpei Dai , Zhijian Ou , Dawei Ren , Pengfei Yu

Text discourse parsing weighs importantly in understanding information flow and argumentative structure in natural language, making it beneficial for downstream tasks. While previous work significantly improves the performance of RST…

Computation and Language · Computer Science 2021-10-12 Zhengyuan Liu , Ke Shi , Nancy F. Chen

Dialogue State Tracking (DST), a key component of task-oriented conversation systems, represents user intentions by determining the values of pre-defined slots in an ongoing dialogue. Existing approaches use hand-crafted templates and…

Computation and Language · Computer Science 2023-10-24 Praveen Venkateswaran , Evelyn Duesterwald , Vatche Isahagian

Task oriented dialogue systems rely heavily on specialized dialogue state tracking (DST) modules for dynamically predicting user intent throughout the conversation. State-of-the-art DST models are typically trained in a supervised manner…

Simultaneous speech translation (SimulST) translates partial speech inputs incrementally. Although the monotonic correspondence between input and output is preferable for smaller latency, it is not the case for distant language pairs such…

Computation and Language · Computer Science 2023-06-16 Yuka Ko , Ryo Fukuda , Yuta Nishikawa , Yasumasa Kano , Katsuhito Sudoh , Satoshi Nakamura

Few-shot dialogue state tracking (DST) with Large Language Models (LLM) relies on an effective and efficient conversation retriever to find similar in-context examples for prompt learning. Previous works use raw dialogue context as search…

Computation and Language · Computer Science 2024-04-04 Seanie Lee , Jianpeng Cheng , Joris Driesen , Alexandru Coca , Anders Johannsen

Dialogue state tracking (DST) module is an important component for task-oriented dialog systems to understand users' goals and needs. Collecting dialogue state labels including slots and values can be costly, especially with the wide…

Computation and Language · Computer Science 2023-01-27 Yuting Yang , Wenqiang Lei , Pei Huang , Juan Cao , Jintao Li , Tat-Seng Chua

Zero-shot transfer learning for Dialogue State Tracking (DST) helps to handle a variety of task-oriented dialogue domains without the cost of collecting in-domain data. Existing works mainly study common data- or model-level augmentation…

Computation and Language · Computer Science 2023-06-02 Qingyue Wang , Liang Ding , Yanan Cao , Yibing Zhan , Zheng Lin , Shi Wang , Dacheng Tao , Li Guo

Goal-oriented dialogue systems typically rely on components specifically developed for a single task or domain. This limits such systems in two different ways: If there is an update in the task domain, the dialogue system usually needs to…

Artificial Intelligence · Computer Science 2018-12-03 Rahul Goel , Shachi Paul , Tagyoung Chung , Jeremie Lecomte , Arindam Mandal , Dilek Hakkani-Tur

Multi-domain dialogue state tracking (DST) is a critical component for conversational AI systems. The domain ontology (i.e., specification of domains, slots, and values) of a conversational AI system is generally incomplete, making the…

Computation and Language · Computer Science 2020-06-23 Li Zhou , Kevin Small

In this paper, we propose a simple yet effective framework for multilingual end-to-end speech translation (ST), in which speech utterances in source languages are directly translated to the desired target languages with a universal…

Computation and Language · Computer Science 2019-11-01 Hirofumi Inaguma , Kevin Duh , Tatsuya Kawahara , Shinji Watanabe

Recent end-to-end speech language models (SLMs) have expanded upon the capabilities of large language models (LLMs) by incorporating pre-trained speech models. However, these SLMs often undergo extensive speech instruction-tuning to bridge…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-30 Ke-Han Lu , Zhehuai Chen , Szu-Wei Fu , Chao-Han Huck Yang , Jagadeesh Balam , Boris Ginsburg , Yu-Chiang Frank Wang , Hung-yi Lee

End-to-end Speech Translation (ST) models have many potential advantages when compared to the cascade of Automatic Speech Recognition (ASR) and text Machine Translation (MT) models, including lowered inference latency and the avoidance of…

Computation and Language · Computer Science 2019-02-12 Ye Jia , Melvin Johnson , Wolfgang Macherey , Ron J. Weiss , Yuan Cao , Chung-Cheng Chiu , Naveen Ari , Stella Laurenzo , Yonghui Wu

We tackle the Dialogue Belief State Tracking(DST) problem of task-oriented conversational systems. Recent approaches to this problem leveraging Transformer-based models have yielded great results. However, training these models is…

Computation and Language · Computer Science 2022-04-19 Debjoy Saha , Bishal Santra , Pawan Goyal

Annotating task-oriented dialogues is notorious for the expensive and difficult data collection process. Few-shot dialogue state tracking (DST) is a realistic solution to this problem. In this paper, we hypothesize that dialogue summaries…

Computation and Language · Computer Science 2022-03-04 Jamin Shin , Hangyeol Yu , Hyeongdon Moon , Andrea Madotto , Juneyoung Park

Recent works in dialogue state tracking (DST) focus on an open vocabulary-based setting to resolve scalability and generalization issues of the predefined ontology-based approaches. However, they are inefficient in that they predict the…

Computation and Language · Computer Science 2020-05-05 Sungdong Kim , Sohee Yang , Gyuwan Kim , Sang-Woo Lee

Given the great success of large language models (LLMs) across various tasks, in this paper, we introduce LLM-ST, a novel and effective speech translation model constructed upon a pre-trained LLM. By integrating the large language model…

Computation and Language · Computer Science 2023-12-22 Zhichao Huang , Rong Ye , Tom Ko , Qianqian Dong , Shanbo Cheng , Mingxuan Wang , Hang Li