English
Related papers

Related papers: DZ-TDPO: Non-Destructive Temporal Alignment for Mu…

200 papers

Inference-time alignment provides an efficient alternative for aligning LLMs with humans. However, these approaches still face challenges, such as limited scalability due to policy-specific value functions and latency during the inference…

Computation and Language · Computer Science 2025-05-27 Ruizhe Chen , Wenhao Chai , Zhifei Yang , Xiaotian Zhang , Joey Tianyi Zhou , Tony Quek , Soujanya Poria , Zuozhu Liu

Zero-shot domain adaptation for dialogue state tracking (DST) remains a challenging problem in task-oriented dialogue (TOD) systems, where models must generalize to target domains unseen at training time. Current large language model…

Computation and Language · Computer Science 2025-02-24 Christopher Richardson , Roshan Sharma , Neeraj Gaur , Parisa Haghani , Anirudh Sundar , Bhuvana Ramabhadran

Dialogue state tracking (DST) aims at estimating the current dialogue state given all the preceding conversation. For multi-domain DST, the data sparsity problem is a major obstacle due to increased numbers of state candidates and dialogue…

Computation and Language · Computer Science 2020-10-08 Su Zhu , Jieyu Li , Lu Chen , Kai Yu

With the demanding need for deploying dialogue systems in new domains with less cost, zero-shot dialogue state tracking (DST), which tracks user's requirements in task-oriented dialogues without training on desired domains, draws attention…

Computation and Language · Computer Science 2023-02-28 Ruolin Su , Jingfeng Yang , Ting-Wei Wu , Biing-Hwang Juang

Zero-shot dialogue state tracking (DST) seeks to enable dialogue systems to transition to unfamiliar domains without manual annotation or extensive retraining. Prior research has approached this objective by embedding prompts into language…

Computation and Language · Computer Science 2024-08-01 Xiang Luo , Zhiwen Tang , Jin Wang , Xuejie Zhang

In task-oriented multi-turn dialogue systems, dialogue state refers to a compact representation of the user goal in the context of dialogue history. Dialogue state tracking (DST) is to estimate the dialogue state at each turn. Due to the…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Yanbin Zhao , Su Zhu , Kai Yu

This paper presents a comparative study of context management strategies for end-to-end Spoken Dialog State Tracking using Speech-LLMs. We systematically evaluate traditional multimodal context (combining text history and spoken current…

Computation and Language · Computer Science 2026-02-17 Nizar El Ghazal , Antoine Caubrière , Valentin Vielzeuf

Dialog state tracking (DST) is a crucial component in a task-oriented dialog system for conversational information access. A common practice in current dialog systems is to define the dialog state by a set of slot-value pairs. Such…

Computation and Language · Computer Science 2018-11-06 Yinpei Dai , Zhijian Ou , Dawei Ren , Pengfei Yu

In environments with delayed observation, state augmentation by including actions within the delay window is adopted to retrieve Markovian property to enable reinforcement learning (RL). However, state-of-the-art (SOTA) RL techniques with…

Machine Learning · Computer Science 2024-10-23 Qingyuan Wu , Simon Sinong Zhan , Yixuan Wang , Yuhui Wang , Chung-Wei Lin , Chen Lv , Qi Zhu , Chao Huang

Diffusion models produce high-fidelity speech but are inefficient for real-time use due to long denoising steps and challenges in modeling intonation and rhythm. To improve this, we propose Diffusion Loss-Guided Policy Optimization (DLPO),…

Sound · Computer Science 2025-08-06 Jingyi Chen , Ju Seung Byun , Micha Elsner , Pichao Wang , Andrew Perrault

Large language models (LLMs) require careful alignment to balance competing objectives - factuality, safety, conciseness, proactivity, and diversity. Existing studies focus on individual techniques or specific dimensions, lacking a holistic…

Machine Learning · Computer Science 2025-09-17 Denis Janiak , Julia Moska , Dawid Motyka , Karolina Seweryn , Paweł Walkowiak , Bartosz Żuk , Arkadiusz Janz

Dialogue State Tracking (DST) is critical for comprehensively interpreting user and system utterances, thereby forming the cornerstone of efficient dialogue systems. Despite past research efforts focused on enhancing DST performance through…

Computation and Language · Computer Science 2023-07-25 Yukyung Lee , Takyoung Kim , Hoonsang Yoon , Pilsung Kang , Junseong Bang , Misuk Kim

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

Computation and Language · Computer Science 2024-06-14 James D. Finch , Jinho D. Choi

In schema-guided dialogue state tracking models estimate the current state of a conversation using natural language descriptions of the service schema for generalization to unseen services. Prior generative approaches which decode slot…

Computation and Language · Computer Science 2023-06-16 Björn Bebensee , Haejun Lee

While communicating with a user, a task-oriented dialogue system has to track the user's needs at each turn according to the conversation history. This process called dialogue state tracking (DST) is crucial because it directly informs the…

Computation and Language · Computer Science 2022-08-01 Léo Jacqmin , Lina M. Rojas-Barahona , Benoit Favre

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels. However, collecting these annotations is expensive and…

Computation and Language · Computer Science 2019-11-27 Bo-Hsiang Tseng , Marek Rei , Paweł Budzianowski , Richard E. Turner , Bill Byrne , Anna Korhonen

Dialogue state tracking (DST) plays an important role in task-oriented dialogue systems. However, collecting a large amount of turn-by-turn annotated dialogue data is costly and inefficient. In this paper, we propose a novel turn-level…

Computation and Language · Computer Science 2023-10-24 Zihan Zhang , Meng Fang , Fanghua Ye , Ling Chen , Mohammad-Reza Namazi-Rad

Dialogue State Tracking is central to multi-domain task-oriented dialogue systems, responsible for extracting information from user utterances. We present a novel hybrid architecture that augments GPT-2 with representations derived from…

Computation and Language · Computer Science 2021-09-24 Weizhe Lin , Bo-Hsiang Tseng , Bill Byrne

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

Computation and Language · Computer Science 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

Task-oriented dialogue systems aim to help users achieve their goals in specific domains. Recent neural dialogue systems use the entire dialogue history for abundant contextual information accumulated over multiple conversational turns.…

Computation and Language · Computer Science 2021-03-12 Hyunmin Jeon , Gary Geunbae Lee