English
Related papers

Related papers: Dialogue Telemetry: Turn-Level Instrumentation for…

200 papers

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

Computation and Language · Computer Science 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Self-talk-an internal dialogue that can occur silently or be spoken aloud-plays a crucial role in emotional regulation, cognitive processing, and motivation, yet has remained largely invisible and unmeasurable in everyday life. In this…

Sound · Computer Science 2025-11-12 Euihyeok Lee , Seonghyeon Kim , SangHun Im , Heung-Seon Oh , Seungwoo Kang

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

General-purpose large language models (LLMs) are increasingly deployed in verticals such as telecommunications, where adaptation is hindered by scarce, low-information-density corpora and tight mobile/edge constraints. We propose Data…

Machine Learning · Computer Science 2025-11-11 Zhicheng Zhou , Jing Li , Suming Qiu , Junjie Huang , Linyuan Qiu , Zhijie Sun

Full-Duplex Speech Language Models (FD-SLMs) are specialized foundation models designed to enable natural, real-time spoken interactions by modeling complex conversational turn-taking such as interruptions, backchannels, and overlapping…

Computation and Language · Computer Science 2026-01-21 Wenqian Cui , Lei Zhu , Xiaohui Li , Zhihan Guo , Haoli Bai , Lu Hou , Irwin King

Task-oriented dialogue (TOD) systems enable users to achieve their goals through natural language interactions. Traditionally, these systems have relied on turn-level manually annotated metadata, such as dialogue states and policy…

Computation and Language · Computer Science 2024-11-05 Adib Mosharrof , A. B. Siddique

Deep learning (DL) models based on the transformer architecture have revolutionized many DL applications such as large language models (LLMs), vision transformers, audio generation, and time series prediction. Much of this progress has been…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-20 Quentin Anthony , Benjamin Michalowicz , Jacob Hatef , Lang Xu , Mustafa Abduljabbar , Aamir Shafi , Hari Subramoni , Dhabaleswar Panda

A Dialogue State Tracker (DST) is a key component in a dialogue system aiming at estimating the beliefs of possible user goals at each dialogue turn. Most of the current DST trackers make use of recurrent neural networks and are based on…

Computation and Language · Computer Science 2019-10-23 Vevake Balaraman , Bernardo Magnini

Large language models (LLMs) are used in a variety of mission-critical roles. Due to the rapidly developing nature of LLMs, there is a lack of quantifiable understanding of the bias and perspective associated with LLM output. Inspired by…

Computation and Language · Computer Science 2025-07-15 Taejin Kim , Siun-Chuon Mau , Konrad Vesey

Recent advancements in large language models (LLMs) have led to significant progress in text-based dialogue systems. These systems can now generate high-quality responses that are accurate and coherent across a wide range of topics and…

Computation and Language · Computer Science 2025-01-10 Long Mai , Julie Carson-Berndsen

Speech encompasses a wealth of information, including but not limited to content, paralinguistic, and environmental information. This comprehensive nature of speech significantly impacts communication and is crucial for human-computer…

Computation and Language · Computer Science 2025-01-17 Junyi Ao , Yuancheng Wang , Xiaohai Tian , Dekun Chen , Jun Zhang , Lu Lu , Yuxuan Wang , Haizhou Li , Zhizheng Wu

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

Computation and Language · Computer Science 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

It is important to define meaningful and interpretable automatic evaluation metrics for open-domain dialog research. Standard language generation metrics have been shown to be ineffective for dialog. This paper introduces the FED metric…

Computation and Language · Computer Science 2020-06-25 Shikib Mehri , Maxine Eskenazi

As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogue states are…

Computation and Language · Computer Science 2022-08-05 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Sequence-to-sequence state-of-the-art systems for dialogue state tracking (DST) use the full dialogue history as input, represent the current state as a list with all the slots, and generate the entire state from scratch at each dialogue…

Computation and Language · Computer Science 2024-10-17 Pietro Lesci , Yoshinari Fujinuma , Momchil Hardalov , Chao Shang , Yassine Benajiba , Lluis Marquez

Scalability for handling unknown slot values is a important problem in dialogue state tracking (DST). As far as we know, previous scalable DST approaches generally rely on either the candidate generation from slot tagging output or the span…

Computation and Language · Computer Science 2021-06-18 Puhai Yang , Heyan Huang , Xianling Mao

Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task-oriented dialogs. In real-world settings with constantly changing services, DST systems must generalize…

Computation and Language · Computer Science 2021-01-22 Shuyang Li , Jin Cao , Mukund Sridhar , Henghui Zhu , Shang-Wen Li , Wael Hamza , Julian McAuley

As large language models (LLMs) increasingly permeate daily lives, there is a growing demand for real-time interactions that mirror human conversations. Traditional turn-based chat systems driven by LLMs prevent users from verbally…

Computation and Language · Computer Science 2026-01-14 Xinrong Zhang , Yingfa Chen , Shengding Hu , Xu Han , Zihang Xu , Yuanwei Xu , Weilin Zhao , Maosong Sun , Zhiyuan Liu

Achieving seamless, human-like interaction remains a key challenge for full-duplex spoken dialogue models (SDMs). Reinforcement learning (RL) has substantially enhanced text- and vision-language models, while well-designed reward signals…

Artificial Intelligence · Computer Science 2026-04-17 Yifu Chen , Shengpeng Ji , Zhengqing Liu , Qian Chen , Wen Wang , Ziqing Wang , Yangzhuo Li , Tianle Liang , Zhou Zhao

Dialogue State Tracking (DST), a key component of task-oriented conversation systems, represents user intentions by determining the values of pre-defined slots in an ongoing dialogue. Existing approaches use hand-crafted templates and…

Computation and Language · Computer Science 2023-10-24 Praveen Venkateswaran , Evelyn Duesterwald , Vatche Isahagian