English
Related papers

Related papers: What Did You Say? Task-Oriented Dialog Datasets Ar…

200 papers

Sequence-to-sequence state-of-the-art systems for dialogue state tracking (DST) use the full dialogue history as input, represent the current state as a list with all the slots, and generate the entire state from scratch at each dialogue…

Computation and Language · Computer Science 2024-10-17 Pietro Lesci , Yoshinari Fujinuma , Momchil Hardalov , Chao Shang , Yassine Benajiba , Lluis Marquez

The research of knowledge-driven conversational systems is largely limited due to the lack of dialog data which consist of multi-turn conversations on multiple topics and with knowledge annotations. In this paper, we propose a Chinese…

Computation and Language · Computer Science 2020-04-09 Hao Zhou , Chujie Zheng , Kaili Huang , Minlie Huang , Xiaoyan Zhu

Machine learning approaches for building task-oriented dialogue systems require large conversational datasets with labels to train on. We are interested in building task-oriented dialogue systems from human-human conversations, which may be…

Computation and Language · Computer Science 2019-07-09 Shachi Paul , Rahul Goel , Dilek Hakkani-Tür

Responding with multi-modal content has been recognized as an essential capability for an intelligent conversational agent. In this paper, we introduce the MMDialog dataset to better facilitate multi-modal conversation. MMDialog is composed…

Computation and Language · Computer Science 2022-12-22 Jiazhan Feng , Qingfeng Sun , Can Xu , Pu Zhao , Yaming Yang , Chongyang Tao , Dongyan Zhao , Qingwei Lin

Dialogue systems capable of social influence such as persuasion, negotiation, and therapy, are essential for extending the use of technology to numerous realistic scenarios. However, existing research primarily focuses on either…

Computation and Language · Computer Science 2023-01-26 Kushal Chawla , Weiyan Shi , Jingwen Zhang , Gale Lucas , Zhou Yu , Jonathan Gratch

Task-oriented dialogue (TOD) systems are experiencing a revolution driven by Large Language Models (LLMs), yet the evaluation methodologies for these systems remain insufficient for their growing sophistication. While traditional automatic…

Computation and Language · Computer Science 2025-07-17 Emre Can Acikgoz , Carl Guo , Suvodip Dey , Akul Datta , Takyoung Kim , Gokhan Tur , Dilek Hakkani-Tür

Many efforts have been made to construct dialog systems for different types of conversations, such as task-oriented dialog (TOD) and open-domain dialog (ODD). To better mimic human-level conversations that usually fuse various dialog modes,…

Computation and Language · Computer Science 2023-08-01 Miaoran Li , Baolin Peng , Michel Galley , Jianfeng Gao , Zhu Zhang

Classic pipeline models for task-oriented dialogue system require explicit modeling the dialogue states and hand-crafted action spaces to query a domain-specific knowledge base. Conversely, sequence-to-sequence models learn to map dialogue…

Computation and Language · Computer Science 2018-06-13 Haoyang Wen , Yijia Liu , Wanxiang Che , Libo Qin , Ting Liu

Multi-turn conversations are a common and critical mode of language model interaction. However, current open training and evaluation data focus on single-turn settings, failing to capture the additional dimension of these longer…

Computation and Language · Computer Science 2026-03-18 Victoria Graf , Valentina Pyatkin , Nouha Dziri , Nathan Lambert , Hannaneh Hajishirzi

Digital assistants are experiencing rapid growth due to their ability to assist users with day-to-day tasks where most dialogues are happening multi-turn. However, evaluating multi-turn dialogues remains challenging, especially at scale. We…

Computation and Language · Computer Science 2021-06-21 Ziming Li , Dookun Park , Julia Kiseleva , Young-Bum Kim , Sungjin Lee

Dialogue state tracking (DST) is a pivotal component in task-oriented dialogue systems. While it is relatively easy for a DST model to capture belief states in short conversations, the task of DST becomes more challenging as the length of a…

Computation and Language · Computer Science 2021-05-07 Ye Zhang , Yuan Cao , Mahdis Mahdieh , Jeffrey Zhao , Yonghui Wu

Task transfer, transferring knowledge contained in related tasks, holds the promise of reducing the quantity of labeled data required to fine-tune language models. Dialogue understanding encompasses many diverse tasks, yet task transfer has…

Computation and Language · Computer Science 2022-10-17 Alon Albalak , Yi-Lin Tuan , Pegah Jandaghi , Connor Pryor , Luke Yoffe , Deepak Ramachandran , Lise Getoor , Jay Pujara , William Yang Wang

Tool-Augmented Language Models (TALMs) leverage external APIs to answer user queries across various domains. However, existing benchmark datasets for TALM research often feature simplistic dialogues that do not reflect real-world scenarios,…

Computation and Language · Computer Science 2025-03-04 Jeonghoon Shim , Gyuhyeon Seo , Cheongsu Lim , Yohan Jo

Understanding and characterizing how people interact in information-seeking conversations is crucial in developing conversational search systems. In this paper, we introduce a new dataset designed for this purpose and use it to analyze…

Information Retrieval · Computer Science 2018-04-25 Chen Qu , Liu Yang , W. Bruce Croft , Johanne R. Trippas , Yongfeng Zhang , Minghui Qiu

Emotions are indispensable in human communication, but are often overlooked in task-oriented dialogue (ToD) modelling, where the task success is the primary focus. While existing works have explored user emotions or similar concepts in some…

When humans converse, what a speaker will say next significantly depends on what he sees. Unfortunately, existing dialogue models generate dialogue utterances only based on preceding textual contexts, and visual contexts are rarely…

Computation and Language · Computer Science 2021-06-01 Yuxian Meng , Shuhe Wang , Qinghong Han , Xiaofei Sun , Fei Wu , Rui Yan , Jiwei Li

Neural task-oriented dialogue systems often struggle to smoothly interface with a knowledge base. In this work, we seek to address this problem by proposing a new neural dialogue agent that is able to effectively sustain grounded,…

Computation and Language · Computer Science 2017-07-17 Mihail Eric , Christopher D. Manning

A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Evaluation), a public…

Computation and Language · Computer Science 2020-10-02 Shikib Mehri , Mihail Eric , Dilek Hakkani-Tur

Effective feedback is essential for refining instructional practices in mathematics education, and researchers often turn to advanced natural language processing (NLP) models to analyze classroom dialogues from multiple perspectives.…

Computation and Language · Computer Science 2025-08-05 Jannatun Naim , Jie Cao , Fareen Tasneem , Jennifer Jacobs , Brent Milne , James Martin , Tamara Sumner

Existing benchmarks used to evaluate the performance of end-to-end neural dialog systems lack a key component: natural variation present in human conversations. Most datasets are constructed through crowdsourcing, where the crowd workers…

Computation and Language · Computer Science 2020-10-07 Jatin Ganhotra , Robert Moore , Sachindra Joshi , Kahini Wadhawan