English
Related papers

Related papers: Dialog Acts for Task-Driven Embodied Agents

200 papers

End-to-end task-oriented dialog models have achieved promising performance on collaborative tasks where users willingly coordinate with the system to complete a given task. While in non-collaborative settings, for example, negotiation and…

Computation and Language · Computer Science 2019-12-02 Yu Li , Kun Qian , Weiyan Shi , Zhou Yu

In an era where single large language models have dominated the landscape of artificial intelligence for years, multi-agent systems arise as new protagonists in conversational task-solving. While previous studies have showcased their…

Computation and Language · Computer Science 2024-11-04 Jonas Becker

Pre-trained conversation models (PCMs) have achieved promising progress in recent years. However, existing PCMs for Task-oriented dialog (TOD) are insufficient for capturing the sequential nature of the TOD-related tasks, as well as for…

Computation and Language · Computer Science 2023-10-03 Lucen Zhong , Hengtong Lu , Caixia Yuan , Xiaojie Wang , Jiashen Sun , Ke Zeng , Guanglu Wan

Robust task-oriented spoken dialogue agents require exposure to the full diversity of how people interact through speech. Building spoken user simulators that address this requires large-scale spoken task-oriented dialogue (TOD) data…

Computation and Language · Computer Science 2026-03-18 Jonggeun Lee , Junseong Pyo , Jeongmin Park , Yohan Jo

In this work, we study computational approaches to detect online dialogic instructions, which are widely used to help students understand learning materials, and build effective study habits. This task is rather challenging due to the…

Computation and Language · Computer Science 2021-07-16 Yang Hao , Hang Li , Wenbiao Ding , Zhongqin Wu , Jiliang Tang , Rose Luckin , Zitao Liu

End-to-end neural approaches are becoming increasingly common in conversational scenarios due to their promising performances when provided with sufficient amount of data. In this paper, we present a novel methodology to address the…

Computation and Language · Computer Science 2019-10-17 Sourabh Majumdar , Serra Sinem Tekiroglu , Marco Guerini

Learning task-oriented dialog policies via reinforcement learning typically requires large amounts of interaction with users, which in practice renders such methods unusable for real-world applications. In order to reduce the data…

Computation and Language · Computer Science 2022-07-04 Jorge A. Mendez , Alborz Geramifard , Mohammad Ghavamzadeh , Bing Liu

Most existing dialogue corpora and models have been designed to fit into 2 predominant categories : task-oriented dialogues portray functional goals, such as making a restaurant reservation or booking a plane ticket, while…

Computation and Language · Computer Science 2023-11-27 Armand Stricker , Patrick Paroubek

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

Computation and Language · Computer Science 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

We aim to evaluate Large Language Models (LLMs) for embodied decision making. While a significant body of work has been leveraging LLMs for decision making in embodied environments, we still lack a systematic understanding of their…

This paper gives an overview of the Schema-Guided Dialogue State Tracking task of the 8th Dialogue System Technology Challenge. The goal of this task is to develop dialogue state tracking models suitable for large-scale virtual assistants,…

Computation and Language · Computer Science 2020-02-05 Abhinav Rastogi , Xiaoxue Zang , Srinivas Sunkara , Raghav Gupta , Pranav Khaitan

The migration of conversational AI agents across different embodiments in order to maintain the continuity of the task has been recently explored to further improve user experience. However, these migratable agents lack contextual…

Robotics · Computer Science 2020-10-26 Ravi Tejwani , Boris Katz , Cynthia Breazeal

In this paper, we introduce Dependency Dialogue Acts (DDA), a novel framework for capturing the structure of speaker-intentions in multi-party dialogues. DDA combines and adapts features from existing dialogue annotation frameworks, and…

Being engaging, knowledgeable, and empathetic are all desirable general qualities in a conversational agent. Previous work has introduced tasks and datasets that aim to help agents to learn those qualities in isolation and gauge how well…

Computation and Language · Computer Science 2020-04-21 Eric Michael Smith , Mary Williamson , Kurt Shuster , Jason Weston , Y-Lan Boureau

Due to privacy concerns, open dialogue datasets for mental health are primarily generated through human or AI synthesis methods. However, the inherent implicit nature of psychological processes, particularly those of clients, poses…

Human-Computer Interaction · Computer Science 2025-11-18 Lixiu Wu , Yuanrong Tang , Qisen Pan , Xianyang Zhan , Yucheng Han , Lanxi Xiao , Tianhong Wang , Chen Zhong , Jiangtao Gong

AI agents today are mostly siloed - they either retrieve and reason over vast amount of digital information and knowledge obtained online; or interact with the physical world through embodied perception, planning and action - but rarely…

Artificial Intelligence · Computer Science 2025-07-31 Yining Hong , Rui Sun , Bingxuan Li , Xingcheng Yao , Maxine Wu , Alexander Chien , Da Yin , Ying Nian Wu , Zhecan James Wang , Kai-Wei Chang

In real-world scenarios, it is desirable for embodied agents to have the ability to leverage human language to gain explicit or implicit knowledge for learning tasks. Despite recent progress, most previous approaches adopt simple low-level…

Computation and Language · Computer Science 2024-11-01 Jiajun Xi , Yinong He , Jianing Yang , Yinpei Dai , Joyce Chai

Recent advances in task-oriented dialogue (TOD) systems, driven by large language models (LLMs) with extensive API and tool integration, have enabled conversational agents to coordinate interleaved goals, maintain long-horizon context, and…

Computation and Language · Computer Science 2026-02-02 Yifei Zhang , Hooshang Nayyeri , Rinat Khaziev , Emine Yilmaz , Gokhan Tur , Dilek Hakkani-Tür , Hari Thadakamalla

In order to build dialogue systems to tackle the ambitious task of holding social conversations, we argue that we need a data driven approach that includes insight into human conversational chit chat, and which incorporates different…

Computation and Language · Computer Science 2017-09-12 Kevin K. Bowden , Shereen Oraby , Amita Misra , Jiaqi Wu , Stephanie Lukin