English
Related papers

Related papers: "Think Before You Speak": Improving Multi-Action D…

200 papers

In this paper, a novel Generation-Evaluation framework is developed for multi-turn conversations with the objective of letting both participants know more about each other. For the sake of rational knowledge utilization and coherent…

Computation and Language · Computer Science 2019-06-04 Siqi Bao , Huang He , Fan Wang , Rongzhong Lian , Hua Wu

Spoken Dialogue Models (SDMs) have advanced rapidly, yet their ability to sustain genuinely interactive multi-turn conversations remains underexplored, as most benchmarks focus on single-turn exchanges. We introduce Multi-Bench, the first…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Yayue Deng , Guoqiang Hu , Haiyang Sun , Xiangyu Zhang , Haoyang Zhang , Fei Tian , Xuerui Yang , Gang Yu , Eng Siong Chng

Recent research has shown that multi-task pre-training greatly improves the model's robustness and transfer ability, which is crucial for building a high-quality dialog system. However, most previous works on multi-task pre-training rely…

Computation and Language · Computer Science 2023-09-21 Yucheng Cai , Wentao Ma , Yuchuan Wu , Shuzheng Si , Yuan Shao , Zhijian Ou , Yongbin Li

Recently, reinforcement learning (RL) has been applied to task-oriented dialogue systems by using latent actions to solve shortcomings of supervised learning (SL). In this paper, we propose a multi-domain task-oriented dialogue system,…

Computation and Language · Computer Science 2021-07-08 Hyunmin Jeon , Gary Geunbae Lee

While most task-oriented dialogues assume conversations between the agent and one user at a time, dialogue systems are increasingly expected to communicate with multiple users simultaneously who make decisions collaboratively. To facilitate…

Recent works usually address Dialog policy learning DPL by training a reinforcement learning (RL) agent to determine the best dialog action. However, existing works on deep RL require a large volume of agent-user interactions to achieve…

Computation and Language · Computer Science 2023-09-06 Huimin Wang , Wai-Chung Kwan , Kam-Fai Wong

Task-Oriented Dialogue (TOD) systems have become crucial components in interactive artificial intelligence applications. While recent advances have capitalized on pre-trained language models (PLMs), they exhibit limitations regarding…

Computation and Language · Computer Science 2023-12-11 Sungryull Sohn , Yiwei Lyu , Anthony Liu , Lajanugen Logeswaran , Dong-Ki Kim , Dongsub Shim , Honglak Lee

Recent advancements in proactive dialogues have garnered significant attention, particularly for more complex objectives (e.g. emotion support and persuasion). Unlike traditional task-oriented dialogues, proactive dialogues demand advanced…

Computation and Language · Computer Science 2024-12-20 Tao He , Lizi Liao , Yixin Cao , Yuanxing Liu , Yiheng Sun , Zerui Chen , Ming Liu , Bing Qin

We present an online tutoring system that learns to provide effective feedback to students after they answer questions incorrectly. Using data from one million students, the system learns which assistance action (e.g., one of multiple…

Machine Learning · Computer Science 2025-08-04 Robin Schmucker , Nimish Pachapurkar , Shanmuga Bala , Miral Shah , Tom Mitchell

Developing language model-based dialogue agents requires effective data to train models that can follow specific task logic. However, most existing data simulation methods focus on increasing diversity in language, topics, or dialogue acts…

Computation and Language · Computer Science 2025-03-04 Wanyu Du , Song Feng , James Gung , Lijia Sun , Yi Zhang , Saab Mansour , Yanjun Qi

Task-oriented dialogue (TOD) system is designed to accomplish user-defined tasks through dialogues. The TOD system has progressed towards end-to-end modeling by leveraging pre-trained large language models. Fine-tuning the pre-trained…

Computation and Language · Computer Science 2024-11-11 Dharmendra Prajapat , Durga Toshniwal

Persuasive dialogue generation plays a vital role in decision-making, negotiation, counseling, and behavior change, yet it remains a challenging problem. In complex persuasion where the persuadee's internal states are not expressed clearly,…

Computation and Language · Computer Science 2026-05-19 Dingyi Zhang , Ziqing Zhuang , Linhai Zhang , Ziyang Gao , Deyu Zhou

We study an approach to policy selection for large relational Markov Decision Processes (MDPs). We consider a variant of approximate policy iteration (API) that replaces the usual value-function learning step with a learning step in policy…

Artificial Intelligence · Computer Science 2011-09-13 A. Fern , R. Givan , S. Yoon

There is a growing interest in developing goal-oriented dialog systems which serve users in accomplishing complex tasks through multi-turn conversations. Although many methods are devised to evaluate and improve the performance of…

Computation and Language · Computer Science 2020-05-18 Ryuichi Takanobu , Qi Zhu , Jinchao Li , Baolin Peng , Jianfeng Gao , Minlie Huang

Large language model (LLM)-based agents are increasingly used to perform complex, multi-step workflows in regulated settings such as compliance and due diligence. However, many agentic architectures rely primarily on prompt engineering of a…

Artificial Intelligence · Computer Science 2026-02-03 Ananya Joshi , Michael Rudow

Personalized dialogue requires more than recalling explicit user histories: systems also need to infer hidden user states that evolve through interaction and shape appropriate response strategies. Existing memory- and profile-based methods…

Computation and Language · Computer Science 2026-05-26 Jiani Luo , Xiaoyan Zhao , Yang Zhang , Shuyi Miao , Bingbing Xu , Stefan Konigorski , Tat-Seng Chua

In shared autonomy, a user and autonomous system work together to achieve shared goals. To collaborate effectively, the autonomous system must know the user's goal. As such, most prior works follow a predict-then-act model, first predicting…

Effective robotic systems for long-horizon human-robot collaboration must adapt to a wide range of human partners, whose physical behavior, willingness to assist, and understanding of the robot's capabilities may change over time. This…

The task-oriented spoken dialogue system (SDS) aims to assist a human user in accomplishing a specific task (e.g., hotel booking). The dialogue management is a core part of SDS. There are two main missions in dialogue management: dialogue…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Xiaoyuan Liu , Kai Yu

Effective contact-rich manipulation requires robots to synergistically leverage vision, force, and proprioception. However, Reinforcement Learning agents struggle to learn in such multisensory settings, especially amidst sensory noise and…

Robotics · Computer Science 2026-04-27 Rickmer Krohn , Vignesh Prasad , Gabriele Tiboni , Georgia Chalvatzaki