English
Related papers

Related papers: Learning Goal-Oriented Visual Dialog via Tempered …

200 papers

A reinforcement learning agent that needs to pursue different goals across episodes requires a goal-conditional policy. In addition to their potential to generalize desirable behavior to unseen goals, such policies may also enable…

Machine Learning · Computer Science 2019-02-21 Paulo Rauber , Avinash Ummadisingu , Filipe Mutz , Juergen Schmidhuber

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

In this paper, we present a neural network based task-oriented dialogue system that can be optimized end-to-end with deep reinforcement learning (RL). The system is able to track dialogue state, interface with knowledge bases, and…

Computation and Language · Computer Science 2017-12-04 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

We teach goal-driven agents to interactively act and speak in situated environments by training on generated curriculums. Our agents operate in LIGHT (Urbanek et al. 2019) -- a large-scale crowd-sourced fantasy text adventure game wherein…

Computation and Language · Computer Science 2022-02-28 Prithviraj Ammanabrolu , Renee Jia , Mark O. Riedl

As AI technology advances, research in playing text-based games with agents has becomeprogressively popular. In this paper, a novel approach to agent design and agent learning ispresented with the context of reinforcement learning. A model…

Computation and Language · Computer Science 2025-09-04 Haonan Wang , Mingjia Zhao , Junfeng Sun , Wei Liu

Traditional policy gradient methods are fundamentally flawed. Natural gradients converge quicker and better, forming the foundation of contemporary Reinforcement Learning such as Trust Region Policy Optimization (TRPO) and Proximal Policy…

Machine Learning · Computer Science 2022-09-07 W. J. A. van Heeswijk

Building an interactive artificial intelligence that can ask questions about the real world is one of the biggest challenges for vision and language problems. In particular, goal-oriented visual dialogue, where the aim of the agent is to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Shoya Matsumori , Kosuke Shingyouchi , Yuki Abe , Yosuke Fukuchi , Komei Sugiura , Michita Imai

Traditional recommendation systems produce static rather than interactive recommendations invariant to a user's specific requests, clarifications, or current mood, and can suffer from the cold-start problem if their tastes are unknown.…

Computation and Language · Computer Science 2019-09-10 Dongyeop Kang , Anusha Balakrishnan , Pararth Shah , Paul Crook , Y-Lan Boureau , Jason Weston

LLM-based conversational AI agents struggle to maintain coherent behavior over long horizons due to limited context. While RAG-based approaches are increasingly adopted to overcome this limitation by storing interactions in external memory…

Artificial Intelligence · Computer Science 2026-05-13 Jiazhou Liang , Armin Toroghi , Yifan Simon Liu , Faeze Moradi Kalarde , Liam Gallagher , Scott Sanner

Developing a dialogue agent that is capable of making autonomous decisions and communicating by natural language is one of the long-term goals of machine learning research. Traditional approaches either rely on hand-crafting a small…

Computation and Language · Computer Science 2017-05-30 Tsung-Hsien Wen , Yishu Miao , Phil Blunsom , Steve Young

Prompt-based pre-trained language models (PLMs) paradigm have succeeded substantially in few-shot natural language processing (NLP) tasks. However, prior discrete prompt optimization methods require expert knowledge to design the base…

Machine Learning · Computer Science 2024-01-17 Chengzhengxu Li , Xiaoming Liu , Yichen Wang , Duyi Li , Yu Lan , Chao Shen

Speech recognition systems have achieved high recognition performance for several tasks. However, the performance of such systems is dependent on the tremendously costly development work of preparing vast amounts of task-matched transcribed…

Computation and Language · Computer Science 2017-11-13 Taku Kato , Takahiro Shinozaki

Reinforcement Learning (RL) has been witnessed its potential for training a dialogue policy agent towards maximizing the accumulated rewards given from users. However, the reward can be very sparse for it is usually only provided at the end…

Computation and Language · Computer Science 2021-11-03 Hongru Wang , Huimin Wang , Zezhong Wang , Kam-Fai Wong

To interpret natural language at the discourse level, it is very useful to accurately recognize dialogue acts, such as SUGGEST, in identifying speaker intentions. Our research explores the utility of a machine learning method called…

cmp-lg · Computer Science 2007-05-23 Ken Samuel , Sandra Carberry , K. Vijay-Shanker

Task-oriented Dialog (ToD) systems have to solve multiple subgoals to accomplish user goals, whereas feedback is often obtained only at the end of the dialog. In this work, we propose SUIT (SUbgoal-aware ITerative Training), an iterative…

Computation and Language · Computer Science 2024-11-26 Magdalena Kaiser , Patrick Ernst , György Szarvas

Modern task-oriented dialogue (TOD) systems increasingly rely on large language model (LLM) agents, leveraging Retrieval-Augmented Generation (RAG) and long-context capabilities for long-term memory utilization. However, these methods are…

Computation and Language · Computer Science 2025-08-14 Yiming Du , Bingbing Wang , Yang He , Bin Liang , Baojun Wang , Zhongyang Li , Lin Gui , Jeff Z. Pan , Ruifeng Xu , Kam-Fai Wong

This paper addresses the challenge of improving interaction quality in dialogue based learning by detecting and recommending effective pedagogical strategies in tutor student conversations. We introduce PedagoSense, a pedology grounded…

Computation and Language · Computer Science 2026-02-03 Shahem Sultan , Shahem Fadi , Yousef Melhim , Ibrahim Alsarraj , Besher Hassan

The main goal of modeling human conversation is to create agents which can interact with people in both open-ended and goal-oriented scenarios. End-to-end trained neural dialog systems are an important line of research for such generalized…

Computation and Language · Computer Science 2019-04-30 Chaitanya K. Joshi , Fei Mi , Boi Faltings

We study the estimation of policy gradients for continuous-time systems with known dynamics. By reframing policy learning in continuous-time, we show that it is possible construct a more efficient and accurate gradient estimator. The…

Machine Learning · Computer Science 2021-06-25 Samuel Ainsworth , Kendall Lowrey , John Thickstun , Zaid Harchaoui , Siddhartha Srinivasa

We propose a reinforcement learning-based approach to optimize conversational strategies for product recommendation across diverse industries. As organizations increasingly adopt intelligent agents to support sales and service operations,…

Information Retrieval · Computer Science 2025-07-03 Kang Liu