English
Related papers

Related papers: Neural Response Ranking for Social Conversation: A…

200 papers

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. A part of this effort is the policy optimisation task, which attempts to find a policy describing how to…

Computation and Language · Computer Science 2018-02-13 Gellért Weisz , Paweł Budzianowski , Pei-Hao Su , Milica Gašić

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

We present Sparrow, an information-seeking dialogue agent trained to be more helpful, correct, and harmless compared to prompted language model baselines. We use reinforcement learning from human feedback to train our models with two new…

Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tuning methods and benchmarks overlook critical aspects like…

Computation and Language · Computer Science 2026-02-24 Zijie Liu , Xinyu Zhao , Jie Peng , Zhuangdi Zhu , Qingyu Chen , Kaidi Xu , Xia Hu , Tianlong Chen

There is a resurgent interest in developing intelligent open-domain dialog systems due to the availability of large amounts of conversational data and the recent progress on neural approaches to conversational AI. Unlike traditional…

Computation and Language · Computer Science 2020-03-02 Minlie Huang , Xiaoyan Zhu , Jianfeng Gao

The applicability of common sentiment analysis models to open domain human robot interaction is investigated within this paper. The models are used on a dataset specific to user interaction with the Alana system (a Alexa prize system) in…

Artificial Intelligence · Computer Science 2021-07-19 Mohamad Alissa , Issa Haddad , Jonathan Meyer , Jade Obeid , Nicolas Wiecek , Sukrit Wongariyakavee

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

Predicting user satisfaction in conversational systems has become critical, as spoken conversational assistants operate in increasingly complex domains. Online satisfaction prediction (i.e., predicting satisfaction of the user with the…

Human-Computer Interaction · Computer Science 2020-06-04 Jason Ingyu Choi , Ali Ahmadvand , Eugene Agichtein

Sellers in user to user marketplaces can be inundated with questions from potential buyers. Answers are often already available in the product description. We collected a dataset of around 590K such questions and answers from conversations…

Computation and Language · Computer Science 2018-02-07 Girish Kumar , Matthew Henderson , Shannon Chan , Hoang Nguyen , Lucas Ngoo

The development of trustworthy conversational information-seeking systems relies on dialogue models that can generate faithful and accurate responses based on relevant knowledge texts. However, two main challenges hinder this task. Firstly,…

Computation and Language · Computer Science 2023-11-03 Wanyu Du , Yangfeng Ji

Answering multiple-choice questions in a setting in which no supporting documents are explicitly provided continues to stand as a core problem in natural language processing. The contribution of this article is two-fold. First, it describes…

Computation and Language · Computer Science 2019-11-15 George-Sebastian Pîrtoacă , Traian Rebedea , Stefan Ruseti

Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress recently mostly through employing reinforcement learning methods. However, these approaches have become very sophisticated. It is time to re-evaluate it.…

Computation and Language · Computer Science 2020-09-22 Ziming Li , Julia Kiseleva , Maarten de Rijke

Fully data driven Chatbots for non-goal oriented dialogues are known to suffer from inconsistent behaviour across their turns, stemming from a general difficulty in controlling parameters like their assumed background personality and…

Computation and Language · Computer Science 2020-03-31 Fabian Galetzka , Chukwuemeka U. Eneh , David Schlangen

The core challenge in numerous real-world applications is to match an inquiry to the best document from a mutable and finite set of candidates. Existing industry solutions, especially latency-constrained services, often rely on similarity…

Information Retrieval · Computer Science 2024-11-13 Xiaofeng Zhu , Thomas Lin , Vishal Anand , Matthew Calderwood , Eric Clausen-Brown , Gord Lueck , Wen-wai Yim , Cheng Wu

The ability of a machine to communicate with humans has long been associated with the general success of AI. This dates back to Alan Turing's epoch-making work in the early 1950s, which proposes that a machine's intelligence can be tested…

Computation and Language · Computer Science 2020-02-03 Jiwei Li

Evaluation is crucial in the development process of task-oriented dialogue systems. As an evaluation method, user simulation allows us to tackle issues such as scalability and cost-efficiency, making it a viable choice for large-scale…

Information Retrieval · Computer Science 2021-05-11 Weiwei Sun , Shuo Zhang , Krisztian Balog , Zhaochun Ren , Pengjie Ren , Zhumin Chen , Maarten de Rijke

In this paper, we investigate the use of discourse-aware rewards with reinforcement learning to guide a model to generate long, coherent text. In particular, we propose to learn neural rewards to model cross-sentence ordering as a means to…

Computation and Language · Computer Science 2018-05-11 Antoine Bosselut , Asli Celikyilmaz , Xiaodong He , Jianfeng Gao , Po-Sen Huang , Yejin Choi

We present Chirpy Cardinal, an open-domain dialogue agent, as a research platform for the 2019 Alexa Prize competition. Building an open-domain socialbot that talks to real people is challenging - such a system must meet multiple user…

Current dialogue systems are not very engaging for users, especially when trained end-to-end without relying on proactive reengaging scripted strategies. Zhang et al. (2018) showed that the engagement level of end-to-end dialogue models…

Computation and Language · Computer Science 2018-09-07 Pierre-Emmanuel Mazaré , Samuel Humeau , Martin Raison , Antoine Bordes

Human communication depends on implicit social signals where effectiveness is shaped by tone, context, and conversational norms rather than semantic content alone. We introduce KARMA (Karma-Aligned Reward Model Adaptation), a framework for…

Computation and Language · Computer Science 2026-05-27 Jared Scott , Jesse Roberts