English
Related papers

Related papers: Reinforcement Learning from Reformulations in Conv…

200 papers

Knowledge-driven dialog system has recently made remarkable breakthroughs. Compared with general dialog systems, superior knowledge-driven dialog systems can generate more informative and knowledgeable responses with pre-provided knowledge.…

Computation and Language · Computer Science 2023-02-24 Zhongtian Hu , Lifang Wang , Yangqi Chen , Yushuang Liu , Ronghan Li , Meng Zhao , Xinyu Lu , Zejun Jiang

This paper presents an empirical study of conversational question reformulation (CQR) with sequence-to-sequence architectures and pretrained language models (PLMs). We leverage PLMs to address the strong token-to-token independence…

Computation and Language · Computer Science 2020-04-07 Sheng-Chieh Lin , Jheng-Hong Yang , Rodrigo Nogueira , Ming-Feng Tsai , Chuan-Ju Wang , Jimmy Lin

To address the data scarcity issue in Conversational question answering (ConvQA), a dialog inpainting method, which utilizes documents to generate ConvQA datasets, has been proposed. However, the original dialog inpainting model is trained…

Computation and Language · Computer Science 2023-11-15 Yerin Hwang , Yongil Kim , Hyunkyung Bae , Jeesoo Bang , Hwanhee Lee , Kyomin Jung

We propose a method to efficiently learn diverse strategies in reinforcement learning for query reformulation in the tasks of document retrieval and question answering. In the proposed framework an agent consists of multiple specialized…

Machine Learning · Computer Science 2018-12-27 Rodrigo Nogueira , Jannis Bulian , Massimiliano Ciaramita

Complex knowledge base question answering can be achieved by converting questions into sequences of predefined actions. However, there is a significant semantic and structural gap between natural language and action sequences, which makes…

Computation and Language · Computer Science 2022-12-27 Yechun Tang , Xiaoxia Cheng , Weiming Lu

Reinforcement learning has become the central approach for language models (LMs) to learn from environmental reward or feedback. In practice, the environmental feedback is usually sparse and delayed. Learning from such signals is…

Machine Learning · Computer Science 2026-02-17 Taiwei Shi , Sihao Chen , Bowen Jiang , Linxin Song , Longqi Yang , Jieyu Zhao

Recent Visual Question Answering (VQA) models have shown impressive performance on the VQA benchmark but remain sensitive to small linguistic variations in input questions. Existing approaches address this by augmenting the dataset with…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Yash Kant , Abhinav Moudgil , Dhruv Batra , Devi Parikh , Harsh Agrawal

Neural models for response generation produce responses that are semantically plausible but not necessarily factually consistent with facts describing the speaker's persona. These models are trained with fully supervised learning where the…

Computation and Language · Computer Science 2021-02-16 Mohsen Mesgar , Edwin Simpson , Iryna Gurevych

Existing literature on Question Answering (QA) mostly focuses on algorithmic novelty, data augmentation, or increasingly large pre-trained language models like XLNet and RoBERTa. Additionally, a lot of systems on the QA leaderboards do not…

Computation and Language · Computer Science 2019-09-13 Lin Pan , Rishav Chakravarti , Anthony Ferritto , Michael Glass , Alfio Gliozzo , Salim Roukos , Radu Florian , Avirup Sil

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

In order to facilitate natural language understanding, the key is to engage commonsense or background knowledge. However, how to engage commonsense effectively in question answering systems is still under exploration in both research…

Computation and Language · Computer Science 2020-11-06 Qianglong Chen , Feng Ji , Haiqing Chen , Yin Zhang

Conversational question answering systems often rely on semantic parsing to enable interactive information retrieval, which involves the generation of structured database queries from a natural language input. For information-seeking…

Computation and Language · Computer Science 2024-01-04 Phillip Schneider , Manuel Klettner , Kristiina Jokinen , Elena Simperl , Florian Matthes

We present and evaluate a new model for Natural Language Generation (NLG) in Spoken Dialogue Systems, based on statistical planning, given noisy feedback from the current generation context (e.g. a user and a surface realiser). We study its…

Computation and Language · Computer Science 2016-06-16 Verena Rieser , Oliver Lemon

We explore unconstrained natural language feedback as a learning signal for artificial agents. Humans use rich and varied language to teach, yet most prior work on interactive learning from language assumes a particular form of input (e.g.,…

Artificial Intelligence · Computer Science 2021-07-06 Theodore R. Sumers , Mark K. Ho , Robert D. Hawkins , Karthik Narasimhan , Thomas L. Griffiths

Question answering is an effective method for obtaining information from knowledge bases (KB). In this paper, we propose the Neural-Symbolic Complex Question Answering (NS-CQA) model, a data-efficient reinforcement learning framework for…

Computation and Language · Computer Science 2020-11-02 Yuncheng Hua , Yuan-Fang Li , Guilin Qi , Wei Wu , Jingyao Zhang , Daiqing Qi

Conversational search is one of the ultimate goals of information retrieval. Recent research approaches conversational search by simplified settings of response ranking and conversational question answering, where an answer is either…

Information Retrieval · Computer Science 2020-05-26 Chen Qu , Liu Yang , Cen Chen , Minghui Qiu , W. Bruce Croft , Mohit Iyyer

We develop an artificial agent motivated to augment its knowledge base beyond its initial training. The agent actively participates in dialogues with other agents, strategically acquiring new information. The agent models its knowledge as…

Artificial Intelligence · Computer Science 2024-07-01 Selene Baez Santamaria , Shihan Wang , Piek Vossen

To build an open-domain multi-turn conversation system is one of the most interesting and challenging tasks in Artificial Intelligence. Many research efforts have been dedicated to building such dialogue systems, yet few shed light on…

Computation and Language · Computer Science 2018-11-20 Lili Yao , Ruijian Xu , Chao Li , Dongyan Zhao , Rui Yan

Personalization in Question Answering (QA) requires answers that are both accurate and aligned with users' background, preferences, and historical context. Existing state-of-the-art methods primarily rely on retrieval-augmented generation…

Computation and Language · Computer Science 2026-02-24 Maryam Amirizaniani , Alireza Salemi , Hamed Zamani

Existing conversational search studies mainly focused on asking better clarifying questions and/or improving search result quality. These works aim at retrieving better responses according to the search context, and their performances are…

Information Retrieval · Computer Science 2023-04-18 Zhenduo Wang , Zhichao Xu , Qingyao Ai