English
Related papers

Related papers: Ask the Right Questions: Active Question Reformula…

200 papers

Open-domain question answering (QA) aims to find the answer to a question from a large collection of documents.Though many models for single-document machine comprehension have achieved strong performance, there is still much room for…

Computation and Language · Computer Science 2020-06-11 Mantong Zhou , Zhouxing Shi , Minlie Huang , Xiaoyan Zhu

Recent work (Xu et al., 2020) has suggested that numeral systems in different languages are shaped by a functional need for efficient communication in an information-theoretic sense. Here we take a learning-theoretic approach and show how…

Computation and Language · Computer Science 2024-05-01 Emil Carlsson , Devdatt Dubhashi , Fredrik D. Johansson

Deep reinforcement learning suffers from catastrophic forgetting and sample inefficiency making it less applicable to the ever-changing real world. However, the ability to use previously learned knowledge is essential for AI agents to…

Artificial Intelligence · Computer Science 2023-11-27 Ekaterina Nikonova , Cheng Xue , Jochen Renz

This paper introduces a framework that integrates reinforcement learning (RL) with autonomous agents to enable continuous improvement in the automated process of software test cases authoring from business requirement documents within…

Software Engineering · Computer Science 2025-12-09 Mohanakrishnan Hariharan

Recent work has shown how predictive modeling can endow agents with rich knowledge of their surroundings, improving their ability to act in complex environments. We propose question-answering as a general paradigm to decode and understand…

Answering open-ended questions is an essential capability for any intelligent agent. One of the most interesting recent open-ended question answering challenges is Visual Question Answering (VQA) which attempts to evaluate a system's visual…

Computation and Language · Computer Science 2016-10-25 Omid Bakhshandeh , Trung Bui , Zhe Lin , Walter Chang

We apply Reinforcement Learning algorithms to solve the classic quantitative finance Market Making problem, in which an agent provides liquidity to the market by placing buy and sell orders while maximizing a utility function. The optimal…

Machine Learning · Computer Science 2021-04-12 Matias Selser , Javier Kreiner , Manuel Maurette

Retrieval Augmented Generation (RAG) enables Large Language Models (LLMs) to generalize to new information by decoupling reasoning capabilities from static knowledge bases. Traditional RAG enhancements have explored vertical…

Software Engineering · Computer Science 2025-04-30 Michael Iannelli , Sneha Kuchipudi , Vera Dvorak

Query reformulation is the process by which a input search query is refined by the user to match documents outside the original top-n results. On average, roughly 50% of text search queries involve some form of reformulation, and term…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Kyle Xiao , Houdong Hu , Yan Wang

This paper presents first successful steps in designing search agents that learn meta-strategies for iterative query refinement in information-seeking tasks. Our approach uses machine reading to guide the selection of refinement terms from…

A good dialogue agent should have the ability to interact with users by both responding to questions and by asking questions, and importantly to learn from both types of interaction. In this work, we explore this direction by designing a…

Computation and Language · Computer Science 2017-02-14 Jiwei Li , Alexander H. Miller , Sumit Chopra , Marc'Aurelio Ranzato , Jason Weston

Many AI systems focus solely on providing solutions or explaining outcomes. However, complex tasks like research and strategic thinking often benefit from a more comprehensive approach to augmenting the thinking process rather than…

Human-Computer Interaction · Computer Science 2024-12-25 Soya Park , Hari Subramonyam , Chinmay Kulkarni

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Damien Teney , Anton van den Hengel

High-fidelity, AI-based simulated classroom systems enable teachers to rehearse effective teaching strategies. However, dialogue-oriented open-ended conversations such as teaching a student about scale factors can be difficult to model.…

Human-Computer Interaction · Computer Science 2021-12-07 Debajyoti Datta , Maria Phillips , James P Bywater , Jennifer Chiu , Ginger S. Watson , Laura E. Barnes , Donald E Brown

Interactive reinforcement learning has become an important apprenticeship approach to speed up convergence in classic reinforcement learning problems. In this regard, a variant of interactive reinforcement learning is policy shaping which…

Artificial Intelligence · Computer Science 2019-04-16 Francisco Cruz , Sven Magg , Yukie Nagai , Stefan Wermter

The recent explosion of question answering (QA) datasets and models has increased the interest in the generalization of models across multiple domains and formats by either training on multiple datasets or by combining multiple models.…

Computation and Language · Computer Science 2023-02-08 Haritz Puerto , Gözde Gül Şahin , Iryna Gurevych

Question generation (QG) attempts to solve the inverse of question answering (QA) problem by generating a natural language question given a document and an answer. While sequence to sequence neural models surpass rule-based systems for QG,…

Computation and Language · Computer Science 2020-11-03 Deepak Gupta , Hardik Chauhan , Akella Ravi Tej , Asif Ekbal , Pushpak Bhattacharyya

Automatic query reformulation refers to rewriting a user's original query in order to improve the ranking of retrieval results compared to the original query. We present a general framework for automatic query reformulation based on…

Information Retrieval · Computer Science 2015-07-15 Fernando Diaz

Large language models (LLMs) augmented with external tools are increasingly deployed as deep research agents that gather, reason over, and synthesize web information to answer complex queries. Although recent open-source systems achieve…

Artificial Intelligence · Computer Science 2026-02-24 Yi Wan , Jiuqi Wang , Liam Li , Jinsong Liu , Ruihao Zhu , Zheqing Zhu

This work proposes a novel technique Augmented Reinforcement Learning framework for the improvement of decision-making capabilities of machine learning models. The introduction of agents as external overseers checks on model decisions. The…

Machine Learning · Computer Science 2025-08-05 Sandesh Kumar Singh