English
Related papers

Related papers: You Only Need One Model for Open-domain Question A…

200 papers

Looped Transformers offer a promising alternative to purely feed-forward computation by iteratively refining latent representations, improving language modeling and reasoning. Yet recurrent architectures remain unstable to train, costly to…

Machine Learning · Computer Science 2026-05-13 Jacob Fein-Ashley , Paria Rashidinejad

Open-domain complex Question Answering (QA) is a difficult task with challenges in evidence retrieval and reasoning. The complexity of such questions could stem from questions being compositional, hybrid evidence, or ambiguity in questions.…

Computation and Language · Computer Science 2024-06-26 Venktesh V. Deepali Prabhu , Avishek Anand

Pre-trained multimodal models have achieved significant success in retrieval-based question answering. However, current multimodal retrieval question-answering models face two main challenges. Firstly, utilizing compressed evidence features…

Artificial Intelligence · Computer Science 2023-10-17 Shuwen Yang , Anran Wu , Xingjiao Wu , Luwei Xiao , Tianlong Ma , Cheng Jin , Liang He

Any system which performs goal-directed continual learning must not only learn incrementally but process and absorb information incrementally. Such a system also has to understand when its goals have been achieved. In this paper, we…

Computation and Language · Computer Science 2019-01-16 Samira Abnar , Tania Bedrax-weiss , Tom Kwiatkowski , William W. Cohen

Asking clarifying questions in response to ambiguous or faceted queries has been recognized as a useful technique for various information retrieval systems, especially conversational search systems with limited bandwidth interfaces.…

Information Retrieval · Computer Science 2020-06-16 Helia Hashemi , Hamed Zamani , W. Bruce Croft

Reranking documents based on their relevance to a given query is a critical task in information retrieval. Traditional reranking methods often lack transparency and rely on proprietary models, hindering reproducibility and interpretability.…

Computation and Language · Computer Science 2025-04-15 Yuelyu Ji , Zhuochun Li , Rui Meng , Daqing He

The retriever-reader pipeline has shown promising performance in open-domain QA but suffers from a very slow inference speed. Recently proposed question retrieval models tackle this problem by indexing question-answer pairs and searching…

Computation and Language · Computer Science 2022-05-20 Yeon Seonwoo , Juhee Son , Jiho Jin , Sang-Woo Lee , Ji-Hoon Kim , Jung-Woo Ha , Alice Oh

Parallel deep learning architectures like fine-tuned BERT and MT-DNN, have quickly become the state of the art, bypassing previous deep and shallow learning methods by a large margin. More recently, pre-trained models from large related…

Information Retrieval · Computer Science 2019-07-04 Hemant Pugaliya , Karan Saxena , Shefali Garg , Sheetal Shalini , Prashant Gupta , Eric Nyberg , Teruko Mitamura

The conventional paradigm in neural question answering (QA) for narrative content is limited to a two-stage process: first, relevant text passages are retrieved and, subsequently, a neural network for machine comprehension extracts the…

Computation and Language · Computer Science 2019-08-13 Bernhard Kratzwald , Anna Eigenmann , Stefan Feuerriegel

A retriever, which retrieves relevant knowledge pieces from a knowledge base given a context, is an important component in many natural language processing (NLP) tasks. Retrievers have been introduced in knowledge-grounded dialog systems to…

Computation and Language · Computer Science 2025-06-03 Yucheng Cai , Ke Li , Yi Huang , Junlan Feng , Zhijian Ou

Retrieval Augment Generation (RAG) is a recent advancement in Open-Domain Question Answering (ODQA). RAG has only been trained and explored with a Wikipedia-based external knowledge base and is not optimized for use in other specialized…

Computation and Language · Computer Science 2024-10-08 Shamane Siriwardhana , Rivindu Weerasekera , Elliott Wen , Tharindu Kaluarachchi , Rajib Rana , Suranga Nanayakkara

We implement a method for re-ranking top-10 results of a state-of-the-art question answering (QA) system. The goal of our re-ranking approach is to improve the answer selection given the user question and the top-10 candidates. We focus on…

Machine Learning · Computer Science 2021-06-17 Michael Barz , Daniel Sonntag

Intelligent personal assistant systems with either text-based or voice-based conversational interfaces are becoming increasingly popular around the world. Retrieval-based conversation models have the advantages of returning fluent and…

Information Retrieval · Computer Science 2018-05-10 Liu Yang , Minghui Qiu , Chen Qu , Jiafeng Guo , Yongfeng Zhang , W. Bruce Croft , Jun Huang , Haiqing Chen

The Retrieval Question Answering (ReQA) task employs the retrieval-augmented framework, composed of a retriever and generator. The generator formulates the answer based on the documents retrieved by the retriever. Incorporating Large…

Computation and Language · Computer Science 2023-10-31 Haoyan Yang , Zhitao Li , Yong Zhang , Jianzong Wang , Ning Cheng , Ming Li , Jing Xiao

We present ReFormeR, a pattern-guided approach for query reformulation. Instead of prompting a language model to generate reformulations of a query directly, ReFormeR first elicits short reformulation patterns from pairs of initial queries…

Information Retrieval · Computer Science 2026-04-03 Amin Bigdeli , Mert Incesu , Negar Arabzadeh , Charles L. A. Clarke , Ebrahim Bagheri

Retrieval-augmented models have proven to be effective in natural language processing tasks, yet there remains a lack of research on their optimization using variational inference. We introduce the Variational Open-Domain (VOD) framework…

Computation and Language · Computer Science 2023-06-01 Valentin Liévin , Andreas Geert Motzfeldt , Ida Riis Jensen , Ole Winther

In this paper, we consider the problem of machine reading task when the questions are in the form of keywords, rather than natural language. In recent years, researchers have achieved significant success on machine reading comprehension…

Computation and Language · Computer Science 2017-11-02 Boyuan Pan , Hao Li , Zhou Zhao , Deng Cai , Xiaofei He

We initiate an investigation of learning tasks in a setting where the learner is given access to two competing provers, only one of which is honest. Specifically, we consider the power of such learners in assessing purported properties of…

Machine Learning · Statistics 2026-03-13 Ran Canetti , Ephraim Linder , Connor Wagaman

Conversational retrieval refers to an information retrieval system that operates in an iterative and interactive manner, requiring the retrieval of various external resources, such as persona, knowledge, and even response, to effectively…

Computation and Language · Computer Science 2024-02-29 Hongru Wang , Boyang Xue , Baohang Zhou , Rui Wang , Fei Mi , Weichao Wang , Yasheng Wang , Kam-Fai Wong

Recent work on open domain question answering (QA) assumes strong supervision of the supporting evidence and/or assumes a blackbox information retrieval (IR) system to retrieve evidence candidates. We argue that both are suboptimal, since…

Computation and Language · Computer Science 2019-07-01 Kenton Lee , Ming-Wei Chang , Kristina Toutanova