English
Related papers

Related papers: RECONSIDER: Re-Ranking using Span-Focused Cross-At…

200 papers

Machine Reading Comprehension (MRC) with multiple-choice questions requires the machine to read given passage and select the correct answer among several candidates. In this paper, we propose a novel approach called Convolutional Spatial…

Computation and Language · Computer Science 2019-11-05 Zhipeng Chen , Yiming Cui , Wentao Ma , Shijin Wang , Guoping Hu

Open-domain question answering relies on efficient passage retrieval to select candidate contexts, where traditional sparse vector space models, such as TF-IDF or BM25, are the de facto method. In this work, we show that retrieval can be…

Computation and Language · Computer Science 2020-10-02 Vladimir Karpukhin , Barlas Oğuz , Sewon Min , Patrick Lewis , Ledell Wu , Sergey Edunov , Danqi Chen , Wen-tau Yih

Open domain conversational agents can answer a broad range of targeted queries. However, the sequential nature of interaction with these systems makes knowledge exploration a lengthy task which burdens the user with asking a chain of well…

Computation and Language · Computer Science 2023-02-23 Christopher Richardson , Sudipta Kar , Anjishnu Kumar , Anand Ramachandran , Omar Zia Khan , Zeynab Raeesy , Abhinav Sethy

Contrastive learning has been the dominant approach to training dense retrieval models. In this work, we investigate the impact of ranking context - an often overlooked aspect of learning dense retrieval models. In particular, we examine…

Information Retrieval · Computer Science 2023-10-24 George Zerveas , Navid Rekabsaz , Daniel Cohen , Carsten Eickhoff

Similar question retrieval is a core task in community-based question answering (CQA) services. To balance the effectiveness and efficiency, the question retrieval system is typically implemented as multi-stage rankers: The first-stage…

Information Retrieval · Computer Science 2021-07-20 Yinqiong Cai , Yixing Fan , Jiafeng Guo , Ruqing Zhang , Yanyan Lan , Xueqi Cheng

Modern enterprise retrieval systems must handle short, underspecified queries such as ``foreign transaction fee refund'' and ``recent check status''. In these cases, semantic nuance and metadata matter but per-query large language model…

Information Retrieval · Computer Science 2026-01-06 Satya Swaroop Gudipudi , Sahil Girhepuje , Ponnurangam Kumaraguru , Kristine Ma

Question answering (QA) is a high-level ability of natural language processing. Most extractive ma-chine reading comprehension models focus on factoid questions (e.g., who, when, where) and restrict the output answer as a short and…

Computation and Language · Computer Science 2021-10-25 Peng Cui , Dongyao Hu , Le Hu

In this paper, we introduce the Reinforced Mnemonic Reader for machine reading comprehension tasks, which enhances previous attentive readers in two aspects. First, a reattention mechanism is proposed to refine current attentions by…

Computation and Language · Computer Science 2018-06-07 Minghao Hu , Yuxing Peng , Zhen Huang , Xipeng Qiu , Furu Wei , Ming Zhou

While numerous methods have been proposed as defenses against adversarial examples in question answering (QA), these techniques are often model specific, require retraining of the model, and give only marginal improvements in performance…

Computation and Language · Computer Science 2021-02-08 Sagnik Majumder , Chinmoy Samant , Greg Durrett

Conversational search supports multi-turn user-system interactions to solve complex information needs. Different from the traditional single-turn ad-hoc search, conversational search encounters a more challenging problem of…

Information Retrieval · Computer Science 2024-07-30 Fengran Mo , Chen Qu , Kelong Mao , Yihong Wu , Zhan Su , Kaiyu Huang , Jian-Yun Nie

Existing machine reading comprehension (MRC) models do not scale effectively to real-world applications like web-level information retrieval and question answering (QA). We argue that this stems from the nature of MRC datasets: most of…

Computation and Language · Computer Science 2020-04-17 Xingdi Yuan , Jie Fu , Marc-Alexandre Cote , Yi Tay , Christopher Pal , Adam Trischler

Rerankers, typically cross-encoders, are computationally intensive but are frequently used because they are widely assumed to outperform cheaper initial IR systems. We challenge this assumption by measuring reranker performance for full…

Information Retrieval · Computer Science 2025-07-14 Mathew Jacob , Erik Lindgren , Matei Zaharia , Michael Carbin , Omar Khattab , Andrew Drozdov

This paper proposes a novel neural machine reading model for open-domain question answering at scale. Existing machine comprehension models typically assume that a short piece of relevant text containing answers is already identified and…

Computation and Language · Computer Science 2017-10-06 Bin Bi , Hao Ma

We study calibration in question answering, estimating whether model correctly predicts answer for each question. Unlike prior work which mainly rely on the model's confidence score, our calibrator incorporates information about the input…

Computation and Language · Computer Science 2021-06-04 Shujian Zhang , Chengyue Gong , Eunsol Choi

Built upon the existing analysis of retrieval heads in large language models, we propose an alternative reranking framework that trains models to estimate passage-query relevance using the attention scores of selected heads. This approach…

Computation and Language · Computer Science 2026-03-11 Yuqing Li , Jiangnan Li , Mo Yu , Guoxuan Ding , Zheng Lin , Weiping Wang , Jie Zhou

We propose EAR, a query Expansion And Reranking approach for improving passage retrieval, with the application to open-domain question answering. EAR first applies a query expansion model to generate a diverse set of queries, and then uses…

Computation and Language · Computer Science 2023-05-29 Yung-Sung Chuang , Wei Fang , Shang-Wen Li , Wen-tau Yih , James Glass

To produce a domain-agnostic question answering model for the Machine Reading Question Answering (MRQA) 2019 Shared Task, we investigate the relative benefits of large pre-trained language models, various data sampling strategies, as well…

Computation and Language · Computer Science 2019-12-05 Shayne Longpre , Yi Lu , Zhucheng Tu , Chris DuBois

The conventional paradigm in neural question answering (QA) for narrative content is limited to a two-stage process: first, relevant text passages are retrieved and, subsequently, a neural network for machine comprehension extracts the…

Computation and Language · Computer Science 2019-08-13 Bernhard Kratzwald , Anna Eigenmann , Stefan Feuerriegel

Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex…

Computation and Language · Computer Science 2020-09-22 Shih-Ting Lin , Greg Durrett

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

Computation and Language · Computer Science 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang