English
Related papers

Related papers: Real-Time Open-Domain Question Answering with Dens…

200 papers

Charts are very popular to analyze data and convey important insights. People often analyze visualizations to answer open-ended questions that require explanatory answers. Answering such questions are often difficult and time-consuming as…

Machine Learning · Computer Science 2022-10-14 Shankar Kantharaj , Xuan Long Do , Rixie Tiffany Ko Leong , Jia Qing Tan , Enamul Hoque , Shafiq Joty

This paper describes a compact and effective model for low-latency passage retrieval in conversational search based on learned dense representations. Prior to our work, the state-of-the-art approach uses a multi-stage pipeline comprising…

Information Retrieval · Computer Science 2021-11-30 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

To enable building and testing models on long-document comprehension, we introduce QuALITY, a multiple-choice QA dataset with context passages in English that have an average length of about 5,000 tokens, much longer than typical current…

Visually-situated languages such as charts and plots are omnipresent in real-world documents. These graphical depictions are human-readable and are often analyzed in visually-rich documents to address a variety of questions that necessitate…

Artificial Intelligence · Computer Science 2023-10-31 Anran Wu , Luwei Xiao , Xingjiao Wu , Shuwen Yang , Junjie Xu , Zisong Zhuang , Nian Xie , Cheng Jin , Liang He

We introduce a new dataset for Question Rewriting in Conversational Context (QReCC), which contains 14K conversations with 80K question-answer pairs. The task in QReCC is to find answers to conversational questions within a collection of…

Information Retrieval · Computer Science 2021-04-16 Raviteja Anantha , Svitlana Vakulenko , Zhucheng Tu , Shayne Longpre , Stephen Pulman , Srinivas Chappidi

Dense vector representations for sentences made significant progress in recent years as can be seen on sentence similarity tasks. Real-world phrase retrieval applications, on the other hand, still encounter challenges for effective use of…

Computation and Language · Computer Science 2024-05-14 Eyal Orbach , Lev Haikin , Nelly David , Avi Faizakof

Open-domain KeyPhrase Extraction (KPE) aims to extract keyphrases from documents without domain or quality restrictions, e.g., web pages with variant domains and qualities. Recently, neural methods have shown promising results in many KPE…

Computation and Language · Computer Science 2021-09-20 Si Sun , Zhenghao Liu , Chenyan Xiong , Zhiyuan Liu , Jie Bao

Recently, large language models (LLMs) have gained much attention for the emergence of human-comparable capabilities and huge potential. However, for open-domain implicit question-answering problems, LLMs may not be the ultimate solution…

Computation and Language · Computer Science 2026-03-10 Chang Liu , Xiaoguang Li , Lifeng Shang , Xin Jiang , Qun Liu , Edmund Y. Lam , Ngai Wong

Recent advancements in open-domain question answering (ODQA), i.e., finding answers from large open-domain corpus like Wikipedia, have led to human-level performance on many datasets. However, progress in QA over book stories (Book QA) lags…

Computation and Language · Computer Science 2021-06-08 Xiangyang Mou , Chenghao Yang , Mo Yu , Bingsheng Yao , Xiaoxiao Guo , Saloni Potdar , Hui Su

We study open-domain question answering with structured, unstructured and semi-structured knowledge sources, including text, tables, lists and knowledge bases. Departing from prior work, we propose a unifying approach that homogenizes all…

Computation and Language · Computer Science 2022-05-05 Barlas Oguz , Xilun Chen , Vladimir Karpukhin , Stan Peshterliev , Dmytro Okhonko , Michael Schlichtkrull , Sonal Gupta , Yashar Mehdad , Scott Yih

While there has been substantial progress in factoid question-answering (QA), answering complex questions remains challenging, typically requiring both a large body of knowledge and inference techniques. Open Information Extraction (Open…

Artificial Intelligence · Computer Science 2017-04-20 Tushar Khot , Ashish Sabharwal , Peter Clark

Accurately retrieving relevant bid keywords for user queries is critical in Sponsored Search but remains challenging, particularly for short, ambiguous queries. Existing dense and generative retrieval models often fail to capture nuanced…

Information Retrieval · Computer Science 2024-10-21 Akash Kumar Mohankumar , Gururaj K , Gagan Madan , Amit Singh

In this paper, we introduce SWE-QA, a text and code corpus aimed at benchmarking multi-hop code comprehension, addressing the gap between simplified evaluation tasks and the complex reasoning required in real-world software development.…

Software Engineering · Computer Science 2026-04-29 Laïla Elkoussy , Julien Perez

We present MedConceptsQA, a dedicated open source benchmark for medical concepts question answering. The benchmark comprises of questions of various medical concepts across different vocabularies: diagnoses, procedures, and drugs. The…

Computation and Language · Computer Science 2024-05-15 Ofir Ben Shoham , Nadav Rappoport

With the rise in mobile and voice search, answer passage retrieval acts as a critical component of an effective information retrieval system for open domain question answering. Currently, there are no comparable collections that address…

Information Retrieval · Computer Science 2018-05-11 Daniel Cohen , Liu Yang , W. Bruce Croft

We present two new large-scale datasets aimed at evaluating systems designed to comprehend a natural language query and extract its answer from a large corpus of text. The Quasar-S dataset consists of 37000 cloze-style (fill-in-the-gap)…

Computation and Language · Computer Science 2017-08-10 Bhuwan Dhingra , Kathryn Mazaitis , William W. Cohen

Retrieval-augmented question answering (QA) integrates external information and thereby increases the QA accuracy of reader models that lack domain knowledge. However, documents retrieved for closed domains require high expertise, so the…

Computation and Language · Computer Science 2025-06-30 Jeonghun Cho , Gary Geunbae Lee

This paper proposes to tackle open- domain question answering using Wikipedia as the unique knowledge source: the answer to any factoid question is a text span in a Wikipedia article. This task of machine reading at scale combines the…

Computation and Language · Computer Science 2017-05-01 Danqi Chen , Adam Fisch , Jason Weston , Antoine Bordes

Despite recent advances in large language models (LLMs), most QA benchmarks are still confined to single-paragraph or single-document settings, failing to capture the complexity of real-world information-seeking tasks. Practical QA often…

Computation and Language · Computer Science 2025-08-25 Jiwon Park , Seohyun Pyeon , Jinwoo Kim , Rina Carines Cabal , Yihao Ding , Soyeon Caren Han

Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method called dense retrieval.…

Information Retrieval · Computer Science 2025-03-25 Ahmed H. Salamah , Pierre McWhannel , Nicole Yan