English
Related papers

Related papers: Real-Time Open-Domain Question Answering with Dens…

200 papers

Reasoning language models have demonstrated remarkable capabilities on challenging tasks by generating elaborate chain-of-thought (CoT) solutions. However, such lengthy generation shifts the inference bottleneck from compute-bound to…

Question answering (QA) is a critical task for speech-based retrieval from knowledge sources, by sifting only the answers without requiring to read supporting documents. Specifically, open-domain QA aims to answer user questions on…

Computation and Language · Computer Science 2023-08-09 Sang-eun Han , Yeonseok Jeong , Seung-won Hwang , Kyungjae Lee

IR models using a pretrained language model significantly outperform lexical approaches like BM25. In particular, SPLADE, which encodes texts to sparse vectors, is an effective model for practical use because it shows robustness to…

Computation and Language · Computer Science 2022-11-11 Hiroki Iida , Naoaki Okazaki

Legal question answering (QA) has attracted increasing attention from people seeking legal advice, which aims to retrieve the most applicable answers from a large-scale database of question-answer pairs. Previous methods mainly use a…

Computation and Language · Computer Science 2024-12-30 Shiwen Ni , Hao Cheng , Min Yang

Organizations handling sensitive documents face a critical dilemma: adopt cloud-based AI systems that offer powerful question-answering capabilities but compromise data privacy, or maintain local processing that ensures security but…

Computation and Language · Computer Science 2025-12-01 Paolo Astrino

Prior work in standardized science exams requires support from large text corpus, such as targeted science corpus fromWikipedia or SimpleWikipedia. However, retrieving knowledge from the large corpus is time-consuming and questions embedded…

Artificial Intelligence · Computer Science 2020-04-28 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

With the rise of large-scale pre-trained language models, open-domain question-answering (ODQA) has become an important research topic in NLP. Based on the popular pre-training fine-tuning approach, we posit that an additional in-domain…

Computation and Language · Computer Science 2022-05-03 Patrick Huber , Armen Aghajanyan , Barlas Oğuz , Dmytro Okhonko , Wen-tau Yih , Sonal Gupta , Xilun Chen

Human mind is the palace of curious questions that seek answers. Computational resolution of this challenge is possible through Natural Language Processing techniques. Statistical techniques like machine learning and deep learning require a…

Computation and Language · Computer Science 2022-04-21 Pragya Katyayan , Nisheeth Joshi

Given its effectiveness on knowledge-intensive natural language processing tasks, dense retrieval models have become increasingly popular. Specifically, the de-facto architecture for open-domain question answering uses two isomorphic…

Computation and Language · Computer Science 2023-05-24 Hao Cheng , Hao Fang , Xiaodong Liu , Jianfeng Gao

Open-domain question answering requires retrieval systems able to cope with the diverse and varied nature of questions, providing accurate answers across a broad spectrum of query types and topics. To deal with such topic heterogeneity…

Information Retrieval · Computer Science 2024-03-21 Pranav Kasela , Gabriella Pasi , Raffaele Perego , Nicola Tonellotto

Semantic parsing solves knowledge base (KB) question answering (KBQA) by composing a KB query, which generally involves node extraction (NE) and graph composition (GC) to detect and connect related nodes in a query. Despite the strong…

Computation and Language · Computer Science 2022-07-11 Minhao Zhang , Ruoyu Zhang , Yanzeng Li , Lei Zou

Keyphrase provides accurate information of document content that is highly compact, concise, full of meanings, and widely used for discourse comprehension, organization, and text retrieval. Though previous studies have made substantial…

Information Retrieval · Computer Science 2021-11-04 Yu Zhao , Jia Song , Huali Feng , Fuzhen Zhuang , Qing Li , Xiaojie Wang , Ji Liu

Open Domain Question Answering requires systems to retrieve external knowledge and perform multi-hop reasoning by composing knowledge spread over multiple sentences. In the recently introduced open domain question answering challenge…

Computation and Language · Computer Science 2020-04-20 Pratyay Banerjee , Chitta Baral

Neural network models recently proposed for question answering (QA) primarily focus on capturing the passage-question relation. However, they have minimal capability to link relevant facts distributed across multiple sentences which is…

Computation and Language · Computer Science 2018-01-26 Souvik Kundu , Hwee Tou Ng

Dense retrieval systems conduct first-stage retrieval using embedded representations and simple similarity metrics to match a query to documents. Its effectiveness depends on encoded embeddings to capture the semantics of queries and…

Information Retrieval · Computer Science 2021-09-01 HongChien Yu , Chenyan Xiong , Jamie Callan

An effective paradigm for building Automated Question Answering systems is the re-use of previously answered questions, e.g., for FAQs or forum applications. Given a database (DB) of question/answer (q/a) pairs, it is possible to answer a…

Computation and Language · Computer Science 2023-04-04 Stefano Campese , Ivano Lauriola , Alessandro Moschitti

Large language models are trained on massive scrapes of the web, which are often unstructured, noisy, and poorly phrased. Current scaling laws show that learning from such data requires an abundance of both compute and data, which grows…

Computation and Language · Computer Science 2024-01-30 Pratyush Maini , Skyler Seto , He Bai , David Grangier , Yizhe Zhang , Navdeep Jaitly

Inability of the naive users to formulate appropriate queries is a fundamental problem in web search engines. Therefore, assisting users to issue more effective queries is an important way to improve users' happiness. One effective approach…

Information Retrieval · Computer Science 2019-07-03 Amir H. Jadidinejad

Existing dense retrieval models struggle with reasoning-intensive retrieval task as they fail to capture implicit relevance that requires reasoning beyond surface-level semantic information. To address these challenges, we propose…

Information Retrieval · Computer Science 2025-07-18 Sangam Lee , Ryang Heo , SeongKu Kang , Dongha Lee

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

Computation and Language · Computer Science 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang