English
Related papers

Related papers: Delaying Interaction Layers in Transformer-based E…

200 papers

The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge. Although prior work has sought to increase the knowledge coverage by incorporating structured knowledge beyond…

Computation and Language · Computer Science 2022-03-22 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

Open domain question answering (ODQA) is a longstanding task aimed at answering factual questions from a large knowledge corpus without any explicit evidence in natural language processing (NLP). Recent works have predominantly focused on…

Computation and Language · Computer Science 2022-11-16 Qin Zhang , Shangsi Chen , Dongkuan Xu , Qingqing Cao , Xiaojun Chen , Trevor Cohn , Meng Fang

Large language models have recently pushed open domain question answering (ODQA) to new frontiers. However, prevailing retriever-reader pipelines often depend on multiple rounds of prompt level instructions, leading to high computational…

Computation and Language · Computer Science 2025-09-23 Zhanghao Hu , Hanqi Yan , Qinglin Zhu , Zhenyi Shen , Yulan He , Lin Gui

We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources. The key novelty of our method is the introduction of the intermediary modules into the…

Computation and Language · Computer Science 2022-10-25 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

Large transformer models, such as BERT, achieve state-of-the-art results in machine reading comprehension (MRC) for open-domain question answering (QA). However, transformers have a high computational cost for inference which makes them…

Computation and Language · Computer Science 2021-08-06 Haytham ElFadeel , Stan Peshterliev

Recent advances in open-domain question answering (ODQA) have demonstrated impressive accuracy on standard Wikipedia style benchmarks. However, it is less clear how robust these models are and how well they perform when applied to…

Computation and Language · Computer Science 2022-12-21 Dheeru Dua , Emma Strubell , Sameer Singh , Pat Verga

Transformer-based QA models use input-wide self-attention -- i.e. across both the question and the input passage -- at all layers, causing them to be slow and memory-intensive. It turns out that we can get by without input-wide…

Computation and Language · Computer Science 2020-05-05 Qingqing Cao , Harsh Trivedi , Aruna Balasubramanian , Niranjan Balasubramanian

Recent advancements in open-domain question answering (ODQA), i.e., finding answers from large open-domain corpus like Wikipedia, have led to human-level performance on many datasets. However, progress in QA over book stories (Book QA) lags…

Computation and Language · Computer Science 2021-06-08 Xiangyang Mou , Chenghao Yang , Mo Yu , Bingsheng Yao , Xiaoxiao Guo , Saloni Potdar , Hui Su

We develop a unified system to answer directly from text open-domain questions that may require a varying number of retrieval steps. We employ a single multi-task transformer model to perform all the necessary subtasks -- retrieving…

Computation and Language · Computer Science 2021-11-01 Peng Qi , Haejun Lee , Oghenetegiri "TG" Sido , Christopher D. Manning

This paper discusses the effectiveness of various text processing techniques, their combinations, and encodings to achieve a reduction of complexity and size in a given text corpus. The simplified text corpus is sent to BERT (or similar…

Computation and Language · Computer Science 2024-12-18 Chejui Liao , Tabish Maniar , Sravanajyothi N , Anantha Sharma

Pre-training a transformer-based model for the language modeling task in a large dataset and then fine-tuning it for downstream tasks has been found very useful in recent years. One major advantage of such pre-trained language models is…

Computation and Language · Computer Science 2020-11-17 Md Tahmid Rahman Laskar , Enamul Hoque , Jimmy Xiangji Huang

Large transformer-based language models have been shown to be very effective in many classification tasks. However, their computational complexity prevents their use in applications requiring the classification of a large set of candidates.…

Computation and Language · Computer Science 2020-05-08 Luca Soldaini , Alessandro Moschitti

Unlike the Open Domain Question Answering (ODQA) setting, the conversational (ODConvQA) domain has received limited attention when it comes to reevaluating baselines for both efficiency and effectiveness. In this paper, we study the…

Computation and Language · Computer Science 2023-10-24 Andrei C. Coman , Gianni Barlacchi , Adrià de Gispert

Recent studies on open-domain question answering have achieved prominent performance improvement using pre-trained language models such as BERT. State-of-the-art approaches typically follow the "retrieve and read" pipeline and employ…

Computation and Language · Computer Science 2020-03-02 Yuyu Zhang , Ping Nie , Xiubo Geng , Arun Ramamurthy , Le Song , Daxin Jiang

Building automatic technical support system is an important yet challenge task. Conceptually, to answer a user question on a technical forum, a human expert has to first retrieve relevant documents, and then read them carefully to identify…

Computation and Language · Computer Science 2021-05-19 Wenhao Yu , Lingfei Wu , Yu Deng , Qingkai Zeng , Ruchi Mahindru , Sinem Guven , Meng Jiang

The performance of Open-Domain Question Answering (ODQA) retrieval systems can exhibit sub-optimal behavior, providing text excerpts with varying degrees of irrelevance. Unfortunately, many existing ODQA datasets lack examples specifically…

Computation and Language · Computer Science 2024-03-05 Rustam Abdumalikov , Pasquale Minervini , Yova Kementchedjhieva

In the last few years, open-domain question answering (ODQA) has advanced rapidly due to the development of deep learning techniques and the availability of large-scale QA datasets. However, the current datasets are essentially designed for…

Computation and Language · Computer Science 2022-02-23 Jiexin Wang , Adam Jatowt , Masatoshi Yoshikawa

Open Domain Question Answering (ODQA) has been advancing rapidly in recent times, driven by significant developments in dense passage retrieval and pretrained language models. Current models typically incorporate the FiD framework, which is…

Computation and Language · Computer Science 2024-08-13 Yufei Huang , Xu Han , Maosong Sun

Cross-lingual open domain question answering (CLQA) is a complex problem, comprising cross-lingual retrieval from a multilingual knowledge base, followed by answer generation in the query language. Both steps are usually tackled by separate…

Computation and Language · Computer Science 2024-10-03 Fan Jiang , Tom Drummond , Trevor Cohn

To extract answers from a large corpus, open-domain question answering (QA) systems usually rely on information retrieval (IR) techniques to narrow the search space. Standard inverted index methods such as TF-IDF are commonly used as thanks…

Computation and Language · Computer Science 2021-02-22 Wenhan Xiong , Hong Wang , William Yang Wang
‹ Prev 1 2 3 10 Next ›