English
Related papers

Related papers: RFiD: Towards Rational Fusion-in-Decoder for Open-…

200 papers

In Open-domain Question Answering (ODQA), it is essential to discern relevant contexts as evidence and avoid spurious ones among retrieved results. The model architecture that uses concatenated multiple contexts in the decoding phase, i.e.,…

Computation and Language · Computer Science 2024-04-04 Eunseong Choi , Hyeri Lee , Jongwuk Lee

Fusion-in-Decoder (FiD) is an effective retrieval-augmented language model applied across a variety of open-domain tasks, such as question answering, fact checking, etc. In FiD, supporting passages are first retrieved and then processed…

Computation and Language · Computer Science 2023-11-07 Moshe Berchansky , Peter Izsak , Avi Caciularu , Ido Dagan , Moshe Wasserblat

Current Open-Domain Question Answering (ODQA) model paradigm often contains a retrieving module and a reading module. Given an input question, the reading module predicts the answer from the relevant passages which are retrieved by the…

Computation and Language · Computer Science 2022-06-07 Donghan Yu , Chenguang Zhu , Yuwei Fang , Wenhao Yu , Shuohang Wang , Yichong Xu , Xiang Ren , Yiming Yang , Michael Zeng

Open Domain Question Answering (ODQA) has been advancing rapidly in recent times, driven by significant developments in dense passage retrieval and pretrained language models. Current models typically incorporate the FiD framework, which is…

Computation and Language · Computer Science 2024-08-13 Yufei Huang , Xu Han , Maosong Sun

Fusion-in-Decoder (FiD) is a powerful retrieval-augmented language model that sets the state-of-the-art on many knowledge-intensive NLP tasks. However, the architecture used for FiD was chosen by making minimal modifications to a standard…

Computation and Language · Computer Science 2023-06-06 Michiel de Jong , Yury Zemlyanskiy , Joshua Ainslie , Nicholas FitzGerald , Sumit Sanghai , Fei Sha , William Cohen

The current state-of-the-art generative models for open-domain question answering (ODQA) have focused on generating direct answers from unstructured textual information. However, a large amount of world's knowledge is stored in structured…

Computation and Language · Computer Science 2021-12-09 Alexander Hanbo Li , Patrick Ng , Peng Xu , Henghui Zhu , Zhiguo Wang , Bing Xiang

Fusion-in-decoder (Fid) (Izacard and Grave, 2020) is a generative question answering (QA) model that leverages passage retrieval with a pre-trained transformer and pushed the state of the art on single-hop QA. However, the complexity of…

Computation and Language · Computer Science 2022-05-20 Semih Yavuz , Kazuma Hashimoto , Yingbo Zhou , Nitish Shirish Keskar , Caiming Xiong

Generative models have recently started to outperform extractive models in Open Domain Question Answering, largely by leveraging their decoder to attend over multiple encoded passages and combining their information. However, generative…

Computation and Language · Computer Science 2022-11-21 Akhil Kedia , Mohd Abbas Zaidi , Haejun Lee

The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge. Although prior work has sought to increase the knowledge coverage by incorporating structured knowledge beyond…

Computation and Language · Computer Science 2022-03-22 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

Knowledge-Intensive Visual Question Answering (KI-VQA) refers to answering a question about an image whose answer does not lie in the image. This paper presents a new pipeline for KI-VQA tasks, consisting of a retriever and a reader. First,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Alireza Salemi , Juan Altmayer Pizzorno , Hamed Zamani

The question answering system can answer questions from various fields and forms with deep neural networks, but it still lacks effective ways when facing multiple evidences. We introduce a new model called SRQA, which means Synthetic Reader…

Computation and Language · Computer Science 2020-09-04 Jiuniu Wang , Wenjia Xu , Xingyu Fu , Yang Wei , Li Jin , Ziyan Chen , Guangluan Xu , Yirong Wu

Conventional works generally employ a two-phase model in which a generator selects the most important pieces, followed by a predictor that makes predictions based on the selected pieces. However, such a two-phase model may incur the…

Machine Learning · Computer Science 2022-09-21 Wei Liu , Haozhao Wang , Jun Wang , Ruixuan Li , Chao Yue , Yuankai Zhang

To date, most of recent work under the retrieval-reader framework for open-domain QA focuses on either extractive or generative reader exclusively. In this paper, we study a hybrid approach for leveraging the strengths of both models. We…

Computation and Language · Computer Science 2021-06-04 Hao Cheng , Yelong Shen , Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao

Conventional VQA approaches primarily rely on question-answer (Q&A) pairs to learn the spatio-temporal dynamics of video content. However, most existing annotations are event-centric, which restricts the model's ability to capture the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ju-Young Oh

We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources. The key novelty of our method is the introduction of the intermediary modules into the…

Computation and Language · Computer Science 2022-10-25 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

In the chemical and process industries, Process Flow Diagrams (PFDs) and Piping and Instrumentation Diagrams (P&IDs) are critical for design, construction, and maintenance. Recent advancements in Generative AI, such as Large Multimodal…

Computation and Language · Computer Science 2024-09-04 Sagar Srinivas Sakhinana , Geethan Sannidhi , Venkataramana Runkana

Retrieval-augmented generation models augment knowledge encoded in a language model by providing additional relevant external knowledge (context) during generation. Although it has been shown that the quantity and quality of context impact…

Computation and Language · Computer Science 2024-03-22 Kosuke Akimoto , Kunihiro Takeoka , Masafumi Oyamada

State-of-the-art extractive question-answering models achieve superhuman performances on the SQuAD benchmark. Yet, they are unreasonably heavy and need expensive GPU computing to answer questions in a reasonable time. Thus, they cannot be…

Computation and Language · Computer Science 2025-03-11 Sofian Chaybouti , Achraf Saghe , Aymen Shabou

In open-domain question answering, questions are highly likely to be ambiguous because users may not know the scope of relevant topics when formulating them. Therefore, a system needs to find possible interpretations of the question, and…

The performance of Open-Domain Question Answering (ODQA) retrieval systems can exhibit sub-optimal behavior, providing text excerpts with varying degrees of irrelevance. Unfortunately, many existing ODQA datasets lack examples specifically…

Computation and Language · Computer Science 2024-03-05 Rustam Abdumalikov , Pasquale Minervini , Yova Kementchedjhieva
‹ Prev 1 2 3 10 Next ›