中文
相关论文

相关论文: RFiD: Towards Rational Fusion-in-Decoder for Open-…

200 篇论文

In Open-domain Question Answering (ODQA), it is essential to discern relevant contexts as evidence and avoid spurious ones among retrieved results. The model architecture that uses concatenated multiple contexts in the decoding phase, i.e.,…

计算与语言 · 计算机科学 2024-04-04 Eunseong Choi , Hyeri Lee , Jongwuk Lee

Fusion-in-Decoder (FiD) is an effective retrieval-augmented language model applied across a variety of open-domain tasks, such as question answering, fact checking, etc. In FiD, supporting passages are first retrieved and then processed…

计算与语言 · 计算机科学 2023-11-07 Moshe Berchansky , Peter Izsak , Avi Caciularu , Ido Dagan , Moshe Wasserblat

Current Open-Domain Question Answering (ODQA) model paradigm often contains a retrieving module and a reading module. Given an input question, the reading module predicts the answer from the relevant passages which are retrieved by the…

计算与语言 · 计算机科学 2022-06-07 Donghan Yu , Chenguang Zhu , Yuwei Fang , Wenhao Yu , Shuohang Wang , Yichong Xu , Xiang Ren , Yiming Yang , Michael Zeng

Open Domain Question Answering (ODQA) has been advancing rapidly in recent times, driven by significant developments in dense passage retrieval and pretrained language models. Current models typically incorporate the FiD framework, which is…

计算与语言 · 计算机科学 2024-08-13 Yufei Huang , Xu Han , Maosong Sun

Fusion-in-Decoder (FiD) is a powerful retrieval-augmented language model that sets the state-of-the-art on many knowledge-intensive NLP tasks. However, the architecture used for FiD was chosen by making minimal modifications to a standard…

计算与语言 · 计算机科学 2023-06-06 Michiel de Jong , Yury Zemlyanskiy , Joshua Ainslie , Nicholas FitzGerald , Sumit Sanghai , Fei Sha , William Cohen

The current state-of-the-art generative models for open-domain question answering (ODQA) have focused on generating direct answers from unstructured textual information. However, a large amount of world's knowledge is stored in structured…

计算与语言 · 计算机科学 2021-12-09 Alexander Hanbo Li , Patrick Ng , Peng Xu , Henghui Zhu , Zhiguo Wang , Bing Xiang

Fusion-in-decoder (Fid) (Izacard and Grave, 2020) is a generative question answering (QA) model that leverages passage retrieval with a pre-trained transformer and pushed the state of the art on single-hop QA. However, the complexity of…

计算与语言 · 计算机科学 2022-05-20 Semih Yavuz , Kazuma Hashimoto , Yingbo Zhou , Nitish Shirish Keskar , Caiming Xiong

Generative models have recently started to outperform extractive models in Open Domain Question Answering, largely by leveraging their decoder to attend over multiple encoded passages and combining their information. However, generative…

计算与语言 · 计算机科学 2022-11-21 Akhil Kedia , Mohd Abbas Zaidi , Haejun Lee

The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge. Although prior work has sought to increase the knowledge coverage by incorporating structured knowledge beyond…

计算与语言 · 计算机科学 2022-03-22 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

Knowledge-Intensive Visual Question Answering (KI-VQA) refers to answering a question about an image whose answer does not lie in the image. This paper presents a new pipeline for KI-VQA tasks, consisting of a retriever and a reader. First,…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Alireza Salemi , Juan Altmayer Pizzorno , Hamed Zamani

The question answering system can answer questions from various fields and forms with deep neural networks, but it still lacks effective ways when facing multiple evidences. We introduce a new model called SRQA, which means Synthetic Reader…

计算与语言 · 计算机科学 2020-09-04 Jiuniu Wang , Wenjia Xu , Xingyu Fu , Yang Wei , Li Jin , Ziyan Chen , Guangluan Xu , Yirong Wu

Conventional works generally employ a two-phase model in which a generator selects the most important pieces, followed by a predictor that makes predictions based on the selected pieces. However, such a two-phase model may incur the…

机器学习 · 计算机科学 2022-09-21 Wei Liu , Haozhao Wang , Jun Wang , Ruixuan Li , Chao Yue , Yuankai Zhang

To date, most of recent work under the retrieval-reader framework for open-domain QA focuses on either extractive or generative reader exclusively. In this paper, we study a hybrid approach for leveraging the strengths of both models. We…

计算与语言 · 计算机科学 2021-06-04 Hao Cheng , Yelong Shen , Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao

Conventional VQA approaches primarily rely on question-answer (Q&A) pairs to learn the spatio-temporal dynamics of video content. However, most existing annotations are event-centric, which restricts the model's ability to capture the…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Ju-Young Oh

We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources. The key novelty of our method is the introduction of the intermediary modules into the…

计算与语言 · 计算机科学 2022-10-25 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

In the chemical and process industries, Process Flow Diagrams (PFDs) and Piping and Instrumentation Diagrams (P&IDs) are critical for design, construction, and maintenance. Recent advancements in Generative AI, such as Large Multimodal…

计算与语言 · 计算机科学 2024-09-04 Sagar Srinivas Sakhinana , Geethan Sannidhi , Venkataramana Runkana

Retrieval-augmented generation models augment knowledge encoded in a language model by providing additional relevant external knowledge (context) during generation. Although it has been shown that the quantity and quality of context impact…

计算与语言 · 计算机科学 2024-03-22 Kosuke Akimoto , Kunihiro Takeoka , Masafumi Oyamada

State-of-the-art extractive question-answering models achieve superhuman performances on the SQuAD benchmark. Yet, they are unreasonably heavy and need expensive GPU computing to answer questions in a reasonable time. Thus, they cannot be…

计算与语言 · 计算机科学 2025-03-11 Sofian Chaybouti , Achraf Saghe , Aymen Shabou

In open-domain question answering, questions are highly likely to be ambiguous because users may not know the scope of relevant topics when formulating them. Therefore, a system needs to find possible interpretations of the question, and…

The performance of Open-Domain Question Answering (ODQA) retrieval systems can exhibit sub-optimal behavior, providing text excerpts with varying degrees of irrelevance. Unfortunately, many existing ODQA datasets lack examples specifically…

计算与语言 · 计算机科学 2024-03-05 Rustam Abdumalikov , Pasquale Minervini , Yova Kementchedjhieva
‹ 上一页 1 2 3 10 下一页 ›