English
Related papers

Related papers: Optimizing Retrieval-augmented Reader Models via T…

200 papers

Fusion-in-Decoder (FiD) is a powerful retrieval-augmented language model that sets the state-of-the-art on many knowledge-intensive NLP tasks. However, the architecture used for FiD was chosen by making minimal modifications to a standard…

Computation and Language · Computer Science 2023-06-06 Michiel de Jong , Yury Zemlyanskiy , Joshua Ainslie , Nicholas FitzGerald , Sumit Sanghai , Fei Sha , William Cohen

Current Open-Domain Question Answering (ODQA) model paradigm often contains a retrieving module and a reading module. Given an input question, the reading module predicts the answer from the relevant passages which are retrieved by the…

Computation and Language · Computer Science 2022-06-07 Donghan Yu , Chenguang Zhu , Yuwei Fang , Wenhao Yu , Shuohang Wang , Yichong Xu , Xiang Ren , Yiming Yang , Michael Zeng

Open-Domain Question Answering (ODQA) systems necessitate a reader model capable of generating answers by simultaneously referring to multiple passages. Although representative models like Fusion-in-Decoder (FiD) have been proposed to…

Computation and Language · Computer Science 2023-05-29 Cunxiang Wang , Haofei Yu , Yue Zhang

Open Domain Question Answering (ODQA) has been advancing rapidly in recent times, driven by significant developments in dense passage retrieval and pretrained language models. Current models typically incorporate the FiD framework, which is…

Computation and Language · Computer Science 2024-08-13 Yufei Huang , Xu Han , Maosong Sun

Retrieval-augmented generation models offer many benefits over standalone language models: besides a textual answer to a given query they provide provenance items retrieved from an updateable knowledge base. However, they are also more…

Computation and Language · Computer Science 2022-09-29 Sebastian Hofstätter , Jiecao Chen , Karthik Raman , Hamed Zamani

Retrieval-augmented language models such as Fusion-in-Decoder are powerful, setting the state of the art on a variety of knowledge-intensive tasks. However, they are also expensive, due to the need to encode a large number of retrieved…

Computation and Language · Computer Science 2023-06-06 Michiel de Jong , Yury Zemlyanskiy , Nicholas FitzGerald , Joshua Ainslie , Sumit Sanghai , Fei Sha , William Cohen

Retrieval-augmented generation models augment knowledge encoded in a language model by providing additional relevant external knowledge (context) during generation. Although it has been shown that the quantity and quality of context impact…

Computation and Language · Computer Science 2024-03-22 Kosuke Akimoto , Kunihiro Takeoka , Masafumi Oyamada

In Open-domain Question Answering (ODQA), it is essential to discern relevant contexts as evidence and avoid spurious ones among retrieved results. The model architecture that uses concatenated multiple contexts in the decoding phase, i.e.,…

Computation and Language · Computer Science 2024-04-04 Eunseong Choi , Hyeri Lee , Jongwuk Lee

This paper studies multi-task training of retrieval-augmented generation models for knowledge-intensive tasks. We propose to clean the training set by utilizing a distinct property of knowledge-intensive generation: The connection of…

Computation and Language · Computer Science 2022-07-08 Sebastian Hofstätter , Jiecao Chen , Karthik Raman , Hamed Zamani

Large language models (LLMs) have achieved significant performance gains using advanced prompting techniques over various tasks. However, the increasing length of prompts leads to high computational costs and often obscures crucial…

Computation and Language · Computer Science 2025-01-03 Eunseong Choi , Sunkyung Lee , Minjin Choi , June Park , Jongwuk Lee

Fusion-in-decoder (Fid) (Izacard and Grave, 2020) is a generative question answering (QA) model that leverages passage retrieval with a pre-trained transformer and pushed the state of the art on single-hop QA. However, the complexity of…

Computation and Language · Computer Science 2022-05-20 Semih Yavuz , Kazuma Hashimoto , Yingbo Zhou , Nitish Shirish Keskar , Caiming Xiong

Retrieval-augmented generation (RAG) has become a dominant paradigm for grounding large language models (LLMs) with external evidence in knowledge-intensive question answering. A core design choice is how to fuse retrieved samples into the…

Computation and Language · Computer Science 2026-02-16 Yixin Chen , Ying Xiong , Shangyu Wu , Xiangrui Ke , Nan Guan , Chun Jason Xue

Retrieval-based augmentations (RA) incorporating knowledge from an external database into language models have greatly succeeded in various knowledge-intensive (KI) tasks. However, integrating retrievals in non-knowledge-intensive (NKI)…

Computation and Language · Computer Science 2024-05-28 Shangyu Wu , Ying Xiong , Yufei Cui , Xue Liu , Buzhou Tang , Tei-Wei Kuo , Chun Jason Xue

Code generation aims to automatically generate code snippets of specific programming language according to natural language descriptions. The continuous advancements in deep learning, particularly pre-trained models, have empowered the code…

Software Engineering · Computer Science 2025-01-24 Zezhou Yang , Sirong Chen , Cuiyun Gao , Zhenhao Li , Xing Hu , Kui Liu , Xin Xia

Retrieval-augmented code generation often conditions the decoder on large retrieved code snippets. This ties online inference cost to repository size and introduces noise from long contexts. We present Hierarchical Embedding Fusion (HEF), a…

Computation and Language · Computer Science 2026-03-10 Nikita Sorokin , Ivan Sedykh , Valentin Malykh

We propose ListT5, a novel reranking approach based on Fusion-in-Decoder (FiD) that handles multiple candidate passages at both train and inference time. We also introduce an efficient inference framework for listwise ranking based on m-ary…

Information Retrieval · Computer Science 2024-06-07 Soyoung Yoon , Eunbi Choi , Jiyeon Kim , Hyeongu Yun , Yireun Kim , Seung-won Hwang

Attention-based recurrent neural encoder-decoder models present an elegant solution to the automatic speech recognition problem. This approach folds the acoustic model, pronunciation model, and language model into a single network and…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Shubham Toshniwal , Anjuli Kannan , Chung-Cheng Chiu , Yonghui Wu , Tara N Sainath , Karen Livescu

Recently, Transformer-based encoder-decoder models have demonstrated strong performance in multilingual speech recognition. However, the decoder's autoregressive nature and large size introduce significant bottlenecks during inference.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-28 Yunkyu Lim , Jihwan Park , Hyung Yong Kim , Hanbin Lee , Byeong-Yeol Kim

Attribution is crucial in question answering (QA) with Large Language Models (LLMs).SOTA question decomposition-based approaches use long form answers to generate questions for retrieving related documents. However, the generated questions…

Computation and Language · Computer Science 2025-11-17 Zhichao Yan , Jiaoyan Chen , Jiapu Wang , Xiaoli Li , Ru Li , Jeff Z. Pan

While Masked Diffusion Language Models (MDLMs) relying on token masking and unmasking have shown promise in language modeling, their computational efficiency and generation flexibility remain constrained by the masking paradigm. In this…

Computation and Language · Computer Science 2026-03-26 Fangyu Ding , Ding Ding , Sijin Chen , Kaibo Wang , Peng Xu , Zijin Feng , Haoli Bai , Kai Han , Youliang Yan , Binhang Yuan , Jiacheng Sun
‹ Prev 1 2 3 10 Next ›