English
Related papers

Related papers: Adaptive Guidance for Retrieval-Augmented Masked D…

200 papers

Retrieval-Augmented Generation (RAG) has become an essential approach for extending the reasoning and knowledge capacity of large language models (LLMs). While prior research has primarily focused on retrieval quality and prompting…

Computation and Language · Computer Science 2025-12-09 Jiamin Chen , Yuchen Li , Xinyu Ma , Xinran Chen , Xiaokun Zhang , Shuaiqiang Wang , Chen Ma , Dawei Yin

The scaling of large language models to encode all the world's knowledge in model parameters is unsustainable and has exacerbated resource barriers. Retrieval-Augmented Generation (RAG) presents a potential solution, yet its application to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Varun Nagaraj Rao , Siddharth Choudhary , Aditya Deshpande , Ravi Kumar Satzoda , Srikar Appalaraju

Retrieval-Augmented Generation (RAG) enhances language models by retrieving and incorporating relevant external knowledge. However, traditional retrieve-and-generate processes may not be optimized for real-world scenarios, where queries…

Computation and Language · Computer Science 2025-02-28 Ingeol Baek , Hwan Chang , Byeongjeong Kim , Jimin Lee , Hwanhee Lee

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm to enhance large language models (LLMs) by conditioning generation on external evidence retrieved at inference time. While RAG addresses critical limitations of…

Information Retrieval · Computer Science 2025-06-03 Chaitanya Sharma

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources to address their limitations in accessing up-to-date or specialized information. A natural strategy to increase the…

Computation and Language · Computer Science 2025-11-10 Song Wang , Zihan Chen , Peng Wang , Zhepei Wei , Zhen Tan , Yu Meng , Cong Shen , Jundong Li

Retrieval-Augmented Generation (RAG) improves reliability of large language models by incorporating external knowledge, but the retrieval process can introduce bias that propagates to generated outputs. This issue is particularly…

Databases · Computer Science 2026-05-18 Yingqi Zhao , Vasilis Efthymiou , Jyrki Nummenmaa , Kostas Stefanidis

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the…

Information Retrieval · Computer Science 2025-08-26 Leqian Li , Dianxi Shi , Jialu Zhou , Xinyu Wei , Mingyue Yang , Songchang Jin , Shaowu Yang

Despite the success of integrating large language models into the development of conversational systems, many studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses. Hence, many…

Computation and Language · Computer Science 2024-08-01 Xi Wang , Procheta Sen , Ruizhe Li , Emine Yilmaz

Retrieval-augmented generation (RAG) often falls short when retrieved context includes confusing semi-relevant passages, or when answering questions require deep contextual understanding and reasoning. We propose an efficient fine-tuning…

Computation and Language · Computer Science 2025-07-28 Mohammad Kachuee , Teja Gollapudi , Minseok Kim , Yin Huang , Kai Sun , Xiao Yang , Jiaqi Wang , Nirav Shah , Yue Liu , Aaron Colak , Anuj Kumar , Wen-tau Yih , Xin Luna Dong

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

Information Retrieval · Computer Science 2026-05-19 Yizheng Huang , Jimmy Huang

Retrieval-augmented generation (RAG) incorporates external knowledge into large language models (LLMs), improving their adaptability to downstream tasks and enabling information updates. Surprisingly, recent empirical evidence demonstrates…

Computation and Language · Computer Science 2026-01-08 Yang Sun , Zhiyong Xie , Lixin Zou , Dan Luo , Min Tang , Xiangyu Zhao , Yunwei Zhao , Xixun Lin , Yanxiong Lu , Chenliang Li

Retrieval-augmented generation (RAG) enhances the capabilities of large language models (LLMs) by incorporating external knowledge into their input prompts. However, when the retrieved context contradicts the LLM's parametric knowledge, it…

Computation and Language · Computer Science 2025-09-29 Eunseong Choi , June Park , Hyeri Lee , Jongwuk Lee

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Bearing in mind the limited parametric knowledge of Large Language Models (LLMs), retrieval-augmented generation (RAG) which supplies them with the relevant external knowledge has served as an approach to mitigate the issue of…

Computation and Language · Computer Science 2025-01-10 Hanna Zubkova , Ji-Hoon Park , Seong-Whan Lee

Retrieval-augmented large language models (LLMs) have been remarkably competent in various NLP tasks. However, it was observed by previous works that retrieval is not always helpful, especially when the LLM is already knowledgeable on the…

Computation and Language · Computer Science 2024-12-16 Chengkai Huang , Yu Xia , Rui Wang , Kaige Xie , Tong Yu , Julian McAuley , Lina Yao

With the rapid advancement of Multi-modal Large Language Models (MLLMs), their capability in understanding both images and text has greatly improved. However, their potential for leveraging multi-modal contextual information in…

Artificial Intelligence · Computer Science 2025-08-08 Zhenghao Liu , Xingsheng Zhu , Tianshuo Zhou , Xinyi Zhang , Xiaoyuan Yi , Yukun Yan , Ge Yu , Maosong Sun

Speech recognition systems often face challenges due to domain mismatch, particularly in real-world applications where domain-specific data is unavailable because of data accessibility and confidentiality constraints. Inspired by…

Computation and Language · Computer Science 2025-02-24 Peng Shen , Xugang Lu , Hisashi Kawai

Large language models (LLM) hold significant potential for applications in biomedicine, but they struggle with hallucinations and outdated knowledge. While retrieval-augmented generation (RAG) is generally employed to address these issues,…

Computation and Language · Computer Science 2025-09-23 Jiwoong Sohn , Yein Park , Chanwoong Yoon , Sihyeon Park , Hyeon Hwang , Mujeen Sung , Hyunjae Kim , Jaewoo Kang

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies…

Computation and Language · Computer Science 2025-10-10 Shuo Yu , Mingyue Cheng , Qi Liu , Daoyu Wang , Jiqian Yang , Jie Ouyang , Yucong Luo , Chenyi Lei , Enhong Chen

Retrieval-Augmented Generation (RAG) improves the factual accuracy of large language model (LLM) outputs by grounding generation in external knowledge. Recent agentic RAG systems extend this paradigm with critical agents to evaluate model…

Information Retrieval · Computer Science 2026-05-20 Gongbo Zhang , Yifan Peng , Chunhua Weng