English
Related papers

Related papers: Inference Scaling for Long-Context Retrieval Augme…

200 papers

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly…

Computation and Language · Computer Science 2025-06-05 Yucheng Chu , Peng He , Hang Li , Haoyu Han , Kaiqi Yang , Yu Xue , Tingting Li , Joseph Krajcik , Jiliang Tang

Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement…

Machine Learning · Computer Science 2025-10-15 Jeongyeon Hwang , Junyoung Park , Hyejin Park , Dongwoo Kim , Sangdon Park , Jungseul Ok

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Retrieval Augmented Generation (RAG) is a framework for incorporating external knowledge, usually in the form of a set of documents retrieved from a collection, as a part of a prompt to a large language model (LLM) to potentially improve…

Information Retrieval · Computer Science 2025-02-24 Fangzheng Tian , Debasis Ganguly , Craig Macdonald

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge to generate a response within a context with improved accuracy and reduced hallucinations. However, multi-modal RAG systems face…

Machine Learning · Computer Science 2025-01-09 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Retrieval Augmented Generation (RAG), a paradigm that integrates external contextual information with large language models (LLMs) to enhance factual accuracy and relevance, has emerged as a pivotal area in generative AI. The LLMs used in…

Computation and Language · Computer Science 2024-09-17 Xuan-Phi Nguyen , Shrey Pandit , Senthil Purushwalkam , Austin Xu , Hailin Chen , Yifei Ming , Zixuan Ke , Silvio Savarese , Caiming Xong , Shafiq Joty

Security applications are increasingly relying on large language models (LLMs) for cyber threat detection; however, their opaque reasoning often limits trust, particularly in decisions that require domain-specific cybersecurity knowledge.…

Cryptography and Security · Computer Science 2025-11-03 Arnabh Borah , Md Tanvirul Alam , Nidhi Rastogi

Retrieval Augmented Generation (RAG) systems have emerged as a powerful method for enhancing large language models (LLMs) with up-to-date information. However, the retrieval step in RAG can sometimes surface documents containing…

Computation and Language · Computer Science 2025-04-02 Vignesh Gokul , Srikanth Tenneti , Alwarappan Nakkiran

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Computation and Language · Computer Science 2025-09-30 Qinggang Zhang , Shengyuan Chen , Yuanchen Bei , Zheng Yuan , Huachi Zhou , Zijin Hong , Hao Chen , Yilin Xiao , Chuang Zhou , Junnan Dong , Yi Chang , Xiao Huang

Large language models (LLMs) with retrieval augmented-generation (RAG) have been the optimal choice for scalable generative AI solutions in the recent past. Although RAG implemented with AI agents (agentic-RAG) has been recently…

Artificial Intelligence · Computer Science 2024-11-19 Sohini Roychowdhury , Marko Krema , Anvar Mahammad , Brian Moore , Arijit Mukherjee , Punit Prakashchandra

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved at inference time. While RAG demonstrates strong performance on benchmarks largely derived from general-domain corpora…

Computation and Language · Computer Science 2025-07-29 Ran Xu , Yuchen Zhuang , Yue Yu , Haoyu Wang , Wenqi Shi , Carl Yang

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

Computation and Language · Computer Science 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Retrieval-Augmented Generation (RAG) has recently emerged as a method to extend beyond the pre-trained knowledge of Large Language Models by augmenting the original prompt with relevant passages or documents retrieved by an Information…

Large Vision-Language Models (LVLMs) have made remarkable strides in multimodal tasks such as visual question answering, visual grounding, and complex reasoning. However, they remain limited by static training data, susceptibility to…

Artificial Intelligence · Computer Science 2025-08-27 Chan-Wei Hu , Yueqi Wang , Shuo Xing , Chia-Ju Chen , Suofei Feng , Ryan Rossi , Zhengzhong Tu

The effectiveness of Large Language Models (LLMs) in generating accurate responses relies heavily on the quality of input provided, particularly when employing Retrieval Augmented Generation (RAG) techniques. RAG enhances LLMs by sourcing…

Information Retrieval · Computer Science 2024-08-02 Spurthi Setty , Harsh Thakkar , Alyssa Lee , Eden Chung , Natan Vidra

Long text classification is challenging for Large Language Models (LLMs) due to token limits and high computational costs. This study explores whether a Retrieval Augmented Generation (RAG) approach using only the most relevant text…

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-augmented generation (RAG) improves language model (LM) performance by providing relevant context at test time for knowledge-intensive situations. However, the relationship between parametric knowledge acquired during pretraining…

Computation and Language · Computer Science 2026-04-02 Karan Singh , Michael Yu , Varun Gangal , Zhuofu Tao , Sachin Kumar , Emmy Liu , Steven Y. Feng

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

Information Retrieval · Computer Science 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

The rapid increase in the number of parameters in large language models (LLMs) has significantly increased the cost involved in fine-tuning and retraining LLMs, a necessity for keeping models up to date and improving accuracy.…

Hardware Architecture · Computer Science 2024-12-17 Michael Shen , Muhammad Umar , Kiwan Maeng , G. Edward Suh , Udit Gupta