English
Related papers

Related papers: REAR: A Relevance-Aware Retrieval-Augmented Framew…

200 papers

Retrieval augmented generation (RAG) systems provide a method for factually grounding the responses of a Large Language Model (LLM) by providing retrieved evidence, or context, as support. Guided by this context, RAG systems can reduce…

Information Retrieval · Computer Science 2025-09-05 Shakiba Amirshahi , Amin Bigdeli , Charles L. A. Clarke , Amira Ghenai

Large Language Models (LLMs) are capable of natural language understanding and generation. But they face challenges such as hallucination and outdated knowledge. Fine-tuning is one possible solution, but it is resource-intensive and must be…

Computation and Language · Computer Science 2025-07-01 Shadman Sobhan , Mohammad Ariful Haque

Retrieval-augmented generation (RAG) is typically optimized for topical relevance, yet its success ultimately depends on whether retrieved passages are useful for a large language model (LLM) to generate correct and complete answers. We…

Computation and Language · Computer Science 2026-01-28 Hengran Zhang , Keping Bi , Jiafeng Guo , Jiaming Zhang , Shuaiqiang Wang , Dawei Yin , Xueqi Cheng

In the field of Material Science, effective information retrieval systems are essential for facilitating research. Traditional Retrieval-Augmented Generation (RAG) approaches in Large Language Models (LLMs) often encounter challenges such…

Information Retrieval · Computer Science 2024-12-03 Radeen Mostafa , Mirza Nihal Baig , Mashaekh Tausif Ehsan , Jakir Hasan

Security applications are increasingly relying on large language models (LLMs) for cyber threat detection; however, their opaque reasoning often limits trust, particularly in decisions that require domain-specific cybersecurity knowledge.…

Cryptography and Security · Computer Science 2025-11-03 Arnabh Borah , Md Tanvirul Alam , Nidhi Rastogi

Retrieval-Augmented Generation (RAG) addresses limitations of large language models (LLMs) by leveraging a vector database to provide more accurate and up-to-date information. When a user submits a query, RAG executes a vector search to…

Artificial Intelligence · Computer Science 2025-06-18 Taehee Jeong

Retrieval-Augmented Generation (RAG) enhances the performance of Large Language Models (LLMs) by incorporating external knowledge. However, LLMs still encounter challenges in effectively utilizing the knowledge from retrieved documents,…

Computation and Language · Computer Science 2025-02-26 Mingyan Wu , Zhenghao Liu , Yukun Yan , Xinze Li , Shi Yu , Zheni Zeng , Yu Gu , Ge Yu

Recent advancements in Retrieval-Augmented Generation (RAG) have revolutionized natural language processing by integrating Large Language Models (LLMs) with external information retrieval, enabling accurate, up-to-date, and verifiable text…

Computation and Language · Computer Science 2025-04-22 Aoran Gan , Hao Yu , Kai Zhang , Qi Liu , Wenyu Yan , Zhenya Huang , Shiwei Tong , Guoping Hu

Retrieval-Augmented Generation has shown remarkable results to address Large Language Models' hallucinations, which usually uses a large external corpus to supplement knowledge to LLMs. However, with the development of LLMs, the internal…

Computation and Language · Computer Science 2026-01-26 Qi Luo , Xiaonan Li , Junqi Dai , Shuang Cheng , Xipeng Qiu

Large Language Models~(LLMs) are prone to hallucinations, and Retrieval-Augmented Generation (RAG) helps mitigate this, but at a high computational cost while risking misinformation. Adaptive retrieval aims to retrieve only when necessary,…

Retrieval-Augmented Generation (RAG) can alleviate hallucinations of Large Language Models (LLMs) by referencing external documents. However, the misinformation in external documents may mislead LLMs' generation. To address this issue, we…

Computation and Language · Computer Science 2024-12-18 Boyi Deng , Wenjie Wang , Fengbin Zhu , Qifan Wang , Fuli Feng

Retrieval-augmented generation (RAG) has increasingly shown its power in extending large language models' (LLMs') capability beyond their pre-trained knowledge. Existing works have shown that RAG can help with software development tasks…

Software Engineering · Computer Science 2025-03-20 Jingyi Chen , Songqiang Chen , Jialun Cao , Jiasi Shen , Shing-Chi Cheung

We propose EAR, a query Expansion And Reranking approach for improving passage retrieval, with the application to open-domain question answering. EAR first applies a query expansion model to generate a diverse set of queries, and then uses…

Computation and Language · Computer Science 2023-05-29 Yung-Sung Chuang , Wei Fang , Shang-Wen Li , Wen-tau Yih , James Glass

Recent advancements in large language models (LLMs) and multi-modal LLMs have been remarkable. However, these models still rely solely on their parametric knowledge, which limits their ability to generate up-to-date information and…

Artificial Intelligence · Computer Science 2025-04-22 Zihan Ling , Zhiyao Guo , Yixuan Huang , Yi An , Shuai Xiao , Jinsong Lan , Xiaoyong Zhu , Bo Zheng

Large Language Models (LLMs) have greatly contributed to the development of adaptive intelligent agents and are positioned as an important way to achieve Artificial General Intelligence (AGI). However, LLMs are prone to produce factually…

Computation and Language · Computer Science 2024-08-29 Weijian Xie , Xuefeng Liang , Yuhui Liu , Kaihua Ni , Hong Cheng , Zetian Hu

Recent Retrieval Augmented Generation (RAG) aims to enhance Large Language Models (LLMs) by incorporating extensive knowledge retrieved from external sources. However, such approach encounters some challenges: Firstly, the original queries…

Computation and Language · Computer Science 2024-10-10 Bolei He , Nuo Chen , Xinran He , Lingyong Yan , Zhenkai Wei , Jinchang Luo , Zhen-Hua Ling

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-augmented generation (RAG) is a prevalent approach for building LLM-based question-answering systems that can take advantage of external knowledge databases. Due to the complexity of real-world RAG systems, there are many…

Computation and Language · Computer Science 2026-01-16 Kin Kwan Leung , Mouloud Belbahri , Yi Sui , Alex Labach , Xueying Zhang , Stephen Anthony Rose , Jesse C. Cresswell

Large language models (LLMs) have recently become the leading source of answers for users' questions online. Despite their ability to offer eloquent answers, their accuracy and reliability can pose a significant challenge. This is…

Computation and Language · Computer Science 2024-07-09 Bojana Bašaragin , Adela Ljajić , Darija Medvecki , Lorenzo Cassano , Miloš Košprdić , Nikola Milošević

Retrieval Augmented Generation (RAG) is a common method for integrating external knowledge into pretrained Large Language Models (LLMs) to enhance accuracy and relevancy in question answering (QA) tasks. However, prompt engineering and…

Computation and Language · Computer Science 2024-10-18 Isaac Chung , Phat Vo , Arman C. Kizilkale , Aaron Reite