English
Related papers

Related papers: Efficient and Effective Internal Memory Retrieval …

200 papers

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

Computation and Language · Computer Science 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Large language models (LLMs) are transforming the landscape of medicine, yet two fundamental challenges persist: keeping up with rapidly evolving medical knowledge and providing verifiable, evidence-grounded reasoning. Retrieval-augmented…

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Retrieval-augmented generation (RAG) has emerged as a promising technology for addressing hallucination issues in the responses generated by large language models (LLMs). Existing studies on RAG primarily focus on applying semantic-based…

Computation and Language · Computer Science 2025-02-12 Xiangrong Zhu , Yuexiang Xie , Yi Liu , Yaliang Li , Wei Hu

As large language models (LLMs) continue to grow in size, their abilities to tackle complex tasks have significantly improved. However, issues such as hallucination and the lack of up-to-date knowledge largely remain unresolved. Knowledge…

Artificial Intelligence · Computer Science 2026-03-17 Lihui Liu

Large pre-trained language models have demonstrated their proficiency in storing factual knowledge within their parameters and achieving remarkable results when fine-tuned for downstream natural language processing tasks. Nonetheless, their…

Computation and Language · Computer Science 2023-09-29 Konstantinos Andriopoulos , Johan Pouwelse

This paper presents the development and evaluation of a Retrieval-Augmented Generation (RAG) system for querying the United Kingdom's National Institute for Health and Care Excellence (NICE) clinical guidelines using Large Language Models…

Retrieval-Augmented Language Modeling (RALM) by integrating large language models (LLM) with relevant documents from an external corpus is a proven method for enabling the LLM to generate information beyond the scope of its pre-training…

Computation and Language · Computer Science 2025-06-16 Runheng Liu , Xingchen Xiao , Heyan Huang , Zewen Chi , Zhijing Wu

Retrieval-Augmented Generation (RAG), which integrates external knowledge into Large Language Models (LLMs), has proven effective in enabling LLMs to produce more accurate and reliable responses. However, it remains a significant challenge…

Computation and Language · Computer Science 2025-02-11 Yan Weng , Fengbin Zhu , Tong Ye , Haoyan Liu , Fuli Feng , Tat-Seng Chua

Purpose: Large Language Models (LLMs) hold significant promise for medical applications. Retrieval Augmented Generation (RAG) emerges as a promising approach for customizing domain knowledge in LLMs. This case study presents the development…

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

Information Retrieval · Computer Science 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

Large Language Models (LLMs) and Code-LLMs (CLLMs) have significantly improved code generation, but, they frequently face difficulties when dealing with challenging and complex problems. Retrieval-Augmented Generation (RAG) addresses this…

Software Engineering · Computer Science 2025-06-17 Iman Saberi , Fatemeh Fard

The integration of Large Language Models (LLMs) into the public health policy sector offers a transformative approach to navigating the vast repositories of regulatory guidance maintained by agencies such as the Centers for Disease Control…

Computation and Language · Computer Science 2026-01-23 Anuj Maharjan , Umesh Yadav

Large language models (LLMs) encapsulate a vast amount of factual information within their pre-trained weights, as evidenced by their ability to answer diverse questions across different domains. However, this knowledge is inherently…

Artificial Intelligence · Computer Science 2024-01-31 Oded Ovadia , Menachem Brief , Moshik Mishaeli , Oren Elisha

Retrieval-augmented generation (RAG) is a common strategy to reduce hallucinations in Large Language Models (LLMs). While reinforcement learning (RL) can enable LLMs to act as search agents by activating retrieval capabilities, existing…

Computation and Language · Computer Science 2025-05-13 Ziyang Huang , Xiaowei Yuan , Yiming Ju , Jun Zhao , Kang Liu

Large language models (LLMs) have revolutionized natural language processing, yet hallucinations in knowledge-intensive tasks remain a critical challenge. Retrieval-augmented generation (RAG) addresses this by integrating external…

Computation and Language · Computer Science 2026-02-17 Zhipeng Song , Xiangyu Kong , Xinrui Bao , Yizhi Zhou , Jiulong Jiao , Sitong Liu , Yuhang Zhou , Heng Qi

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

Security applications are increasingly relying on large language models (LLMs) for cyber threat detection; however, their opaque reasoning often limits trust, particularly in decisions that require domain-specific cybersecurity knowledge.…

Cryptography and Security · Computer Science 2025-11-03 Arnabh Borah , Md Tanvirul Alam , Nidhi Rastogi

With powerful and integrative large language models (LLMs), medical AI agents have demonstrated unique advantages in providing personalized medical consultations, continuous health monitoring, and precise treatment plans.…

Hardware Architecture · Computer Science 2025-11-03 Zhipeng Liao , Kunming Shao , Jiangnan Yu , Liang Zhao , Tim Kwang-Ting Cheng , Chi-Ying Tsui , Jie Yang , Mohamad Sawan

This study develops a question-answering system based on Retrieval-Augmented Generation (RAG) using Chinese Wikipedia and Lawbank as retrieval sources. Using TTQA and TMMLU+ as evaluation datasets, the system employs BGE-M3 for dense vector…

Information Retrieval · Computer Science 2025-01-17 Te-Lun Yang , Jyi-Shane Liu , Yuen-Hsien Tseng , Jyh-Shing Roger Jang