English
Related papers

Related papers: Leveraging Fine-Tuned Retrieval-Augmented Generati…

200 papers

Large language models (LLMs) are transforming the landscape of medicine, yet two fundamental challenges persist: keeping up with rapidly evolving medical knowledge and providing verifiable, evidence-grounded reasoning. Retrieval-augmented…

This paper investigates the impact of domain-specific model fine-tuning and of reasoning mechanisms on the performance of question-answering (Q&A) systems powered by large language models (LLMs) and Retrieval-Augmented Generation (RAG).…

Artificial Intelligence · Computer Science 2024-04-23 Zooey Nguyen , Anthony Annunziata , Vinh Luong , Sang Dinh , Quynh Le , Anh Hai Ha , Chanh Le , Hong An Phan , Shruti Raghavan , Christopher Nguyen

Retrieval-Augmented Generation (RAG) enhances the accuracy of Large Language Model (LLM) responses by leveraging relevant external documents during generation. Although previous studies noted that retrieving many documents can degrade…

Computation and Language · Computer Science 2025-12-01 Shahar Levy , Nir Mazor , Lihi Shalmon , Michael Hassid , Gabriel Stanovsky

With the rapid advancement of Multi-modal Large Language Models (MLLMs), their capability in understanding both images and text has greatly improved. However, their potential for leveraging multi-modal contextual information in…

Artificial Intelligence · Computer Science 2025-08-08 Zhenghao Liu , Xingsheng Zhu , Tianshuo Zhou , Xinyi Zhang , Xiaoyuan Yi , Yukun Yan , Ge Yu , Maosong Sun

Retrieval-Augmented Generation (RAG) systems have recently shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.…

Computation and Language · Computer Science 2025-01-14 Siran Li , Linus Stenzel , Carsten Eickhoff , Seyed Ali Bahrainian

Retrieval Augmented Generation (RAG) is a promising technique for mitigating two key limitations of large language models (LLMs): outdated information and hallucinations. RAG system stores documents as embedding vectors in a database. Given…

Information Retrieval · Computer Science 2026-02-10 Taehee Jeong , Xingzhe Zhao , Peizu Li , Markus Valvur , Weihua Zhao

Retrieval-augmented generation (RAG) extends large language models (LLMs) with external knowledge, but it must balance limited effective context, redundant retrieved evidence, and the loss of fine-grained facts under aggressive compression.…

Computation and Language · Computer Science 2026-04-24 Yiqiao Jin , Rachneet Kaur , Zhen Zeng , Sumitra Ganesh , Srijan Kumar

Retrieval-augmented generation (RAG) enhances LLMs with external knowledge, yet generation remains vulnerable to retrieval-induced noise and uncertain placement of relevant chunks, often causing hallucinations. We present Ext2Gen, an…

Computation and Language · Computer Science 2025-11-18 Hwanjun Song , Jeonghwan Choi , Minseok Kim

Medical question-answering (QA) systems can benefit from advances in large language models (LLMs), but directly applying LLMs to the clinical domain poses challenges such as maintaining factual accuracy and avoiding hallucinations. In this…

Computation and Language · Computer Science 2025-12-08 Tasnimul Hassan , Md Faisal Karim , Haziq Jeelani , Elham Behnam , Robert Green , Fayeq Jeelani Syed

Retrieval-Augmented Generation (RAG) systems often struggle to handle multi-hop question-answering tasks accurately due to irrelevant context retrieval and limited complex reasoning capabilities. We introduce Collab-RAG, a collaborative…

Computation and Language · Computer Science 2025-04-08 Ran Xu , Wenqi Shi , Yuchen Zhuang , Yue Yu , Joyce C. Ho , Haoyu Wang , Carl Yang

The integration of Large Language Models (LLMs) into the public health policy sector offers a transformative approach to navigating the vast repositories of regulatory guidance maintained by agencies such as the Centers for Disease Control…

Computation and Language · Computer Science 2026-01-23 Anuj Maharjan , Umesh Yadav

The scaling of Large Language Models (LLMs) for retrieval-based tasks, particularly in Retrieval Augmented Generation (RAG), faces significant memory constraints, especially when fine-tuning extensive prompt sequences. Current open-source…

Machine Learning · Computer Science 2024-03-20 Anique Tahir , Lu Cheng , Huan Liu

Retrieval-augmented generation (RAG) with large language models (LLMs) has demonstrated strong performance in multilingual question-answering (QA) tasks by leveraging relevant passages retrieved from corpora. In multilingual RAG (mRAG), the…

Computation and Language · Computer Science 2025-12-12 Jirui Qi , Raquel Fernández , Arianna Bisazza

Artificial intelligence (AI) and wireless networking advancements have created new opportunities to enhance network efficiency and performance. In this paper, we introduce Next-Generation GPT (NextG-GPT), an innovative framework that…

Emerging Technologies · Computer Science 2025-05-27 Ahmad M. Nazar , Mohamed Y. Selim , Daji Qiao , Hongwei Zhang

Context. Risk analysis assesses potential risks in specific scenarios. Risk analysis principles are context-less; the same methodology can be applied to a risk connected to health and information technology security. Risk analysis requires…

Computation and Language · Computer Science 2024-09-10 Matteo Esposito , Francesco Palagiano , Valentina Lenarduzzi , Davide Taibi

Large-scale language models (LLMs) have achieved remarkable success across various language tasks but suffer from hallucinations and temporal misalignment. To mitigate these shortcomings, Retrieval-augmented generation (RAG) has been…

Computation and Language · Computer Science 2024-04-30 Zhongzhen Huang , Kui Xue , Yongqi Fan , Linjie Mu , Ruoyu Liu , Tong Ruan , Shaoting Zhang , Xiaofan Zhang

Small language models (SLMs) support efficient deployments on resource-constrained edge devices, but their limited capacity compromises inference performance. Retrieval-augmented generation (RAG) is a promising solution to enhance model…

Machine Learning · Computer Science 2025-04-17 Shangyu Liu , Zhenzhe Zheng , Xiaoyao Huang , Fan Wu , Guihai Chen , Jie Wu

The versatility of large language models (LLMs) has been explored across various sectors, but their application in healthcare poses challenges, particularly in the domain of pharmaceutical contraindications where accurate and reliable…

Artificial Intelligence · Computer Science 2025-08-11 Byeonghun Bang , Jongsuk Yoon , Dong-Jin Chang , Seho Park , Yong Oh Lee

We introduce a novel retrieval-augmented generation (RAG) framework tailored for multihop question answering. First, our system uses large language model (LLM) to decompose complex multihop questions into a sequence of single-hop…

Computation and Language · Computer Science 2025-08-14 Seokgi Lee

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou