中文
相关论文

相关论文: ModernBERT + ColBERT: Enhancing biomedical RAG thr…

200 篇论文

Large Language Models (LLMs), although powerful in general domains, often perform poorly on domain-specific tasks such as medical question answering (QA). In addition, LLMs tend to function as "black-boxes", making it challenging to modify…

计算与语言 · 计算机科学 2024-08-19 Yucheng Shi , Shaochen Xu , Tianze Yang , Zhengliang Liu , Tianming Liu , Quanzheng Li , Xiang Li , Ninghao Liu

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Large Language Models (LLMs) excel at reasoning and generation but are inherently limited by static pretraining data, resulting in factual inaccuracies and weak adaptability to new information. Retrieval-Augmented Generation (RAG) addresses…

计算与语言 · 计算机科学 2025-11-03 Qi Luo , Xiaonan Li , Yuxin Wang , Tingshuo Fan , Yuan Li , Xinchi Chen , Xipeng Qiu

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

信息检索 · 计算机科学 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

The effectiveness of Large Language Models (LLMs) in generating accurate responses relies heavily on the quality of input provided, particularly when employing Retrieval Augmented Generation (RAG) techniques. RAG enhances LLMs by sourcing…

信息检索 · 计算机科学 2024-08-02 Spurthi Setty , Harsh Thakkar , Alyssa Lee , Eden Chung , Natan Vidra

Large Language Models (LLMs) are smart but forgetful. Recent studies, (e.g., (Bubeck et al., 2023)) on modern LLMs have shown that they are capable of performing amazing tasks typically necessitating human-level intelligence. However,…

计算与语言 · 计算机科学 2023-11-08 Eric Melz

Retrieval-augmented generation (RAG) generally enhances large language models' (LLMs) ability to solve knowledge-intensive tasks. But RAG may also lead to performance degradation due to imperfect retrieval and the model's limited ability to…

计算与语言 · 计算机科学 2025-05-29 Shuyang Cao , Karthik Radhakrishnan , David Rosenberg , Steven Lu , Pengxiang Cheng , Lu Wang , Shiyue Zhang

This paper presents a comprehensive study of Retrieval-Augmented Generation (RAG), tracing its evolution from foundational concepts to the current state of the art. RAG combines retrieval mechanisms with generative language models to…

计算与语言 · 计算机科学 2024-10-18 Shailja Gupta , Rajesh Ranjan , Surya Narayan Singh

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-only…

信息检索 · 计算机科学 2025-04-15 Lang Mei , Siyu Mo , Zhihan Yang , Chong Chen

Large language models (LLMs) have shown promise in medical question answering but often struggle with hallucinations and shallow reasoning, particularly in tasks requiring nuanced clinical understanding. Retrieval-augmented generation (RAG)…

计算与语言 · 计算机科学 2025-08-25 Ziyu Wang , Elahe Khatibi , Amir M. Rahmani

Retrieval Augmented Generation (RAG) frameworks have shown significant promise in leveraging external knowledge to enhance the performance of large language models (LLMs). However, conventional RAG methods often retrieve documents based…

计算与语言 · 计算机科学 2025-04-02 Pouya Pezeshkpour , Estevam Hruschka

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Retrieval augmented generation (RAG) has been applied in many scenarios to augment large language models (LLMs) with external documents provided by retrievers. However, a semantic gap exists between LLMs and retrievers due to differences in…

计算与语言 · 计算机科学 2024-10-31 Fuda Ye , Shuangyin Li , Yongqi Zhang , Lei Chen

The Retrieval-Augmented Generation (RAG) framework introduces a retrieval module to dynamically inject retrieved information into the input context of large language models (LLMs), and has demonstrated significant success in various NLP…

信息检索 · 计算机科学 2025-05-27 Yi Jiang , Sendong Zhao , Jianbo Li , Haochun Wang , Bing Qin

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external…

The retrieval-augmented generation (RAG) enables retrieval of relevant information from an external knowledge source and allows large language models (LLMs) to answer queries over previously unseen document collections. However, it was…

计算与语言 · 计算机科学 2025-04-03 Mykhailo Poliakov , Nadiya Shvai

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

计算与语言 · 计算机科学 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-augmented generation (RAG) systems have been shown to be effective in addressing many of the drawbacks of relying solely on the parametric memory of large language models. Recent work has demonstrated that RAG systems can be…

The question-answering system for Life science research, which is characterized by the rapid pace of discovery, evolving insights, and complex interactions among knowledge entities, presents unique challenges in maintaining a comprehensive…

计算与语言 · 计算机科学 2024-08-15 Chengrui Wang , Qingqing Long , Meng Xiao , Xunxin Cai , Chengjun Wu , Zhen Meng , Xuezhi Wang , Yuanchun Zhou

Although Large Language Models (LLMs) demonstrate significant capabilities, their reliance on parametric knowledge often leads to inaccuracies. Retrieval Augmented Generation (RAG) mitigates this by incorporating external knowledge, but…

人工智能 · 计算机科学 2025-11-04 Hailong Yin , Bin Zhu , Jingjing Chen , Chong-Wah Ngo