中文
相关论文

相关论文: LongRAG: Enhancing Retrieval-Augmented Generation …

200 篇论文

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

计算与语言 · 计算机科学 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

While RAG demonstrates remarkable capabilities in LLM applications, its effectiveness is hindered by the ever-increasing length of retrieved contexts, which introduces information redundancy and substantial computational overhead. Existing…

计算与语言 · 计算机科学 2025-10-28 Yixiong Fang , Tianran Sun , Yuling Shi , Xiaodong Gu

Large language models (LLMs) augmented with retrieval exhibit robust performance and extensive versatility by incorporating external contexts. However, the input length grows linearly in the number of retrieved documents, causing a dramatic…

计算与语言 · 计算机科学 2024-05-28 Yun Zhu , Jia-Chen Gu , Caitlin Sikora , Ho Ko , Yinxiao Liu , Chu-Cheng Lin , Lei Shu , Liangchen Luo , Lei Meng , Bang Liu , Jindong Chen

Retrieval-Augmented Generation (RAG) has demonstrated considerable effectiveness in open-domain question answering. However, when applied to heterogeneous documents, comprising both textual and tabular components, existing RAG approaches…

计算与语言 · 计算机科学 2025-10-01 Xiaohan Yu , Pu Jian , Chong Chen

Recent advances in Large Language Models (LLMs) have significantly improved complex reasoning capabilities. Retrieval-Augmented Generation (RAG) has further extended these capabilities by grounding generation in dynamically retrieved…

计算与语言 · 计算机科学 2026-02-23 Jash Rajesh Parekh , Pengcheng Jiang , Jiawei Han

With the advent of large language models (LLMs) and multimodal large language models (MLLMs), the potential of retrieval-augmented generation (RAG) has attracted considerable research attention. Various novel algorithms and models have been…

计算与语言 · 计算机科学 2025-02-25 Jiajie Jin , Yutao Zhu , Guanting Dong , Yuyao Zhang , Xinyu Yang , Chenghao Zhang , Tong Zhao , Zhao Yang , Zhicheng Dou , Ji-Rong Wen

Retrieval-Augmented Generation (RAG) has emerged as a standard framework for knowledge-intensive NLP tasks, combining large language models (LLMs) with document retrieval from external corpora. Despite its widespread use, most RAG pipelines…

信息检索 · 计算机科学 2025-08-26 Mandeep Rathee , V Venktesh , Sean MacAvaney , Avishek Anand

Recent advancements in large language models (LLMs) and multi-modal LLMs have been remarkable. However, these models still rely solely on their parametric knowledge, which limits their ability to generate up-to-date information and…

人工智能 · 计算机科学 2025-04-22 Zihan Ling , Zhiyao Guo , Yixuan Huang , Yi An , Shuai Xiao , Jinsong Lan , Xiaoyong Zhu , Bo Zheng

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

计算与语言 · 计算机科学 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Multimodal Large Language Models (MLLMs) perform well in video understanding but degrade on long videos due to fixed-length context and weak long-term dependency modeling. Retrieval-Augmented Generation (RAG) can expand knowledge…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Zhucun Xue , Jiangning Zhang , Xurong Xie , Yuxuan Cai , Yong Liu , Xiangtai Li , Dacheng Tao

Retrieval-Augmented Generation (RAG) has been used in question answering (QA) systems to improve performance when relevant information is in one (single-hop) or multiple (multi-hop) passages. However, many real life scenarios (e.g. dealing…

计算与语言 · 计算机科学 2026-04-02 Mykolas Sveistrys , Richard Kunert

Large Language Models (LLMs) have demonstrated remarkable capabilities in leveraging extensive external knowledge to enhance responses in multi-turn and agentic applications, such as retrieval-augmented generation (RAG). However, processing…

计算与语言 · 计算机科学 2025-10-14 Xiaoqiang Lin , Aritra Ghosh , Bryan Kian Hsiang Low , Anshumali Shrivastava , Vijai Mohan

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

In the field of Material Science, effective information retrieval systems are essential for facilitating research. Traditional Retrieval-Augmented Generation (RAG) approaches in Large Language Models (LLMs) often encounter challenges such…

信息检索 · 计算机科学 2024-12-03 Radeen Mostafa , Mirza Nihal Baig , Mashaekh Tausif Ehsan , Jakir Hasan

Document Visual Question Answering (Document VQA) must cope with documents that span dozens of pages, yet leading systems still concatenate every page or rely on very large vision-language models, both of which are memory-hungry.…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Eric López , Artemis Llabrés , Ernest Valveny

LLM agents require retrieval to behave less like one-shot context fetching and more like reasoning: searching, reading, traversing, and deciding when evidence is sufficient. Yet current Retrieval-Augmented Generation (RAG) systems organize…

计算与语言 · 计算机科学 2026-05-27 Haoliang Ming , Feifei Li , Xiaoqing Wu , Wenhui Que

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and…

计算与语言 · 计算机科学 2024-04-09 Pouria Rouzrokh , Shahriar Faghani , Cooper U. Gamble , Moein Shariatnia , Bradley J. Erickson

Technology-enhanced learning environments often help students retrieve relevant learning content for questions arising during self-paced study. Large language models (LLMs) have emerged as novel aids for information retrieval during…

信息检索 · 计算机科学 2025-09-29 Eason Chen , Chuangji Li , Shizhuo Li , Zimo Xiao , Jionghao Lin , Kenneth R. Koedinger

Retrieval-augmented generation (RAG) systems combine large language models (LLMs) with external knowledge retrieval, making them highly effective for knowledge-intensive tasks. A crucial but often under-explored component of these systems…

计算与语言 · 计算机科学 2025-05-19 Jiashuo Sun , Xianrui Zhong , Sizhe Zhou , Jiawei Han

Large language models (LLMs) often need to incorporate external knowledge to solve theme-specific problems. Retrieval-augmented generation (RAG) has shown its high promise, empowering LLMs to generate more qualified responses with retrieved…

机器学习 · 计算机科学 2025-08-05 Jimeng Shi , Sizhe Zhou , Bowen Jin , Wei Hu , Runchu Tian , Shaowen Wang , Giri Narasimhan , Jiawei Han