中文
相关论文

相关论文: ECoRAG: Evidentiality-guided Compression for Long …

200 篇论文

Long text classification is challenging for Large Language Models (LLMs) due to token limits and high computational costs. This study explores whether a Retrieval Augmented Generation (RAG) approach using only the most relevant text…

Large Language Models (LLMs) are adept at generating responses based on information within their context. While this ability is useful for interacting with structured data like code files, another popular method, Retrieval-Augmented…

计算与语言 · 计算机科学 2025-10-22 Mihir Gupte , Paolo Giusto , Ramesh S

Large language models (LLMs) often suffer from hallucination, generating factually incorrect statements when handling questions beyond their knowledge and perception. Retrieval-augmented generation (RAG) addresses this by retrieving…

计算与语言 · 计算机科学 2025-11-18 Shengyuan Chen , Chuang Zhou , Zheng Yuan , Qinggang Zhang , Zeyang Cui , Hao Chen , Yilin Xiao , Jiannong Cao , Xiao Huang

Managing extensive context remains a critical bottleneck for Large Language Models (LLMs), particularly in applications like long-document question answering and autonomous agents where lengthy inputs incur high computational costs and…

计算与语言 · 计算机科学 2026-01-06 Yiqing Zhou , Yu Lei , Shuzheng Si , Qingyan Sun , Wei Wang , Yifei Wu , Hao Wen , Gang Chen , Fanchao Qi , Maosong Sun

With the rapid advancement of large language models (LLMs), retrieval-augmented generation (RAG) has emerged as a critical approach to supplement the inherent knowledge limitations of LLMs. However, due to the typically large volume of…

计算与语言 · 计算机科学 2025-11-11 Yuhao Wang , Ruiyang Ren , Yucheng Wang , Jing Liu , Wayne Xin Zhao , Hua Wu , Haifeng Wang

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

计算与语言 · 计算机科学 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Retrieval-Augmented Generation (RAG) effectively grounds Large Language Models (LLMs) with external knowledge and is widely applied to Web-related tasks. However, its scalability is hindered by excessive context length and redundant…

计算与语言 · 计算机科学 2026-03-24 Yunhao Liu , Zian Jia , Xinyu Gao , Kanjun Xu , Yun Xiong

Retrieval-augmented generation (RAG) has emerged as a critical mechanism in contemporary NLP to support Large Language Models(LLMs) in systematically accessing richer factual context. However, the integration of RAG mechanisms brings its…

计算与语言 · 计算机科学 2025-06-11 Leonardo Ranaldi , Marco Valentino , Andrè Freitas

Retrieval-Augmented Generation (RAG) has emerged as the predominant paradigm for grounding Large Language Model outputs in factual knowledge, effectively mitigating hallucinations. However, conventional RAG systems operate under a…

信息检索 · 计算机科学 2026-01-13 Sergii Voloshyn

Long-form question answering (LFQA) requires open-ended long-form responses that synthesize coherent, factually grounded content from multi-source evidence. This makes reinforcement learning (RL) reward design critical. The reward must be…

计算与语言 · 计算机科学 2026-05-08 Yuhao Wang , Ruiyang Ren , Yucheng Wang , Wayne Xin Zhao , Jing Liu , Hua Wu , Haifeng Wang

In traditional RAG framework, the basic retrieval units are normally short. The common retrievers like DPR normally work with 100-word Wikipedia paragraphs. Such a design forces the retriever to search over a large corpus to find the…

计算与语言 · 计算机科学 2024-09-04 Ziyan Jiang , Xueguang Ma , Wenhu Chen

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and…

计算与语言 · 计算机科学 2024-04-09 Pouria Rouzrokh , Shahriar Faghani , Cooper U. Gamble , Moein Shariatnia , Bradley J. Erickson

This paper introduces SemRAG, an enhanced Retrieval Augmented Generation (RAG) framework that efficiently integrates domain-specific knowledge using semantic chunking and knowledge graphs without extensive fine-tuning. Integrating…

计算与语言 · 计算机科学 2025-07-30 Kezhen Zhong , Basem Suleiman , Abdelkarim Erradi , Shijing Chen

While Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by incorporating external knowledge, they still face persistent challenges in retrieval inefficiency and the inability of LLMs to filter out irrelevant…

计算与语言 · 计算机科学 2025-02-13 Ruobing Yao , Yifei Zhang , Shuang Song , Yuhua Liu , Neng Gao , Chenyang Tu

Despite the popularity of retrieval-augmented generation (RAG) as a solution for grounded QA in both academia and industry, current RAG methods struggle with questions where the necessary information is distributed across many documents or…

计算与语言 · 计算机科学 2025-11-11 Nathan Scales , Nathanael Schärli , Olivier Bousquet

Retrieval-Augmented Generation (RAG) systems using large language models (LLMs) often generate inaccurate responses due to the retrieval of irrelevant or loosely related information. Existing methods, which operate at the document level,…

Retrieval-Augmented Generation (RAG) is a framework for grounding Large Language Models (LLMs) in external, up-to-date information. However, recent advancements in context window size allow LLMs to process inputs of up to 128K tokens or…

机器学习 · 计算机科学 2026-02-26 Seongwoong Shim , Myunsoo Kim , Jae Hyeon Cho , Byung-Jun Lee

Retrieval-Augmented Generation (RAG) helps LLMs stay accurate, but feeding long documents into a prompt makes the model slow and expensive. This has motivated context compression, ranging from token pruning and summarization to…

计算与语言 · 计算机科学 2026-01-09 Jianbo Li , Yi Jiang , Sendong Zhao , Bairui Hu , Haochun Wang , Bing Qin

Retrieval-augmented generation (RAG) has become a transformative approach for enhancing large language models (LLMs) by grounding their outputs in external knowledge sources. Yet, a critical question persists: how can vast volumes of…

信息检索 · 计算机科学 2025-04-29 Carlo Merola , Jaspinder Singh

Question answering over visually rich documents (VRDs) requires reasoning not only over isolated content but also over documents' structural organization and cross-page dependencies. However, conventional retrieval-augmented generation…