中文
相关论文

相关论文: U-NIAH: Unified RAG and LLM Evaluation for Long Co…

200 篇论文

Retrieval-Augmented Generation (RAG) is a promising approach for mitigating the hallucination of large language models (LLMs). However, existing research lacks rigorous evaluation of the impact of retrieval-augmented generation on different…

计算与语言 · 计算机科学 2023-12-21 Jiawei Chen , Hongyu Lin , Xianpei Han , Le Sun

Large Language Models (LLM) have shown remarkable language capabilities fueling attempts to integrate them into applications across a wide range of domains. An important application area is question answering over private enterprise…

人工智能 · 计算机科学 2024-06-07 Masoomali Fatehkia , Ji Kim Lucas , Sanjay Chawla

The Retrieval-Augmented Generation (RAG) framework introduces a retrieval module to dynamically inject retrieved information into the input context of large language models (LLMs), and has demonstrated significant success in various NLP…

信息检索 · 计算机科学 2025-05-27 Yi Jiang , Sendong Zhao , Jianbo Li , Haochun Wang , Bing Qin

Retrieval-Augmented Generation (RAG) systems have recently shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.…

计算与语言 · 计算机科学 2025-01-14 Siran Li , Linus Stenzel , Carsten Eickhoff , Seyed Ali Bahrainian

Large Language Models (LLMs) have achieved impressive progress in natural language processing, but their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks. Retrieval-Augmented…

计算与语言 · 计算机科学 2025-05-20 Zhangyu Wang , Siyuan Gao , Rong Zhou , Hao Wang , Li Ning

We present UncertaintyRAG, a novel approach for long-context Retrieval-Augmented Generation (RAG) that utilizes Signal-to-Noise Ratio (SNR)-based span uncertainty to estimate similarity between text chunks. This span uncertainty enhances…

This paper presents a novel approach for unified retrieval-augmented generation (RAG) systems using the recent emerging large language model (LLM) agent concept. Specifically, Agent LLM, which utilizes LLM as fundamental controllers, has…

计算与语言 · 计算机科学 2025-06-02 Hoang Pham , Thuy-Duong Nguyen , Khac-Hoai Nam Bui

Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge,…

计算与语言 · 计算机科学 2025-04-08 Leonardo Ranaldi , Federico Ranaldi , Fabio Massimo Zanzotto , Barry Haddow , Alexandra Birch

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies…

计算与语言 · 计算机科学 2025-10-10 Shuo Yu , Mingyue Cheng , Qi Liu , Daoyu Wang , Jiqian Yang , Jie Ouyang , Yucong Luo , Chenyi Lei , Enhong Chen

Large language models (LLMs) augmented with external data have demonstrated remarkable capabilities in completing real-world tasks. Techniques for integrating external data into LLMs, such as Retrieval-Augmented Generation (RAG) and…

计算与语言 · 计算机科学 2024-09-24 Siyun Zhao , Yuqing Yang , Zilong Wang , Zhiyuan He , Luna K. Qiu , Lili Qiu

Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) to incorporate external knowledge at inference time. However, when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process…

计算与语言 · 计算机科学 2026-04-22 Xingchen Xiao , Heyan Huang , Runheng Liu , Jincheng Xie

Video sequences offer valuable temporal information, but existing large multimodal models (LMMs) fall short in understanding extremely long videos. Many works address this by reducing the number of visual tokens using visual resamplers.…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Peiyuan Zhang , Kaichen Zhang , Bo Li , Guangtao Zeng , Jingkang Yang , Yuanhan Zhang , Ziyue Wang , Haoran Tan , Chunyuan Li , Ziwei Liu

Retrieval-Augmented Generation (RAG) has emerged as a prominent method for incorporating domain knowledge into Large Language Models (LLMs). While RAG enhances response relevance by incorporating retrieved domain knowledge in the context,…

计算与语言 · 计算机科学 2025-03-28 Kushagra Bhushan , Yatin Nandwani , Dinesh Khandelwal , Sonam Gupta , Gaurav Pandey , Dinesh Raghu , Sachindra Joshi

Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. Retrieval-Augmented Generation (RAG) mitigates these issues by integrating external dynamic information for…

Retrieval-Augmented Generation (RAG) is essential for integrating external knowledge into Large Language Model (LLM) outputs. While the literature on RAG is growing, it primarily focuses on systematic reviews and comparisons of new…

计算与语言 · 计算机科学 2024-04-02 Matouš Eibich , Shivay Nagpal , Alexander Fred-Ojala

Retrieval-augmented generation (RAG) enhances large language models (LLMs) with external knowledge to answer questions more accurately. However, research on evaluating RAG systems-particularly the retriever component-remains limited, as…

信息检索 · 计算机科学 2026-04-21 Lorenz Brehme , Thomas Ströhle , Ruth Breu

Providing external knowledge to Large Language Models (LLMs) is a key point for using these models in real-world applications for several reasons, such as incorporating up-to-date content in a real-time manner, providing access to…

计算与语言 · 计算机科学 2024-06-04 Simon Akesson , Frances A. Santos

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-only…

信息检索 · 计算机科学 2025-04-15 Lang Mei , Siyu Mo , Zhihan Yang , Chong Chen

Fine-tuning is an immensely resource-intensive process when retraining Large Language Models (LLMs) to incorporate a larger body of knowledge. Although many fine-tuning techniques have been developed to reduce the time and computational…

计算与语言 · 计算机科学 2025-08-01 Hruday Markondapatnaikuni , Basem Suleiman , Abdelkarim Erradi , Shijing Chen

Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However,…

计算与语言 · 计算机科学 2025-06-10 Weihang Su , Qingyao Ai , Jingtao Zhan , Qian Dong , Yiqun Liu