中文
相关论文

相关论文: Unveiling Knowledge Utilization Mechanisms in LLM-…

200 篇论文

Real-world live retrieval-augmented generation (RAG) systems face significant challenges when processing user queries that are often noisy, ambiguous, and contain multiple intents. While RAG enhances large language models (LLMs) with…

计算与语言 · 计算机科学 2025-06-27 Guanting Dong , Xiaoxi Li , Yuyao Zhang , Mengjie Deng

Recent advances in retrieval-augmented generation (RAG) furnish large language models (LLMs) with iterative retrievals of relevant information to handle complex multi-hop questions. These methods typically alternate between LLM reasoning…

计算与语言 · 计算机科学 2025-05-27 Rui Li , Quanyu Dai , Zeyu Zhang , Xu Chen , Zhenhua Dong , Ji-Rong Wen

The advent of Large Language Models (LLMs) has revolutionized natural language processing. However, these models face challenges in retrieving precise information from vast datasets. Retrieval-Augmented Generation (RAG) was developed to…

信息检索 · 计算机科学 2025-03-04 Yuxin Yang , Haoyang Wu , Tao Wang , Jia Yang , Hao Ma , Guojie Luo

Retrieval Augmented Generation (RAG) improves correctness of Question Answering (QA) and addresses hallucinations in Large Language Models (LLMs), yet greatly increase computational costs. Besides, RAG is not always needed as may introduce…

Retrieval-Augmented Generation (RAG) has demonstrated significant effectiveness in enhancing large language models (LLMs) for complex multi-hop question answering (QA). For multi-hop QA tasks, current iterative approaches predominantly rely…

计算与语言 · 计算机科学 2026-01-19 Yuling Shi , Maolin Sun , Zijun Liu , Mo Yang , Yixiong Fang , Tianran Sun , Xiaodong Gu

Fine-tuning is an immensely resource-intensive process when retraining Large Language Models (LLMs) to incorporate a larger body of knowledge. Although many fine-tuning techniques have been developed to reduce the time and computational…

计算与语言 · 计算机科学 2025-08-01 Hruday Markondapatnaikuni , Basem Suleiman , Abdelkarim Erradi , Shijing Chen

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating additional information from retrieval. However, studies have shown that LLMs still face challenges in effectively using the retrieved information,…

计算与语言 · 计算机科学 2024-06-13 Shicheng Xu , Liang Pang , Mo Yu , Fandong Meng , Huawei Shen , Xueqi Cheng , Jie Zhou

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

计算与语言 · 计算机科学 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

Retrieval-Augmented Generation (RAG) is an effective solution to supplement necessary knowledge to large language models (LLMs). Targeting its bottleneck of retriever performance, "generate-then-read" pipeline is proposed to replace the…

计算与语言 · 计算机科学 2024-06-07 Wei Tang , Yixin Cao , Jiahao Ying , Bo Wang , Yuyue Zhao , Yong Liao , Pengyuan Zhou

Retrieval-Augmented Generation (RAG) enhances Large Language Model (LLM) output by providing prior knowledge as context to input. This is beneficial for knowledge-intensive and expert reliant tasks, including legal question-answering, which…

Large language models (LLMs) has become a significant research focus and is utilized in various fields, such as text generation and dialog systems. One of the most essential applications of LLM is Retrieval Augmented Generation (RAG), which…

计算与语言 · 计算机科学 2025-10-06 Sicheng Dong , Vahid Zolfaghari , Nenad Petrovic , Alois Knoll

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external knowledge. Recently, some works have incorporated iterative knowledge accumulation processes into RAG models to progressively accumulate…

计算与语言 · 计算机科学 2026-01-15 Xinze Li , Zhenghao Liu , Haidong Xin , Yukun Yan , Shuo Wang , Zheni Zeng , Sen Mei , Ge Yu , Maosong Sun

Ensuring factual accuracy while maintaining the creative capabilities of Large Language Model Agents (LMAs) poses significant challenges in the development of intelligent agent systems. LMAs face prevalent issues such as information…

人工智能 · 计算机科学 2024-05-21 Diego Sanmartin

The Retrieval-Augmented Generation (RAG) framework introduces a retrieval module to dynamically inject retrieved information into the input context of large language models (LLMs), and has demonstrated significant success in various NLP…

信息检索 · 计算机科学 2025-05-27 Yi Jiang , Sendong Zhao , Jianbo Li , Haochun Wang , Bing Qin

Retrieval-Augmented Generation (RAG) mitigates hallucination in large language models (LLMs) by incorporating external knowledge during generation. However, the effectiveness of RAG depends not only on the design of the retriever and the…

计算与语言 · 计算机科学 2026-04-15 Xudong Wang , Chaoning Zhang , Qigan Sun , Zhenzhen Huang , Chang Lu , Sheng Zheng , Zeyu Ma , Caiyan Qin , Yang Yang , Hengtao Shen

Massive Open Online Courses (MOOCs) lack direct interaction between learners and instructors, making it challenging for learners to understand new knowledge concepts. Recently, learners have increasingly used Large Language Models (LLMs) to…

人工智能 · 计算机科学 2025-05-19 Mohamed Abdelmagied , Mohamed Amine Chatti , Shoeb Joarder , Qurat Ul Ain , Rawaa Alatrash

A common way to extend the memory of large language models (LLMs) is by retrieval augmented generation (RAG), which inserts text retrieved from a larger memory into an LLM's context window. However, the context window is typically limited…

计算与语言 · 计算机科学 2025-02-14 Marc Pickett , Jeremy Hartman , Ayan Kumar Bhowmick , Raquib-ul Alam , Aditya Vempaty

Large Language Models (LLMs) have demonstrated strong capabilities in web search and reasoning. However, their dependence on static training corpora makes them prone to factual errors and knowledge gaps. Retrieval-Augmented Generation (RAG)…

人工智能 · 计算机科学 2026-01-26 Jiasheng Xu , Mingda Li , Yongqiang Tang , Peijie Wang , Wensheng Zhang

Large Language Models (LLMs) excel at reasoning and generation but are inherently limited by static pretraining data, resulting in factual inaccuracies and weak adaptability to new information. Retrieval-Augmented Generation (RAG) addresses…

计算与语言 · 计算机科学 2025-11-03 Qi Luo , Xiaonan Li , Yuxin Wang , Tingshuo Fan , Yuan Li , Xinchi Chen , Xipeng Qiu

Current general-purpose large language models (LLMs) commonly exhibit knowledge hallucination and insufficient domain-specific adaptability in domain-specific tasks, limiting their effectiveness in specialized question answering scenarios.…

信息检索 · 计算机科学 2025-09-16 Mengzheng Yang , Yanfei Ren , David Osei Opoku , Ruochang Li , Peng Ren , Chunxiao Xing