中文
相关论文

相关论文: RAT: Retrieval Augmented Thoughts Elicit Context-A…

200 篇论文

Recent Retrieval Augmented Generation (RAG) aims to enhance Large Language Models (LLMs) by incorporating extensive knowledge retrieved from external sources. However, such approach encounters some challenges: Firstly, the original queries…

计算与语言 · 计算机科学 2024-10-10 Bolei He , Nuo Chen , Xinran He , Lingyong Yan , Zhenkai Wei , Jinchang Luo , Zhen-Hua Ling

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

计算与语言 · 计算机科学 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Recently, Retrieval Augmented Generation (RAG) has shifted focus to multi-retrieval approaches to tackle complex tasks such as multi-hop question answering. However, these systems struggle to decide when to stop searching once enough…

信息检索 · 计算机科学 2026-04-23 Gabriel Iturra-Bocaz , Petra Galuscakova

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

信息检索 · 计算机科学 2026-05-19 Yizheng Huang , Jimmy Huang

Retrieval-Augmented Generation (RAG) improves large language models by retrieving external knowledge, often truncated into smaller chunks due to the input context window, which leads to information loss, resulting in response hallucinations…

计算与语言 · 计算机科学 2025-11-18 Jie Zhang , Bo Tang , Wanzi Shao , Wenqiang Wei , Jihao Zhao , Jianqing Zhu , Zhiyu li , Wen Xi , Zehao Lin , Feiyu Xiong , Yanchao Tan

Chain-of-thought (CoT) has proven to improve the reasoning capability of large language models (LLMs). However, due to the complexity of multimodal scenarios and the difficulty in collecting high-quality CoT data, CoT reasoning in…

机器学习 · 计算机科学 2024-11-05 Kanzhi Cheng , Yantao Li , Fangzhi Xu , Jianbing Zhang , Hao Zhou , Yang Liu

We present a comprehensive framework for enhancing Retrieval-Augmented Generation (RAG) systems through dynamic retrieval strategies and reinforcement fine-tuning. This approach significantly improves large language models on…

机器学习 · 计算机科学 2025-05-21 Sakhinana Sagar Srinivas , Akash Das , Shivam Gupta , Venkataramana Runkana

Large Language Models (LLMs) have significantly enhanced conversational Artificial Intelligence(AI) chatbots; however, domain-specific accuracy and the avoidance of factual inconsistencies remain pressing challenges, particularly for large…

信息检索 · 计算机科学 2025-09-24 Olalekan K. Akindele , Bhupesh Kumar Mishra , Kenneth Y. Wertheim

Retrieval-augmented generation has gained significant attention due to its ability to integrate relevant external knowledge, enhancing the accuracy and reliability of the LLMs' responses. Most of the existing methods apply a dynamic…

计算与语言 · 计算机科学 2025-01-13 Liang Xiao , Wen Dai , Shuai Chen , Bin Qin , Chongyang Shi , Haopeng Jing , Tianyu Guo

Knowing that the generative capabilities of large language models (LLM) are sometimes hampered by tendencies to hallucinate or create non-factual responses, researchers have increasingly focused on methods to ground generated outputs in…

信息检索 · 计算机科学 2024-11-20 Sonal Prabhune , Donald J. Berndt

Large Language Models (LLMs) excel in various language tasks but they often generate incorrect information, a phenomenon known as "hallucinations". Retrieval-Augmented Generation (RAG) aims to mitigate this by using document retrieval for…

信息检索 · 计算机科学 2024-07-18 Hamin Koo , Minseon Kim , Sung Ju Hwang

Recent large language model (LLM) reasoning, despite its success, suffers from limited domain knowledge, susceptibility to hallucinations, and constrained reasoning depth, particularly in small-scale models deployed in resource-constrained…

人工智能 · 计算机科学 2025-03-04 Wenjie Wu , Yongcheng Jing , Yingjie Wang , Wenbin Hu , Dacheng Tao

The integration of external knowledge through Retrieval-Augmented Generation (RAG) has become foundational in enhancing large language models (LLMs) for knowledge-intensive tasks. However, existing RAG paradigms often overlook the cognitive…

人工智能 · 计算机科学 2025-09-24 Yu Wang , Shiwan Zhao , Zhihu Wang , Ming Fan , Xicheng Zhang , Yubo Zhang , Zhengfan Wang , Heyuan Huang , Ting Liu

Existing large language models (LLMs) show exceptional problem-solving capabilities but might struggle with complex reasoning tasks. Despite the successes of chain-of-thought and tree-based search methods, they mainly depend on the internal…

计算与语言 · 计算机科学 2024-12-18 Jinhao Jiang , Jiayi Chen , Junyi Li , Ruiyang Ren , Shijie Wang , Wayne Xin Zhao , Yang Song , Tao Zhang

Given the growing trend of many organizations integrating Retrieval Augmented Generation (RAG) into their operations, we assess RAG on domain-specific data and test state-of-the-art models across various optimization techniques. We…

人工智能 · 计算机科学 2024-11-14 Anum Afzal , Juraj Vladika , Gentrit Fazlija , Andrei Staradubets , Florian Matthes

We introduce Plan*RAG, a novel framework that enables structured multi-hop reasoning in retrieval-augmented generation (RAG) through test-time reasoning plan generation. While existing approaches such as ReAct maintain reasoning chains…

计算与语言 · 计算机科学 2025-02-05 Prakhar Verma , Sukruta Prakash Midigeshi , Gaurav Sinha , Arno Solin , Nagarajan Natarajan , Amit Sharma

Transformers have become the cornerstone of modern large-scale language models, but their reliance on softmax attention poses a computational bottleneck at both training and inference. Recurrent models offer high efficiency, but compressing…

计算与语言 · 计算机科学 2025-11-20 Xiuying Wei , Anunay Yadav , Razvan Pascanu , Caglar Gulcehre

Retrieval-augmented generation (RAG) appears as a promising method to alleviate the "hallucination" problem in large language models (LLMs), since it can incorporate external traceable resources for response generation. The essence of RAG…

计算与语言 · 计算机科学 2024-10-16 Haosheng Qian , Yixing Fan , Ruqing Zhang , Jiafeng Guo

Despite the promise of Retrieval-Augmented Generation in grounding Multimodal Large Language Models with external knowledge, the transition to extensive contexts often leads to significant attention dilution and reasoning hallucinations.…

计算与语言 · 计算机科学 2026-03-10 Junming Liu , Yuqi Li , Shiping Wen , Zhigang Zeng , Tingwen Huang

Retrieval-Augmented Generation (RAG) enhances the response quality and domain-specific performance of large language models (LLMs) by incorporating external knowledge to combat hallucinations. In recent research, graph structures have been…

信息检索 · 计算机科学 2025-12-17 Hao Hu , Yifan Feng , Ruoxue Li , Rundong Xue , Xingliang Hou , Zhiqiang Tian , Yue Gao , Shaoyi Du