中文
相关论文

相关论文: RAG or Learning? Understanding the Limits of LLM A…

200 篇论文

In today's rapidly evolving landscape of Artificial Intelligence, large language models (LLMs) have emerged as a vibrant research topic. LLMs find applications in various fields and contribute significantly. Despite their powerful language…

计算与语言 · 计算机科学 2024-09-10 Tuan Bui , Oanh Tran , Phuong Nguyen , Bao Ho , Long Nguyen , Thang Bui , Tho Quan

A common solution for mitigating outdated or incorrect information in Large Language Models (LLMs) is to provide updated facts in-context or through knowledge editing. However, these methods introduce knowledge conflicts when the knowledge…

人工智能 · 计算机科学 2026-01-23 Yiyang Feng , Zeming Chen , Haotian Wu , Jiawei Zhou , Antoine Bosselut

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Recent advances in large language models (LLMs) have unlocked powerful reasoning and decision-making capabilities. However, their inherent dependence on static parametric memory fundamentally limits their adaptability, factual accuracy, and…

信息检索 · 计算机科学 2025-08-07 Xinkui Zhao , Haode Li , Yifan Zhang , Guanjie Cheng , Yueshen Xu

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet exhibit critical limitations in knowledge-intensive tasks, often generating hallucinations when faced with questions requiring…

计算与语言 · 计算机科学 2026-01-08 Yilin Xiao , Chuang Zhou , Yujing Zhang , Qinggang Zhang , Su Dong , Shengyuan Chen , Chang Yang , Xiao Huang

Retrieval-augmented generation (RAG) methods are viable solutions for addressing the static memory limits of pre-trained language models. Nevertheless, encountering conflicting sources of information within the retrieval context is an…

计算与语言 · 计算机科学 2025-06-05 Quang Hieu Pham , Hoang Ngo , Anh Tuan Luu , Dat Quoc Nguyen

Retrieval-Augmented Large Language Models (LLMs), which incorporate the non-parametric knowledge from external knowledge bases into LLMs, have emerged as a promising approach to enhancing response accuracy in several tasks, such as…

计算与语言 · 计算机科学 2024-03-29 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Large language models (LLMs) continue to struggle with knowledge-intensive questions that require up-to-date information and multi-hop reasoning. Augmenting LLMs with hybrid external knowledge, such as unstructured text and structured…

机器学习 · 计算机科学 2026-02-12 Junhong Lin , Bing Zhang , Song Wang , Ziyan Liu , Dan Gutfreund , Julian Shun , Yada Zhu

Large language models (LLMs) struggle with the factual error during inference due to the lack of sufficient training data and the most updated knowledge, leading to the hallucination problem. Retrieval-Augmented Generation (RAG) has gained…

信息检索 · 计算机科学 2026-01-22 Zulun Zhu , Tiancheng Huang , Kai Wang , Junda Ye , Xinghe Chen , Siqiang Luo

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-purpose RAG systems to specialized fields such as science and…

计算与语言 · 计算机科学 2025-01-28 Ran Xu , Hui Liu , Sreyashi Nag , Zhenwei Dai , Yaochen Xie , Xianfeng Tang , Chen Luo , Yang Li , Joyce C. Ho , Carl Yang , Qi He

Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less attention has been paid to their ability to simulate human…

计算工程、金融与科学 · 计算机科学 2025-08-25 Yuanjun Feng , Vivek Choudhary , Yash Raj Shrestha

Although the rise of large language models (LLMs) has introduced new opportunities for time series forecasting, existing LLM-based solutions require excessive training and exhibit limited transferability. In view of these challenges, we…

人工智能 · 计算机科学 2024-12-24 Silin Yang , Dong Wang , Haoqi Zheng , Ruochun Jin

Pretraining Large Language Models (LLMs) on large corpora of textual data is now a standard paradigm. When using these LLMs for many downstream applications, it is common to additionally bake in new knowledge (e.g., time-critical news, or…

计算与语言 · 计算机科学 2024-06-06 Tianjun Zhang , Shishir G. Patil , Naman Jain , Sheng Shen , Matei Zaharia , Ion Stoica , Joseph E. Gonzalez

Retrieval augmented generation (RAG) exhibits outstanding performance in promoting the knowledge capabilities of large language models (LLMs) with retrieved documents related to user queries. However, RAG only focuses on improving the…

信息检索 · 计算机科学 2024-06-25 Dongyang Li , Junbing Yan , Taolin Zhang , Chengyu Wang , Xiaofeng He , Longtao Huang , Hui Xue , Jun Huang

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

The recent success of large language models (LLMs) trained on static, pre-collected, general datasets has sparked numerous research directions and applications. One such direction addresses the non-trivial challenge of integrating…

机器学习 · 计算机科学 2024-11-26 Haizhou Shi , Zihao Xu , Hengyi Wang , Weiyi Qin , Wenyuan Wang , Yibin Wang , Zifeng Wang , Sayna Ebrahimi , Hao Wang

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

计算与语言 · 计算机科学 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Recent advances in large language models (LLMs) have led to impressive progress in natural language generation, yet their tendency to produce hallucinated or unsubstantiated content remains a critical concern. To improve factual…

计算与语言 · 计算机科学 2025-05-20 Xukai Liu , Ye Liu , Shiwen Wu , Yanghai Zhang , Yihao Yuan , Kai Zhang , Qi Liu

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-only…

信息检索 · 计算机科学 2025-04-15 Lang Mei , Siyu Mo , Zhihan Yang , Chong Chen

This study addresses the critical need for enhanced situational awareness in autonomous driving (AD) by leveraging the contextual reasoning capabilities of large language models (LLMs). Unlike traditional perception systems that rely on…

人工智能 · 计算机科学 2025-01-09 Xuewen Luo , Fan Ding , Fengze Yang , Yang Zhou , Junnyong Loo , Hwa Hui Tew , Chenxi Liu