中文
相关论文

相关论文: RAG or Learning? Understanding the Limits of LLM A…

200 篇论文

Temporal Knowledge Graph Reasoning (TKGR) is the process of utilizing temporal information to capture complex relations within a Temporal Knowledge Graph (TKG) to infer new knowledge. Conventional methods in TKGR typically depend on deep…

人工智能 · 计算机科学 2024-12-31 Jiapu Wang , Kai Sun , Linhao Luo , Wei Wei , Yongli Hu , Alan Wee-Chung Liew , Shirui Pan , Baocai Yin

Retrieval-Augmented Generation (RAG) offers a promising solution to address various limitations of Large Language Models (LLMs), such as hallucination and difficulties in keeping up with real-time updates. This approach is particularly…

计算与语言 · 计算机科学 2024-06-18 Shuting Wang , Jiongnan Liu , Shiren Song , Jiehan Cheng , Yuqi Fu , Peidong Guo , Kun Fang , Yutao Zhu , Zhicheng Dou

A common way to extend the memory of large language models (LLMs) is by retrieval augmented generation (RAG), which inserts text retrieved from a larger memory into an LLM's context window. However, the context window is typically limited…

计算与语言 · 计算机科学 2025-02-14 Marc Pickett , Jeremy Hartman , Ayan Kumar Bhowmick , Raquib-ul Alam , Aditya Vempaty

Large Language Models (LLMs) augmented with retrieval mechanisms have demonstrated significant potential in fact-checking tasks by integrating external knowledge. However, their reliability decreases when confronted with conflicting…

计算与语言 · 计算机科学 2025-05-26 Ziyu Ge , Yuhao Wu , Daniel Wai Kit Chin , Roy Ka-Wei Lee , Rui Cao

Large language models (LLMs) have transformed natural language processing (NLP), enabling diverse applications by integrating large-scale pre-trained knowledge. However, their static knowledge limits dynamic reasoning over external…

计算与语言 · 计算机科学 2025-09-26 Harshad Khadilkar , Abhay Gupta

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

计算与语言 · 计算机科学 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

Large Language Models (LLMs) often generate inaccurate responses (hallucinations) when faced with questions beyond their knowledge scope. Retrieval-Augmented Generation (RAG) addresses this by leveraging external knowledge, but a critical…

信息检索 · 计算机科学 2025-09-10 Haoxiang Jin , Ronghan Li , Zixiang Lu , Qiguang Miao

We study the limitations of Large Language Models (LLMs) for the task of response generation in human-machine dialogue. Several techniques have been proposed in the literature for different dialogue types (e.g., Open-Domain). However, the…

计算与语言 · 计算机科学 2024-08-06 Simone Alghisi , Massimo Rizzoli , Gabriel Roccabruna , Seyed Mahed Mousavi , Giuseppe Riccardi

Large language models (LLMs) have been widely used for various tasks and applications. However, LLMs and fine-tuning are limited to the pre-trained data. For example, ChatGPT's world knowledge until 2021 can be outdated or inaccurate. To…

计算与语言 · 计算机科学 2025-04-24 Ahsan Bilal , Beiyu Lin

The performance of Large Language Models (LLMs) degrades from the temporal drift between data used for model training and newer text seen during inference. One understudied avenue of language change causing data drift is the emergence of…

计算与语言 · 计算机科学 2024-08-14 Jonathan Zheng , Alan Ritter , Wei Xu

Many existing evaluation benchmarks for Large Language Models (LLMs) quickly become outdated due to the emergence of new models and training data. These benchmarks also fall short in assessing how LLM performance changes over time, as they…

计算与语言 · 计算机科学 2025-07-09 Hui Dai , Ryan Teehan , Mengye Ren

Large Language Models~(LLMs) are prone to hallucinations, and Retrieval-Augmented Generation (RAG) helps mitigate this, but at a high computational cost while risking misinformation. Adaptive retrieval aims to retrieve only when necessary,…

Large language models (LLMs) are transforming the way information is retrieved with vast amounts of knowledge being summarized and presented via natural language conversations. Yet, LLMs are prone to highlight the most frequently seen…

计算与语言 · 计算机科学 2024-02-20 Julien Delile , Srayanta Mukherjee , Anton Van Pamel , Leonid Zhukov

Retrieval Augmented Generation (RAG), a paradigm that integrates external contextual information with large language models (LLMs) to enhance factual accuracy and relevance, has emerged as a pivotal area in generative AI. The LLMs used in…

Large language models (LLMs) frequently generate confident yet factually incorrect content when used for language generation (a phenomenon often known as hallucination). Retrieval augmented generation (RAG) tries to reduce factual errors by…

信息检索 · 计算机科学 2026-04-01 Dobrik Georgiev , Kheeran Naidu , Alberto Cattaneo , Federico Monti , Carlo Luschi , Daniel Justus

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

机器学习 · 计算机科学 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

Large Language Models (LLMs) are adept at generating responses based on information within their context. While this ability is useful for interacting with structured data like code files, another popular method, Retrieval-Augmented…

计算与语言 · 计算机科学 2025-10-22 Mihir Gupte , Paolo Giusto , Ramesh S

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

计算与语言 · 计算机科学 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang

The machine learning system in the form of Retrieval Augmented Generation (RAG) has developed steadily since about 2021. RAG could be observed as a version of the knowledge transfer. In the studied case, the large computing systems are…

综合物理 · 物理学 2025-05-21 Alexey Naikov , Anatoly Oreshkin , Alexey Shvetsov , Andrey Shevel

The dynamic nature of knowledge in an ever-changing world presents challenges for language models trained on static data; the model in the real world often requires not only acquiring new knowledge but also overwriting outdated information…

计算与语言 · 计算机科学 2024-04-23 Yujin Kim , Jaehong Yoon , Seonghyeon Ye , Sangmin Bae , Namgyu Ho , Sung Ju Hwang , Se-young Yun