中文
相关论文

相关论文: Less is More: Making Smaller Language Models Compe…

200 篇论文

Large Language Models (LLMs) have shown strong inductive reasoning ability across various domains, but their reliability is hindered by the outdated knowledge and hallucinations. Retrieval-Augmented Generation mitigates these issues by…

计算与语言 · 计算机科学 2025-06-12 Tianjun Yao , Haoxuan Li , Zhiqiang Shen , Pan Li , Tongliang Liu , Kun Zhang

Knowledge Graphs represent real-world entities and the relationships between them. Multilingual Knowledge Graph Construction (mKGC) refers to the task of automatically constructing or predicting missing entities and links for knowledge…

计算与语言 · 计算机科学 2025-07-23 Hellina Hailu Nigatu , Min Li , Maartje ter Hoeve , Saloni Potdar , Sarah Chasins

Large Language Models (LLMs) have achieved impressive performance across a wide range of applications. However, they often suffer from hallucinations in knowledge-intensive domains due to their reliance on static pretraining corpora. To…

信息检索 · 计算机科学 2026-02-10 Lihui Liu , Jiayuan Ding , Subhabrata Mukherjee , Carl J. Yang

Retrieval-Augmented Generation (RAG) enhances language models by retrieving and incorporating relevant external knowledge. However, traditional retrieve-and-generate processes may not be optimized for real-world scenarios, where queries…

计算与语言 · 计算机科学 2025-02-28 Ingeol Baek , Hwan Chang , Byeongjeong Kim , Jimin Lee , Hwanhee Lee

Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However,…

计算与语言 · 计算机科学 2025-06-10 Weihang Su , Qingyao Ai , Jingtao Zhan , Qian Dong , Yiqun Liu

Retrieval Augmented Generation (RAG) has gradually emerged as a promising paradigm for enhancing the accuracy and factual consistency of content generated by large language models (LLMs). However, existing RAG studies primarily focus on…

信息检索 · 计算机科学 2025-07-24 Qikai Wei , Huansheng Ning , Chunlong Han , Jianguo Ding

Retrieval-Augmented Generation (RAG) has emerged as an effective paradigm for expanding the knowledge capacity of Multimodal Large Language Models (MLLMs) by incorporating external knowledge sources into the generation process, and has been…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Xu Yuan , Liangbo Ning , Qingqing Ye , Wenqi Fan , Qing Li

Retrieval augmented generation RAG is widely deployed to improve factual accuracy in language models yet it remains unclear whether smaller models of size 7B parameters or less can effectively utilize retrieved information. To investigate…

计算与语言 · 计算机科学 2026-03-13 Sanchit Pandey

Retrieval Augmented Generation (RAG) has greatly improved the performance of Large Language Model (LLM) responses by grounding generation with context from existing documents. These systems work well when documents are clearly relevant to a…

计算与语言 · 计算机科学 2024-05-29 Jialin Dong , Bahare Fatemi , Bryan Perozzi , Lin F. Yang , Anton Tsitsulin

Large language models (LLMs) often suffer from hallucination, generating factually incorrect statements when handling questions beyond their knowledge and perception. Retrieval-augmented generation (RAG) addresses this by retrieving…

计算与语言 · 计算机科学 2025-11-18 Shengyuan Chen , Chuang Zhou , Zheng Yuan , Qinggang Zhang , Zeyang Cui , Hao Chen , Yilin Xiao , Jiannong Cao , Xiao Huang

Large Language Models (LLMs) are being adopted at an unprecedented rate, yet still face challenges in knowledge-intensive domains like biomedicine. Solutions such as pre-training and domain-specific fine-tuning add substantial computational…

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

计算与语言 · 计算机科学 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Large language models (LLMs) have demonstrated remarkable in-context reasoning capabilities across a wide range of tasks, particularly with unstructured inputs such as language or images. However, LLMs struggle to handle structured data,…

机器学习 · 计算机科学 2025-02-20 Jintang Li , Ruofan Wu , Yuchang Zhu , Huizhe Zhang , Liang Chen , Zibin Zheng

Graph-based retrieval-augmented generation (GraphRAG) exploits structured knowledge to support knowledge-intensive reasoning. However, most existing methods treat graphs as intermediate artifacts, and the few subgraph-based retrieval…

信息检索 · 计算机科学 2026-03-10 Haonan Yuan , Qingyun Sun , Junhua Shi , Mingjun Liu , Jiaqi Yuan , Ziwei Zhang , Xingcheng Fu , Jianxin Li

Retrieval-Augmented Generation (RAG) based on knowledge graphs (KGs) enhances large language models (LLMs) by providing structured and interpretable external knowledge. However, existing KG-based RAG methods struggle to retrieve accurate…

人工智能 · 计算机科学 2025-10-21 Junchi Yu , Yujie Liu , Jindong Gu , Philip Torr , Dongzhan Zhou

Knowledge graph question answering (KGQA) presents significant challenges due to the structural and semantic variations across input graphs. Existing works rely on Large Language Model (LLM) agents for graph traversal and retrieval; an…

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

信息检索 · 计算机科学 2026-05-19 Yizheng Huang , Jimmy Huang

Large Language Models (LLMs) have demonstrated strong capabilities in web search and reasoning. However, their dependence on static training corpora makes them prone to factual errors and knowledge gaps. Retrieval-Augmented Generation (RAG)…

人工智能 · 计算机科学 2026-01-26 Jiasheng Xu , Mingda Li , Yongqiang Tang , Peijie Wang , Wensheng Zhang

Retrieval-augmented generation (RAG) improves the response quality of large language models (LLMs) by retrieving knowledge from external databases. Typical RAG approaches split the text database into chunks, organizing them in a flat…

计算与语言 · 计算机科学 2025-11-18 Boyu Chen , Zirui Guo , Zidan Yang , Yuluo Chen , Junze Chen , Zhenghao Liu , Chuan Shi , Cheng Yang

Graph-based retrieval-augmented generation (RAG) enriches large language models (LLMs) with external knowledge for long-context understanding and multi-hop reasoning, but existing methods face a granularity dilemma: fine-grained…

计算与语言 · 计算机科学 2025-09-26 Yaxiong Wu , Jianyuan Bo , Yongyue Zhang , Sheng Liang , Yong Liu