中文
相关论文

相关论文: Privacy-Preserving Reasoning with Knowledge-Distil…

200 篇论文

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

计算与语言 · 计算机科学 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

The continued promise of Large Language Models (LLMs), particularly in their natural language understanding and generation capabilities, has driven a rapidly increasing interest in identifying and developing LLM use cases. In an effort to…

密码学与安全 · 计算机科学 2026-01-08 Andreea-Elena Bodea , Stephen Meisenbacher , Alexandra Klymenko , Florian Matthes

Retrieval Augmented Generation (RAG) has become the standard approach for equipping Large Language Models (LLMs) with up-to-date knowledge. However, standard RAG, relying on independent passage retrieval, often fails to capture the…

计算与语言 · 计算机科学 2025-11-20 Jingjin Wang , Jiawei Han

Retrieval-augmented generation (RAG) improves the service quality of large language models by retrieving relevant documents from credible literature and integrating them into the context of the user query. Recently, the rise of the cloud…

信息检索 · 计算机科学 2024-12-18 Yihang Cheng , Lan Zhang , Junyang Wang , Mu Yuan , Yunhao Yao

While large language models (LLMs) excel in various natural language processing tasks, their huge size and the inaccessibility of parameters present challenges for practical deployment. Previous studies try to distill task-specific ability…

计算与语言 · 计算机科学 2024-03-21 Xuekai Zhu , Biqing Qi , Kaiyan Zhang , Xinwei Long , Zhouhan Lin , Bowen Zhou

Retrieval-Augmented Generation (RAG) is an emerging approach in natural language processing that combines large language models (LLMs) with external document retrieval to produce more accurate and grounded responses. While RAG has shown…

密码学与安全 · 计算机科学 2025-09-25 Atousa Arzanipour , Rouzbeh Behnia , Reza Ebrahimi , Kaushik Dutta

Retrieval-Augmented Generation (RAG) enables large language models to use external knowledge, but outsourcing the RAG service raises privacy concerns for both data owners and users. Privacy-preserving RAG systems address these concerns by…

密码学与安全 · 计算机科学 2026-05-29 Yulong Ming , Mingyue Wang , Jijia Yang , Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However,…

计算与语言 · 计算机科学 2025-06-10 Weihang Su , Qingyao Ai , Jingtao Zhan , Qian Dong , Yiqun Liu

LLMs often suffer from hallucinations and outdated or incomplete knowledge. RAG is proposed to address these issues by integrating external knowledge like that in KGs into LLMs. However, leveraging private KGs in RAG systems poses…

计算与语言 · 计算机科学 2025-12-04 Yunfeng Ning , Mayi Xu , Jintao Wen , Qiankun Pi , Yuanyuan Zhu , Ming Zhong , Jiawei Jiang , Tieyun Qian

While data synthesis and distillation are promising strategies to enhance small language models, current approaches heavily rely on Large Language Models (LLMs), which suffer from high computational costs, environmental inefficiency, and…

计算与语言 · 计算机科学 2025-04-22 Xin Gao , Qizhi Pei , Zinan Tang , Yu Li , Honglin Lin , Jiang Wu , Lijun Wu , Conghui He

Document-level knowledge graph (KG) construction faces a fundamental scaling challenge: existing methods either rely on expensive large language models (LLMs), making them economically nonviable for large-scale corpora, or employ smaller…

Retrieval-Augmented Generation (RAG) enhances the factual accuracy of large language models (LLMs) by conditioning outputs on external knowledge sources. However, when retrieval involves private or sensitive data, RAG systems are…

计算与语言 · 计算机科学 2025-08-06 Haoran Wang , Xiongxiao Xu , Baixiang Huang , Kai Shu

Retrieval-Augmented Generation (RAG) has recently emerged as a promising solution for enhancing the accuracy and credibility of Large Language Models (LLMs), particularly in Question & Answer tasks. This is achieved by incorporating…

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Retrieval-augmented generation (RAG) is a powerful technique to facilitate language model with proprietary and private data, where data privacy is a pivotal concern. Whereas extensive research has demonstrated the privacy risks of large…

密码学与安全 · 计算机科学 2024-03-03 Shenglai Zeng , Jiankun Zhang , Pengfei He , Yue Xing , Yiding Liu , Han Xu , Jie Ren , Shuaiqiang Wang , Dawei Yin , Yi Chang , Jiliang Tang

Large language models (LLMs) inevitably exhibit hallucinations since the accuracy of generated texts cannot be secured solely by the parametric knowledge they encapsulate. Although retrieval-augmented generation (RAG) is a practicable…

计算与语言 · 计算机科学 2024-10-08 Shi-Qi Yan , Jia-Chen Gu , Yun Zhu , Zhen-Hua Ling

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

计算与语言 · 计算机科学 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

Retrieval-augmented generation (RAG) aims to mitigate the hallucination of Large Language Models (LLMs) by retrieving and incorporating relevant external knowledge into the generation process. However, the external knowledge may contain…

计算与语言 · 计算机科学 2026-01-12 Yi Sui , Chaozhuo Li , Chen Zhang , Dawei song , Qiuchi Li

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources to address their limitations in accessing up-to-date or specialized information. A natural strategy to increase the…

计算与语言 · 计算机科学 2025-11-10 Song Wang , Zihan Chen , Peng Wang , Zhepei Wei , Zhen Tan , Yu Meng , Cong Shen , Jundong Li

Existing Retrieval-Augmented Generation (RAG) systems face challenges in enterprise settings due to limited retrieval scope and data security risks. When relevant internal documents are unavailable, the system struggles to generate accurate…

计算与语言 · 计算机科学 2025-07-18 Grace Byun , Shinsun Lee , Nayoung Choi , Jinho D. Choi