中文
相关论文

相关论文: One Pic is All it Takes: Poisoning Visual Document…

200 篇论文

Retrieval-augmented generation (RAG) systems are widely deployed in real-world applications in diverse domains such as finance, healthcare, and cybersecurity. However, many studies showed that they are vulnerable to knowledge corruption…

密码学与安全 · 计算机科学 2025-08-27 Runpeng Geng , Yanting Wang , Ying Chen , Jinyuan Jia

Retrieval Augmented Generation (RAG) expands the capabilities of modern large language models (LLMs), by anchoring, adapting, and personalizing their responses to the most relevant knowledge sources. It is particularly useful in chatbot…

Large Language Models (LLMs) have demonstrated remarkable capabilities in generating coherent text but remain limited by the static nature of their training data. Retrieval Augmented Generation (RAG) addresses this issue by combining LLMs…

密码学与安全 · 计算机科学 2024-10-21 Cody Clop , Yannick Teglia

Question answering over visually rich documents (VRDs) requires reasoning not only over isolated content but also over documents' structural organization and cross-page dependencies. However, conventional retrieval-augmented generation…

Large language models (LLMs) have transformed natural language processing (NLP), enabling applications from content generation to decision support. Retrieval-Augmented Generation (RAG) improves LLMs by incorporating external knowledge but…

密码学与安全 · 计算机科学 2025-11-11 Zirui Cheng , Jikai Sun , Anjun Gao , Yueyang Quan , Zhuqing Liu , Xiaohua Hu , Minghong Fang

Retrieval-Augmented Generation (RAG) significantly enhances Large Language Models (LLMs), but simultaneously exposes a critical vulnerability to knowledge poisoning attacks. Existing attack methods like PoisonedRAG remain detectable due to…

密码学与安全 · 计算机科学 2026-04-10 Ziye Wang , Guanyu Wang , Kailong Wang

Advanced multimodal Retrieval-Augmented Generation (MRAG) techniques have been widely applied to enhance the capabilities of Large Multimodal Models (LMMs), but they also bring along novel safety issues. Existing adversarial research has…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Linyin Luo , Yujuan Ding , Yunshan Ma , Wenqi Fan , Hanjiang Lai

Multi-modal Retrieval-Augmented Generation (RAG) has become a critical method for empowering LLMs by leveraging candidate visual documents. However, current methods consider the entire document as the basic retrieval unit, introducing…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Yinglu Li , Zhiying Lu , Zhihang Liu , Yiwei Sun , Chuanbin Liu , Hongtao Xie

Retrieval-Augmented Generation (RAG) enriches the input to LLMs by retrieving information from the relevant knowledge database, enabling them to produce responses that are more accurate and contextually appropriate. It is worth noting that…

密码学与安全 · 计算机科学 2025-09-01 Xue Tan , Hao Luan , Mingyu Luo , Xiaoyan Sun , Ping Chen , Jun Dai

Retrieval-Augmented Generation (RAG) has proven effective in mitigating hallucinations in large language models by incorporating external knowledge during inference. However, this integration introduces new security vulnerabilities,…

密码学与安全 · 计算机科学 2025-05-27 Baolei Zhang , Haoran Xin , Jiatong Li , Dongzhe Zhang , Minghong Fang , Zhuqing Liu , Lihai Nie , Zheli Liu

Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of applications, e.g., medical question-answering, mathematical sciences, and code generation. However, they also exhibit inherent limitations, such…

密码学与安全 · 计算机科学 2025-06-23 Yang Jiao , Xiaodong Wang , Kai Yang

Retrieval-Augmented Generation (RAG) is a powerful strategy for improving the factual accuracy of models by retrieving external knowledge relevant to queries and incorporating it into the generation process. However, existing approaches…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Soyeong Jeong , Kangsan Kim , Jinheon Baek , Sung Ju Hwang

Existing multimodal Retrieval-Augmented Generation (RAG) methods for visually rich documents (VRD) are often biased towards retrieving salient knowledge(e.g., prominent text and visual elements), while largely neglecting the critical…

信息检索 · 计算机科学 2025-11-26 Anyang Tong , Xiang Niu , ZhiPing Liu , Chang Tian , Yanyan Wei , Zenglin Shi , Meng Wang

Retrieval-augmented generation (RAG) has emerged as a powerful paradigm for enhancing multimodal large language models by grounding their responses in external, factual knowledge and thus mitigating hallucinations. However, the integration…

密码学与安全 · 计算机科学 2026-03-03 Kennedy Edemacu , Mohammad Mahdi Shokri

Retrieval-Augmented Generation (RAG) has become a core paradigm in document question answering tasks. However, existing methods have limitations when dealing with multimodal documents: one category of methods relies on layout analysis and…

计算与语言 · 计算机科学 2026-03-09 Wang Chen , Wenhan Yu , Guanqiang Qi , Weikang Li , Yang Li , Lei Sha , Deguo Xia , Jizhou Huang

Retrieval-Augmented Generation (RAG) systems have emerged as a promising solution to mitigate LLM hallucinations and enhance their performance in knowledge-intensive domains. However, these systems are vulnerable to adversarial poisoning…

信息检索 · 计算机科学 2025-07-29 Jinyan Su , Jin Peng Zhou , Zhengxin Zhang , Preslav Nakov , Claire Cardie

Retrieval-augmented generation (RAG) systems can effectively mitigate the hallucination problem of large language models (LLMs),but they also possess inherent vulnerabilities. Identifying these weaknesses before the large-scale real-world…

信息检索 · 计算机科学 2025-05-23 Hongru Song , Yu-an Liu , Ruqing Zhang , Jiafeng Guo , Yixing Fan

Large language models (LLMs) have achieved remarkable success due to their exceptional generative capabilities. Despite their success, they also have inherent limitations such as a lack of up-to-date knowledge and hallucination.…

密码学与安全 · 计算机科学 2024-08-14 Wei Zou , Runpeng Geng , Binghui Wang , Jinyuan Jia

Retrieval-augmented generation (RAG) has emerged as a pivotal technique in artificial intelligence (AI), particularly in enhancing the capabilities of large language models (LLMs) by enabling access to external, reliable, and up-to-date…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Xu Zheng , Ziqiao Weng , Yuanhuiyi Lyu , Lutao Jiang , Haiwei Xue , Bin Ren , Danda Paudel , Nicu Sebe , Luc Van Gool , Xuming Hu

Retrieval-Augmented Generation (RAG) systems based on Large Language Models (LLMs) have become a core technology for tasks such as question-answering (QA) and content generation. RAG poisoning is an attack method to induce LLMs to generate…

人工智能 · 计算机科学 2026-01-13 Meng Xi , Sihan Lv , Yechen Jin , Guanjie Cheng , Naibo Wang , Ying Li , Jianwei Yin