English
Related papers

Related papers: Beyond Explicit Refusals: Soft-Failure Attacks on …

200 papers

Retrieval-augmented generation (RAG) has become a common practice in multimodal large language models (MLLM) to enhance factual grounding and reduce hallucination. Yet, its reliance on retrieval exposes MLLMs to knowledge poisoning attacks,…

Retrieval-augmented generation (RAG) is a widely adopted paradigm for enhancing LLMs in medical applications by incorporating expert multimodal knowledge during generation. However, the underlying retrieval databases may naturally contain,…

Cryptography and Security · Computer Science 2026-05-12 Peiru Yang , Haoran Zheng , Tong Ju , Shiting Wang , Wanchun Ni , Jiajun Liu , Shangguang Wang , Yongfeng Huang , Tao Qi

Cellular systems are vulnerable to jamming attacks, especially smart jammers that choose their jamming policies such as the jamming channel frequencies and power based on the ongoing communication policies and network states. In this…

Signal Processing · Electrical Eng. & Systems 2019-04-24 Xiaozhen Lu , Liang Xiao , Canhuang Dai , Huaiyu Dai

Automatic Speech Recognition (ASR) systems have demonstrated remarkable performance across various applications. However, limited data and the unique language features of specific domains, such as low-resource languages, significantly…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Amin Robatian , Mohammad Hajipour , Mohammad Reza Peyghan , Fatemeh Rajabi , Sajjad Amini , Shahrokh Ghaemmaghami , Iman Gholampour

Fact-checking systems with search-enabled large language models (LLMs) have shown strong potential for verifying claims by dynamically retrieving external evidence. However, the robustness of such systems against adversarial attack remains…

Cryptography and Security · Computer Science 2026-03-17 Haoran Ou , Kangjie Chen , Gelei Deng , Hangcheng Liu , Jie Zhang , Tianwei Zhang , Kwok-Yan Lam

Retrieval-Augmented Generation (RAG) significantly enhances Large Language Models (LLMs) by providing access to external knowledge. However, current research primarily focuses on retrieval quality, often overlooking the critical…

Computation and Language · Computer Science 2026-04-16 Zhengyi Zhao , Shubo Zhang , Zezhong Wang , Yuxi Zhang , Huimin Wang , Yutian Zhao , Yefeng Zheng , Binyang Li , Kam-Fai Wong , Xian Wu

Fooling deep neural networks with adversarial input have exposed a significant vulnerability in the current state-of-the-art systems in multiple domains. Both black-box and white-box approaches have been used to either replicate the model…

Cryptography and Security · Computer Science 2019-07-04 Shreya Khare , Rahul Aralikatte , Senthil Mani

With the recent surge of language models in different applications, attention to safety and robustness of these models has gained significant importance. Here we introduce a joint framework in which we simultaneously probe and improve the…

Artificial Intelligence · Computer Science 2023-11-17 Ninareh Mehrabi , Palash Goyal , Anil Ramakrishna , Jwala Dhamala , Shalini Ghosh , Richard Zemel , Kai-Wei Chang , Aram Galstyan , Rahul Gupta

Retrieval-augmented generation (RAG) extends large language models (LLMs) with external knowledge, but it must balance limited effective context, redundant retrieved evidence, and the loss of fine-grained facts under aggressive compression.…

Computation and Language · Computer Science 2026-04-24 Yiqiao Jin , Rachneet Kaur , Zhen Zeng , Sumitra Ganesh , Srijan Kumar

CNN-based face recognition models have brought remarkable performance improvement, but they are vulnerable to adversarial perturbations. Recent studies have shown that adversaries can fool the models even if they can only access the models'…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Junyoung Byun , Hyojun Go , Changick Kim

Retrieval-Augmented Generation (RAG) systems are vulnerable to knowledge base poisoning, yet existing attacks have been evaluated almost exclusively against vanilla retrieve-then-generate pipelines. Architectures designed to handle…

Cryptography and Security · Computer Science 2026-05-08 Samuel Korn

Retrieval-augmented generation (RAG) mitigates the hallucination problem in large language models (LLMs) and has proven effective for personalized usages. However, delivering private retrieved documents directly to LLMs introduces…

Computation and Language · Computer Science 2025-11-25 Yujin Choi , Youngjoo Park , Junyoung Byun , Jaewook Lee , Jinseong Park

While Retrieval-Augmented Generation (RAG) mitigates hallucination and knowledge staleness in Large Language Models (LLMs), existing frameworks often falter on complex, multi-hop queries that require synthesizing information from disparate…

Computation and Language · Computer Science 2025-10-28 Mohammad Aghajani Asl , Majid Asgari-Bidhendi , Behrooz Minaei-Bidgoli

Large Language Models (LLMs) are becoming essential tools for various natural language processing tasks but often suffer from generating outdated or incorrect information. Retrieval-Augmented Generation (RAG) addresses this issue by…

The rapid development of large language models has led to the widespread adoption of Retrieval-Augmented Generation (RAG), which integrates external knowledge to alleviate knowledge bottlenecks and mitigate hallucinations. However, the…

Computation and Language · Computer Science 2024-10-10 Ruotong Pan , Boxi Cao , Hongyu Lin , Xianpei Han , Jia Zheng , Sirui Wang , Xunliang Cai , Le Sun

Accurately identifying adversarial techniques in security texts is critical for effective cyber defense. However, existing methods face a fundamental trade-off: they either rely on generic models with limited domain precision or require…

Cryptography and Security · Computer Science 2025-08-12 Ahmed Lekssays , Utsav Shukla , Husrev Taha Sencar , Md Rizwan Parvez

Although Large Language Models (LLMs) demonstrate significant capabilities, their reliance on parametric knowledge often leads to inaccuracies. Retrieval Augmented Generation (RAG) mitigates this by incorporating external knowledge, but…

Artificial Intelligence · Computer Science 2025-11-04 Hailong Yin , Bin Zhu , Jingjing Chen , Chong-Wah Ngo

Large language models (LLMs) achieve impressive performance across diverse tasks yet remain vulnerable to jailbreak attacks that bypass safety mechanisms. We present RAID (Refusal-Aware and Integrated Decoding), a framework that…

Computation and Language · Computer Science 2025-12-23 Tuan T. Nguyen , John Le , Thai T. Vu , Willy Susilo , Heath Cooper

Small language models (SLMs) support efficient deployments on resource-constrained edge devices, but their limited capacity compromises inference performance. Retrieval-augmented generation (RAG) is a promising solution to enhance model…

Machine Learning · Computer Science 2025-04-17 Shangyu Liu , Zhenzhe Zheng , Xiaoyao Huang , Fan Wu , Guihai Chen , Jie Wu

Automatic speech recognition (ASR) systems are known to be vulnerable to adversarial attacks. This paper addresses detection and defence against targeted white-box attacks on speech signals for ASR systems. While existing work has utilised…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-13 Nikolai L. Kühne , Astrid H. F. Kitchen , Marie S. Jensen , Mikkel S. L. Brøndt , Martin Gonzalez , Christophe Biscio , Zheng-Hua Tan