English
Related papers

Related papers: DeRAG: Black-box Adversarial Attacks on Multiple R…

200 papers

Retrieval-Augmented Generation (RAG) systems often face limitations in specialized domains such as fintech, where domain-specific ontologies, dense terminology, and acronyms complicate effective retrieval and synthesis. This paper…

Artificial Intelligence · Computer Science 2025-10-30 Thomas Cook , Richard Osuagwu , Liman Tsatiashvili , Vrynsia Vrynsia , Koustav Ghosal , Maraim Masoud , Riccardo Mattivi

Retrieval-Augmented Generation (RAG) significantly enhances Large Language Models (LLMs), but simultaneously exposes a critical vulnerability to knowledge poisoning attacks. Existing attack methods like PoisonedRAG remain detectable due to…

Cryptography and Security · Computer Science 2026-04-10 Ziye Wang , Guanyu Wang , Kailong Wang

In Large Language Models, Retrieval-Augmented Generation (RAG) systems can significantly enhance the performance of large language models by integrating external knowledge. However, RAG also introduces new security risks. Existing research…

Machine Learning · Computer Science 2025-06-16 Linlin Wang , Tianqing Zhu , Laiqiao Qin , Longxiang Gao , Wanlei Zhou

Retrieval-Augmented Generation (RAG) systems often fail to maintain contextual faithfulness, generating responses that conflict with the provided context or fail to fully leverage the provided evidence. Existing methods attempt to improve…

Computation and Language · Computer Science 2026-04-16 Linfeng Gao , Qinggang Zhang , Baolong Bi , Bo Zeng , Zheng Yuan , Zerui Chen , Zhimin Wei , Shenghua Liu , Linlong Xu , Longyue Wang , Weihua Luo , Jinsong Su

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external documents at inference time, enabling up-to-date knowledge access without costly retraining. However, conventional RAG methods retrieve…

Computation and Language · Computer Science 2025-07-08 Ting-Wen Ko , Jyun-Yu Jiang , Pu-Jen Cheng

Robust content moderation requires classification systems that can quickly adapt to evolving policies without costly retraining. We present classification using Retrieval-Augmented Generation (RAG), which shifts traditional classification…

Computation and Language · Computer Science 2025-08-11 Richard Willats , Josh Pennington , Aravind Mohan , Bertie Vidgen

Large Language Models (LLMs) can be driven into over-generation, emitting thousands of tokens before producing an end-of-sequence (EOS) token. This degrades answer quality, inflates latency and cost, and can be weaponized as a…

Cryptography and Security · Computer Science 2026-01-21 Manu , Yi Guo , Kanchana Thilakarathna , Nirhoshan Sivaroopan , Jo Plested , Tim Lynar , Jack Yang , Wangli Yang

Retrieval-augmented generation resorts to content retrieved from external sources in order to leverage the performance of large language models in downstream tasks. The excessive volume of retrieved content, the possible dispersion of its…

Computation and Language · Computer Science 2024-07-08 João Rodrigues , António Branco

Large Language Models (LLMs) are increasingly embedded in autonomous systems and public-facing environments, yet they remain susceptible to jailbreak vulnerabilities that may undermine their security and trustworthiness. Adversarial…

Machine Learning · Computer Science 2025-05-15 David Khachaturov , Robert Mullins

Retrieval-Augmented Generation (RAG) has attracted significant attention due to its ability to combine the generative capabilities of Large Language Models (LLMs) with knowledge obtained through efficient retrieval mechanisms over…

Cryptography and Security · Computer Science 2026-01-19 Aiman Al Masoud , Marco Arazzi , Antonino Nocera

This paper addresses the challenge of comprehending very long contexts in Large Language Models (LLMs) by proposing a method that emulates Retrieval Augmented Generation (RAG) through specialized prompt engineering and chain-of-thought…

Computation and Language · Computer Science 2025-02-19 Joon Park , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Large Language Models (LLMs) exhibit remarkable capabilities but are susceptible to adversarial prompts that exploit vulnerabilities to produce unsafe or biased outputs. Existing red-teaming methods often face scalability challenges,…

Computation and Language · Computer Science 2026-01-21 Quy-Anh Dang , Chris Ngo , Truong-Son Hy

Retrieval-Augmented Generation (RAG) has emerged as the dominant architectural pattern to operationalize Large Language Model (LLM) usage in Cyber Threat Intelligence (CTI) systems. However, this design is susceptible to poisoning attacks,…

Cryptography and Security · Computer Science 2025-12-17 Austin Jia , Avaneesh Ramesh , Zain Shamsi , Daniel Zhang , Alex Liu

In recent years, deep reinforcement learning (Deep RL) has been successfully implemented as a smart agent in many systems such as complex games, self-driving cars, and chat-bots. One of the interesting use cases of Deep RL is its…

Machine Learning · Computer Science 2023-09-27 Foozhan Ataiefard , Hadi Hemmati

Adversarial generative models, such as Generative Adversarial Networks (GANs), are widely applied for generating various types of data, i.e., images, text, and audio. Accordingly, its promising performance has led to the GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Zhiyu Zhu , Huaming Chen , Xinyi Wang , Jiayu Zhang , Zhibo Jin , Kim-Kwang Raymond Choo , Jun Shen , Dong Yuan

Code Search is a key task that many programmers often have to perform while developing solutions to problems. Current methodologies suffer from an inability to perform accurately on prompts that contain some ambiguity or ones that require…

Software Engineering · Computer Science 2024-08-22 Sarthak Jain , Aditya Dora , Ka Seng Sam , Prabhat Singh

Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round retrieval and reasoning to resolve queries. Although recent…

Information Retrieval · Computer Science 2025-11-10 Chao Zhang , Yuhao Wang , Derong Xu , Haoxin Zhang , Yuanjie Lyu , Yuhao Chen , Shuochen Liu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

The indexing-retrieval-generation paradigm of retrieval-augmented generation (RAG) has been highly successful in solving knowledge-intensive tasks by integrating external knowledge into large language models (LLMs). However, the…

Cryptography and Security · Computer Science 2025-02-25 Xun Liang , Simin Niu , Zhiyu Li , Sensen Zhang , Hanyu Wang , Feiyu Xiong , Jason Zhaoxin Fan , Bo Tang , Shichao Song , Mengwei Wang , Jiawei Yang

Deep neural networks are vulnerable to adversarial examples, which are crafted by adding human-imperceptible perturbations to original images. Most existing adversarial attack methods achieve nearly 100% attack success rates under the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Guoqiu Wang , Huanqian Yan , Ying Guo , Xingxing Wei

Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks even under a black-box setting where the adversary can only query the model. Particularly, query-based black-box adversarial attacks estimate adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xin Wang , Kai Chen , Xingjun Ma , Zhineng Chen , Jingjing Chen , Yu-Gang Jiang