English
Related papers

Related papers: PRADA: Practical Black-Box Adversarial Attacks aga…

200 papers

In recent years, neural ranking models (NRMs) have been shown to substantially outperform their lexical counterparts in text retrieval. In traditional search pipelines, a combination of features leads to well-defined behaviour. However, as…

Information Retrieval · Computer Science 2024-10-10 Andrew Parry , Sean MacAvaney , Debasis Ganguly

Adversarial prompt attacks can significantly alter the reliability of Retrieval-Augmented Generation (RAG) systems by re-ranking them to produce incorrect outputs. In this paper, we present a novel method that applies Differential Evolution…

Artificial Intelligence · Computer Science 2025-07-22 Jerry Wang , Fang Yu

Training robust deep learning models for down-stream tasks is a critical challenge. Research has shown that down-stream models can be easily fooled with adversarial inputs that look like the training data, but slightly perturbed, in a way…

Machine Learning · Computer Science 2021-01-19 Mahmoud Hossam , Trung Le , He Zhao , Dinh Phung

There has been recently a growing interest in studying adversarial examples on natural language models in the black-box setting. These methods attack natural language classifiers by perturbing certain important words until the classifier…

Machine Learning · Computer Science 2021-05-04 Mahmoud Hossam , Trung Le , He Zhao , Viet Huynh , Dinh Phung

Large language models (LLMs) have been serving as effective backbones for retrieval systems, including Retrieval-Augmentation-Generation (RAG), Dense Information Retriever (IR), and Agent Memory Retrieval. Recent studies have demonstrated…

Cryptography and Security · Computer Science 2026-05-18 Jiate Li , Defu Cao , Li Li , Wei Yang , Yuehan Qin , Chenxiao Yu , Tiannuo Yang , Ryan A. Rossi , Yan Liu , Xiyang Hu , Yue Zhao

Retrieval-Augmented Generation (RAG) enriches LLMs by dynamically retrieving external knowledge, reducing hallucinations and satisfying real-time information needs. While existing research mainly targets RAG's performance and efficiency,…

Information Retrieval · Computer Science 2025-12-29 Zhuo Chen , Yuyang Gong , Jiawei Liu , Miaokun Chen , Haotan Liu , Qikai Cheng , Fan Zhang , Wei Lu , Xiaozhong Liu

Deep neural networks for classification are vulnerable to adversarial attacks, where small perturbations to input samples lead to incorrect predictions. This susceptibility, combined with the black-box nature of such networks, limits their…

Cryptography and Security · Computer Science 2024-08-28 Dipkamal Bhusal , Md Tanvirul Alam , Monish K. Veerabhadran , Michael Clifford , Sara Rampazzi , Nidhi Rastogi

Traffic state prediction is necessary for many Intelligent Transportation Systems applications. Recent developments of the topic have focused on network-wide, multi-step prediction, where state of the art performance is achieved via deep…

Machine Learning · Computer Science 2024-03-12 Bibek Poudel , Weizi Li

Generating adversarial examples in a black-box setting retains a significant challenge with vast practical application prospects. In particular, existing black-box attacks suffer from the need for excessive queries, as it is non-trivial to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Jie Li , Rongrong Ji , Hong Liu , Jianzhuang Liu , Bineng Zhong , Cheng Deng , Qi Tian

Deep Neural Network classifiers are vulnerable to adversarial attack, where an imperceptible perturbation could result in misclassification. However, the vulnerability of DNN-based image ranking systems remains under-explored. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Mo Zhou , Le Wang , Zhenxing Niu , Qilin Zhang , Nanning Zheng , Gang Hua

In recent years, Deep Neural Networks (DNNs) have had a dramatic impact on a variety of problems that were long considered very difficult, e. g., image classification and automatic language translation to name just a few. The accuracy of…

Machine Learning · Computer Science 2019-09-13 Yannik Potdevin , Dirk Nowotka , Vijay Ganesh

Recent studies show that Deep Reinforcement Learning (DRL) models are vulnerable to adversarial attacks, which attack DRL models by adding small perturbations to the observations. However, some attacks assume full availability of the victim…

Machine Learning · Computer Science 2022-02-18 Xinlei Pan , Chaowei Xiao , Warren He , Shuang Yang , Jian Peng , Mingjie Sun , Jinfeng Yi , Zijiang Yang , Mingyan Liu , Bo Li , Dawn Song

Deep neural networks are powerful and popular learning models that achieve state-of-the-art pattern recognition performance on many computer vision, speech, and language processing tasks. However, these networks have also been shown…

Machine Learning · Computer Science 2016-12-20 Nina Narodytska , Shiva Prasad Kasiviswanathan

We explore the black-box adversarial attack on video recognition models. Attacks are only performed on selected key regions and key frames to reduce the high computation cost of searching adversarial perturbations on a video due to its high…

Cryptography and Security · Computer Science 2021-09-01 Zeyuan Wang , Chaofeng Sha , Su Yang

Deep neural networks are vulnerable to adversarial attacks. White-box adversarial attacks can fool neural networks with small adversarial perturbations, especially for large size images. However, keeping successful adversarial perturbations…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Yongwei Wang , Mingquan Feng , Rabab Ward , Z. Jane Wang , Lanjun Wang

Implicit Neural Representations (INRs) have been recently garnering increasing interest in various research fields, mainly due to their ability to represent large, complex data in a compact, continuous manner. Past work further showed that…

Machine Learning · Computer Science 2026-03-04 Tamir Shor , Ethan Fetaya , Chaim Baskin , Alex Bronstein

Language models (LMs) are indispensable tools for natural language processing tasks, but their vulnerability to adversarial attacks remains a concern. While current research has explored adversarial training techniques, their improvements…

Computation and Language · Computer Science 2024-03-28 Brian Formento , Wenjie Feng , Chuan Sheng Foo , Luu Anh Tuan , See-Kiong Ng

Nowadays, digital facial content manipulation has become ubiquitous and realistic with the success of generative adversarial networks (GANs), making face recognition (FR) systems suffer from unprecedented security concerns. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Run Wang , Felix Juefei-Xu , Qing Guo , Yihao Huang , Xiaofei Xie , Lei Ma , Yang Liu

Deep learning (DL) is becoming popular as a new tool for many applications in wireless communication systems. However, for many classification tasks (e.g., modulation classification) it has been shown that DL-based wireless systems are…

Information Theory · Computer Science 2021-01-29 B. R. Manoj , Meysam Sadeghi , Erik G. Larsson

Solving for adversarial examples with projected gradient descent has been demonstrated to be highly effective in fooling the neural network based classifiers. However, in the black-box setting, the attacker is limited only to the query…

Machine Learning · Computer Science 2022-10-19 Seungyong Moon , Gaon An , Hyun Oh Song