English
Related papers

Related papers: Query-Efficient Hard-label Black-box Attack:An Opt…

200 papers

Adversarial text attack research plays a crucial role in evaluating the robustness of NLP models. However, the increasing complexity of transformer-based architectures has dramatically raised the computational cost of attack testing,…

Computation and Language · Computer Science 2025-09-26 Abhinay Shankar Belde , Rohit Ramkumar , Jonathan Rusert

While modern day web applications aim to create impact at the civilization level, they have become vulnerable to adversarial activity, where the next cyber-attack can take any shape and can originate from anywhere. The increasing scale and…

Machine Learning · Statistics 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic

In this paper, we study the standard formulation of an optimization problem when the computation of gradient is not available. Such a problem can be classified as a "black box" optimization problem, since the oracle returns only the value…

Optimization and Control · Mathematics 2024-09-30 Aleksandr Lobanov , Nail Bashirov , Alexander Gasnikov

Black-box optimization is primarily important for many compute-intensive applications, including reinforcement learning (RL), robot control, etc. This paper presents a novel theoretical framework for black-box optimization, in which our…

Machine Learning · Computer Science 2020-09-10 Yueming Lyu , Ivor W. Tsang

With the broad application of deep neural networks (DNNs), backdoor attacks have gradually attracted attention. Backdoor attacks are insidious, and poisoned models perform well on benign samples and are only triggered when given specific…

Machine Learning · Computer Science 2022-07-12 Chang Yue , Peizhuo Lv , Ruigang Liang , Kai Chen

Semantic segmentation is a fundamental visual task that finds extensive deployment in applications with security-sensitive considerations. Nonetheless, recent work illustrates the adversarial vulnerability of semantic segmentation models to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaoyu Chen , Zhengyang Shan , Jingwen Chang , Kaixun Jiang , Dingkang Yang , Yiting Cheng , Wenqiang Zhang

Previous studies have verified that the functionality of black-box models can be stolen with full probability outputs. However, under the more practical hard-label setting, we observe that existing methods suffer from catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yixu Wang , Jie Li , Hong Liu , Yan Wang , Yongjian Wu , Feiyue Huang , Rongrong Ji

We introduce a novel approach for batch selection in Stochastic Gradient Descent (SGD) training, leveraging combinatorial bandit algorithms. Our methodology focuses on optimizing the learning process in the presence of label noise, a…

Machine Learning · Computer Science 2023-11-02 Michal Lisicki , Mihai Nica , Graham W. Taylor

A distribution inference attack aims to infer statistical properties of data used to train machine learning models. These attacks are sometimes surprisingly potent, but the factors that impact distribution inference risk are not well…

Machine Learning · Computer Science 2024-04-09 Anshuman Suri , Yifu Lu , Yanjin Chen , David Evans

Decision-based methods have shown to be effective in black-box adversarial attacks, as they can obtain satisfactory performance and only require to access the final model prediction. Gradient estimation is a critical step in black-box…

Machine Learning · Computer Science 2023-10-31 Han Liu , Xingshuo Huang , Xiaotong Zhang , Qimai Li , Fenglong Ma , Wei Wang , Hongyang Chen , Hong Yu , Xianchao Zhang

Utilizing language models (LMs) without internal access is becoming an attractive paradigm in the field of NLP as many cutting-edge LMs are released through APIs and boast a massive scale. The de-facto method in this type of black-box…

Computation and Language · Computer Science 2023-06-12 Hyunsoo Cho , Youna Kim , Sang-goo Lee

Membership inference attacks are designed to determine, using black box access to trained models, whether a particular example was used in training or not. Membership inference can be formalized as a hypothesis testing problem. The most…

Machine Learning · Computer Science 2023-07-10 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Deep learning (DL) is becoming popular as a new tool for many applications in wireless communication systems. However, for many classification tasks (e.g., modulation classification) it has been shown that DL-based wireless systems are…

Information Theory · Computer Science 2021-01-29 B. R. Manoj , Meysam Sadeghi , Erik G. Larsson

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

Machine Learning · Computer Science 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev

Adversarial ranking attacks have gained increasing attention due to their success in probing vulnerabilities, and, hence, enhancing the robustness, of neural ranking models. Conventional attack methods employ perturbations at a single…

Information Retrieval · Computer Science 2024-04-12 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Gradient-based optimization is the workhorse of deep learning, offering efficient and scalable training via backpropagation. However, exposing gradients during training can leak sensitive information about the underlying data, raising…

Machine Learning · Computer Science 2026-01-06 Ismail Labiad , Mathurin Videau , Matthieu Kowalski , Marc Schoenauer , Alessandro Leite , Julia Kempe , Olivier Teytaud

There has been recently a growing interest in studying adversarial examples on natural language models in the black-box setting. These methods attack natural language classifiers by perturbing certain important words until the classifier…

Machine Learning · Computer Science 2021-05-04 Mahmoud Hossam , Trung Le , He Zhao , Viet Huynh , Dinh Phung

Gradient-based attacks are a primary tool to evaluate robustness of machine-learning models. However, many attacks tend to provide overly-optimistic evaluations as they use fixed loss functions, optimizers, step-size schedulers, and default…

Offline Reinforcement Learning (RL) enables policy optimization from static datasets but is inherently vulnerable to backdoor attacks. Existing attack strategies typically struggle against safety-constrained algorithms (e.g., CQL) due to…

Machine Learning · Computer Science 2026-01-16 Yuanjie Zhao , Junnan Qiu , Yue Ding , Jie Li

Decision-based attacks construct adversarial examples against a machine learning (ML) model by making only hard-label queries. These attacks have mainly been applied directly to standalone neural networks. However, in practice, ML models…

Cryptography and Security · Computer Science 2023-07-24 Chawin Sitawarin , Florian Tramèr , Nicholas Carlini