English
Related papers

Related papers: AutoZOOM: Autoencoder-based Zeroth Order Optimizat…

200 papers

Neural text ranking models have witnessed significant advancement and are increasingly being deployed in practice. Unfortunately, they also inherit adversarial vulnerabilities of general neural models, which have been detected but remain…

Information Retrieval · Computer Science 2023-04-19 Jiawei Liu , Yangyang Kang , Di Tang , Kaisong Song , Changlong Sun , Xiaofeng Wang , Wei Lu , Xiaozhong Liu

Deep neural networks can be exploited using natural adversarial samples, which do not impact human perception. Current approaches often rely on deep neural networks' white-box nature to generate these adversarial samples or synthetically…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Shashank Kotyan , Po-Yuan Mao , Pin-Yu Chen , Danilo Vasconcellos Vargas

Zeroth-order (ZO) optimization provides a gradient-free alternative to first-order (FO) methods by estimating gradients via finite differences of function evaluations, and has recently emerged as a memory-efficient paradigm for fine-tuning…

Machine Learning · Computer Science 2026-02-24 Yicheng Lang , Changsheng Wang , Yihua Zhang , Mingyi Hong , Zheng Zhang , Wotao Yin , Sijia Liu

In the last decade, deep neural networks have proven to be very powerful in computer vision tasks, starting a revolution in the computer vision and machine learning fields. However, deep neural networks, usually, are not robust to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Hao Qiu , Leonardo Lucio Custode , Giovanni Iacca

Recent work has shown that by approximating the behaviour of a non-differentiable black-box function using a neural network, the black-box can be integrated into a differentiable training pipeline for end-to-end training. This methodology…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Ganesh Tata , Katyani Singh , Eric Van Oeveren , Nilanjan Ray

In the learning to learn (L2L) framework, we cast the design of optimization algorithms as a machine learning problem and use deep neural networks to learn the update rules. In this paper, we extend the L2L framework to zeroth-order (ZO)…

Machine Learning · Computer Science 2020-02-10 Yangjun Ruan , Yuanhao Xiong , Sashank Reddi , Sanjiv Kumar , Cho-Jui Hsieh

Black-box adversarial attacks generate adversarial samples via iterative optimizations using repeated queries. Defending deep neural networks against such attacks has been challenging. In this paper, we propose an efficient Boundary Defense…

Cryptography and Security · Computer Science 2022-02-01 Manjushree B. Aithal , Xiaohua Li

Zeroth-order optimizers have recently emerged as a practical approach for fine-tuning large language models (LLMs), significantly reducing GPU memory consumption compared to traditional first-order methods. Yet, existing zeroth-order…

Machine Learning · Computer Science 2025-10-02 Kairun Zhang , Haoyu Li , Yanjun Zhao , Yifan Sun , Huan Zhang

Traditional decision-based black-box adversarial attacks on image classifiers aim to generate adversarial examples by slightly modifying input images while keeping the number of queries low, where each query involves sending an input to the…

Machine Learning · Computer Science 2025-06-10 Mahdi Salmani , Alireza Abdollahpoorrostam , Seyed-Mohsen Moosavi-Dezfooli

Zeroth-order (ZO) optimization has long been favored for its biological plausibility and its capacity to handle non-differentiable objectives, yet its computational complexity has historically limited its application in deep neural…

Machine Learning · Computer Science 2026-02-12 Sansheng Cao , Zhengyu Ma , Yonghong Tian

While deep neural networks show unprecedented performance in various tasks, the vulnerability to adversarial examples hinders their deployment in safety-critical systems. Many studies have shown that attacks are also possible even in a…

Cryptography and Security · Computer Science 2021-11-09 Junyoung Byun , Hyojun Go , Changick Kim

Researchers have repeatedly shown that it is possible to craft adversarial attacks on deep classifiers (small perturbations that significantly change the class label), even in the "black-box" setting where one only has query access to the…

Machine Learning · Computer Science 2021-02-02 Devin Willmott , Anit Kumar Sahu , Fatemeh Sheikholeslami , Filipe Condessa , Zico Kolter

Deep neural networks have recently achieved tremendous success in image classification. Recent studies have however shown that they are easily misled into incorrect classification decisions by adversarial examples. Adversaries can even…

Machine Learning · Computer Science 2019-03-27 Yujia Liu , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard

We investigate how an adversary can optimally use its query budget for targeted evasion attacks against deep neural networks in a black-box setting. We formalize the problem setting and systematically evaluate what benefits the adversary…

Machine Learning · Computer Science 2020-10-23 Mika Juuti , Buse Gul Atli , N. Asokan

This paper proposes a black-box adversarial attack method to automatic speech recognition systems. Some studies have attempted to attack neural networks for speech recognition; however, these methods did not consider the robustness of…

Sound · Computer Science 2024-07-09 Shoma Ishida , Satoshi Ono

Machine learning (ML) models, e.g., deep neural networks (DNNs), are vulnerable to adversarial examples: malicious inputs modified to yield erroneous model outputs, while appearing unmodified to human observers. Potential attacks include…

Cryptography and Security · Computer Science 2017-03-21 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow , Somesh Jha , Z. Berkay Celik , Ananthram Swami

Deep learning models, despite their impressive achievements, suffer from high computational costs and memory requirements, limiting their usability in resource-constrained environments. Sparse neural networks significantly alleviate these…

Machine Learning · Computer Science 2026-03-16 Jie Ji , Gen Li , Kaiyuan Deng , Fatemeh Afghah , Xiaolong Ma

Zeroth-Order optimization presents a promising memory-efficient paradigm for fine-tuning Large Language Models by relying solely on forward passes. However, its practical adoption is severely constrained by slow wall-clock convergence and…

Machine Learning · Computer Science 2026-04-21 Fei Wang , Li Shen , Liang Ding , Chao Xue , Ye Liu , Changxing Ding

Face recognition has obtained remarkable progress in recent years due to the great improvement of deep convolutional neural networks (CNNs). However, deep CNNs are vulnerable to adversarial examples, which can cause fateful consequences in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Yinpeng Dong , Hang Su , Baoyuan Wu , Zhifeng Li , Wei Liu , Tong Zhang , Jun Zhu

Recent research has found that neural networks are vulnerable to several types of adversarial attacks, where the input samples are modified in such a way that the model produces a wrong prediction that misclassifies the adversarial sample.…

Machine Learning · Computer Science 2022-10-07 Jary Pomponi , Simone Scardapane , Aurelio Uncini