English
Related papers

Related papers: AutoZOOM: Autoencoder-based Zeroth Order Optimizat…

200 papers

Large language models (LLMs) have demonstrated impressive capabilities across numerous NLP tasks. Nevertheless, conventional first-order fine-tuning techniques impose heavy memory demands, creating practical obstacles to real-world…

Machine Learning · Computer Science 2025-05-27 Zhendong Mi , Qitao Tan , Xiaodong Yu , Zining Zhu , Geng Yuan , Shaoyi Huang

Many adversarial attacks have been proposed to investigate the security issues of deep neural networks. In the black-box setting, current model stealing attacks train a substitute model to counterfeit the functionality of the target model.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Chen Ma , Li Chen , Jun-Hai Yong

Because noise can interfere with downstream analysis, image denoising has come to occupy an important place in the image processing toolbox. The most accurate state-of-the-art denoisers typically train on a representative dataset. But…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Jason Lequyer , Wen-Hsin Hsu , Reuben Philip , Anna Christina Erpf , Laurence Pelletier

Black-box attacks usually face two problems: poor transferability and the inability to evade the adversarial defense. To overcome these shortcomings, we create an original approach to generate adversarial examples by smoothing the linear…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Hui Xia , Rui Zhang , Shuliang Jiang , Zi Kang

Deep neural networks are facing severe threats from adversarial attacks. Most existing black-box attacks fool target model by generating either global perturbations or local patches. However, both global perturbations and local patches…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Chao Zhou , Yuan-Gen Wang , Guopu Zhu

Zeroth-order (ZO) optimization is a subset of gradient-free optimization that emerges in many signal processing and machine learning applications. It is used for solving optimization problems similarly to gradient-based methods. However, it…

Machine Learning · Computer Science 2020-06-23 Sijia Liu , Pin-Yu Chen , Bhavya Kailkhura , Gaoyuan Zhang , Alfred Hero , Pramod K. Varshney

In analyzing and assessing the condition of dynamical systems, it is necessary to account for nonlinearity. Recent advances in computation have rendered previously computationally infeasible analyses readily executable on common computer…

Computational Engineering, Finance, and Science · Computer Science 2021-09-24 Thomas Simpson , Nikolaos Dervilis , Eleni Chatzi

Existing black-box attacks have demonstrated promising potential in creating adversarial examples (AE) to deceive deep learning models. Most of these attacks need to handle a vast optimization space and require a large number of queries,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Renyang Liu , Wei Zhou , Tianwei Zhang , Kangjie Chen , Jun Zhao , Kwok-Yan Lam

A significant number of machine learning models are vulnerable to model extraction attacks, which focus on stealing the models by using specially curated queries against the target model. This task is well accomplished by using part of the…

Cryptography and Security · Computer Science 2023-08-11 Harshit Shah , Aravindhan G , Pavan Kulkarni , Yuvaraj Govidarajulu , Manojkumar Parmar

This paper proposes an online environment poisoning algorithm tailored for reinforcement learning agents operating in a black-box setting, where an adversary deliberately manipulates training data to lead the agent toward a mischievous…

Machine Learning · Computer Science 2024-12-03 Jianhui Li , Bokang Zhang , Junfeng Wu

Deep neural networks for image classification remain vulnerable to adversarial examples -- small, imperceptible perturbations that induce misclassifications. In black-box settings, where only the final prediction is accessible, crafting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Arjhun Swaminathan , Mete Akgün

Constructing adversarial examples in a black-box threat model injures the original images by introducing visual distortion. In this paper, we propose a novel black-box attack approach that can directly minimize the induced distortion by…

Machine Learning · Computer Science 2021-07-28 Nannan Li , Zhenzhong Chen

Deep neural networks (DNNs) have achieved state-of-the-art performance in many tasks but have shown extreme vulnerabilities to attacks generated by adversarial examples. Many works go with a white-box attack that assumes total access to the…

Cryptography and Security · Computer Science 2022-03-10 Phoenix Williams , Ke Li

As the size of large language models grows exponentially, GPU memory has become a bottleneck for adapting these models to downstream tasks. In this paper, we aim to push the limits of memory-efficient training by minimizing memory usage on…

Machine Learning · Computer Science 2026-02-13 Sifeng Shang , Jiayi Zhou , Chenyu Lin , Minxian Li , Kaiyang Zhou

Recent work has advocated for the use of deep learning to perform power allocation in the downlink of massive MIMO (maMIMO) networks. Yet, such deep learning models are vulnerable to adversarial attacks. In the context of maMIMO power…

Signal Processing · Electrical Eng. & Systems 2023-03-21 Rajeev Sahay , Minjun Zhang , David J. Love , Christopher G. Brinton

Deep neural networks are vulnerable to adversarial attacks. White-box adversarial attacks can fool neural networks with small adversarial perturbations, especially for large size images. However, keeping successful adversarial perturbations…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Yongwei Wang , Mingquan Feng , Rabab Ward , Z. Jane Wang , Lanjun Wang

Autonomous vehicles increasingly rely on cameras to provide the input for perception and scene understanding and the ability of these models to classify their environment and objects, under adverse conditions and image noise is crucial.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Andreas Papachristodoulou , Christos Kyrkou , Theocharis Theocharides

Adversarial attacks have threatened the application of deep neural networks in security-sensitive scenarios. Most existing black-box attacks fool the target model by interacting with it many times and producing global perturbations.…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Tao Xiang , Hangcheng Liu , Shangwei Guo , Tianwei Zhang , Xiaofeng Liao

$\ell_0$ constrained optimization is prevalent in machine learning, particularly for high-dimensional problems, because it is a fundamental approach to achieve sparse learning. Hard-thresholding gradient descent is a dominant technique to…

Machine Learning · Computer Science 2024-03-19 William de Vazelhes , Hualin Zhang , Huimin Wu , Xiao-Tong Yuan , Bin Gu

This paper introduces a class of model-free feedback methods for solving generic constrained optimization problems where the specific mathematical forms of the objective and constraint functions are not available. The proposed methods,…

Optimization and Control · Mathematics 2025-02-13 Xin Chen , Jorge I. Poveda , Na Li