English
Related papers

Related papers: AutoZOOM: Autoencoder-based Zeroth Order Optimizat…

200 papers

We present Attention Zoom, a modular and model-agnostic spatial attention mechanism designed to improve feature extraction in convolutional neural networks (CNNs). Unlike traditional attention approaches that require architecture-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Daniel DeAlcala , Aythami Morales , Julian Fierrez , Ruben Tolosana

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

Clustering algorithms play a fundamental role as tools in decision-making and sensible automation processes. Due to the widespread use of these applications, a robustness analysis of this family of algorithms against adversarial noise has…

Machine Learning · Computer Science 2021-11-11 Antonio Emanuele Cinà , Alessandro Torcinovich , Marcello Pelillo

Since DNN is vulnerable to carefully crafted adversarial examples, adversarial attack on LiDAR sensors have been extensively studied. We introduce a robust black-box attack dubbed LiDAttack. It utilizes a genetic algorithm with a simulated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jinyin Chen , Danxin Liao , Sheng Xiang , Haibin Zheng

When it comes to deploying deep vision models, the behavior of these systems must be explicable to ensure confidence in their reliability and fairness. A common approach to evaluate deep learning models is to build a labeled test set with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jinqi Luo , Zhaoning Wang , Chen Henry Wu , Dong Huang , Fernando De la Torre

Deep learning-based object detection has become ubiquitous in the last decade due to its high accuracy in many real-world applications. With this growing trend, these models are interested in being attacked by adversaries, with most of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Pham Phuc , Son Vuong , Khang Nguyen , Tuan Dang

Fine-tuning large language models (LLMs) with classic first-order optimizers entails prohibitive GPU memory due to the backpropagation process. Recent works have turned to zeroth-order optimizers for fine-tuning, which save substantial…

Machine Learning · Computer Science 2025-02-19 Yanjun Zhao , Sizhe Dang , Haishan Ye , Guang Dai , Yi Qian , Ivor W. Tsang

Zero-shot learning (ZSL) has received extensive attention recently especially in areas of fine-grained object recognition, retrieval, and image captioning. Due to the complete lack of training samples and high requirement of defense…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Xingxing Zhang , Shupeng Gui , Zhenfeng Zhu , Yao Zhao , Ji Liu

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann

While foundation models demonstrate impressive performance across various tasks, they remain vulnerable to adversarial inputs. Current research explores various approaches to enhance model robustness, with Diffusion Denoised Smoothing…

Machine Learning · Computer Science 2025-05-22 Yury Belousov , Brian Pulfer , Vitaliy Kinakh , Slava Voloshynovskiy

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

Machine Learning · Computer Science 2023-06-22 Mouna Rabhi , Roberto Di Pietro

Face recognition has achieved considerable progress in recent years thanks to the development of deep neural networks, but it has recently been discovered that deep neural networks are vulnerable to adversarial examples. This means that…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

Large language models have demonstrated exceptional capabilities across diverse tasks, but their fine-tuning demands significant memory, posing challenges for resource-constrained environments. Zeroth-order (ZO) optimization provides a…

Machine Learning · Computer Science 2025-02-18 Zhen Zhang , Yifan Yang , Kai Zhen , Nathan Susanj , Athanasios Mouchtaris , Siegfried Kunzmann , Zheng Zhang

Adversarial examples are inputs with imperceptible perturbations that easily misleading deep neural networks(DNNs). Recently, adversarial patch, with noise confined to a small and localized patch, has emerged for its easy feasibility in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Aishan Liu , Jiakai Wang , Xianglong Liu , Bowen Cao , Chongzhi Zhang , Hang Yu

Current neural network-based classifiers are susceptible to adversarial examples even in the black-box setting, where the attacker only has query access to the model. In practice, the threat model for real-world systems is often more…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin

Randomized classifiers have been shown to provide a promising approach for achieving certified robustness against adversarial attacks in deep learning. However, most existing methods only leverage Gaussian smoothing noise and only work for…

Machine Learning · Computer Science 2020-10-21 Dinghuai Zhang , Mao Ye , Chengyue Gong , Zhanxing Zhu , Qiang Liu

Zeroth-order (ZO) optimization is one key technique for machine learning problems where gradient calculation is expensive or impossible. Several variance reduced ZO proximal algorithms have been proposed to speed up ZO optimization for…

Optimization and Control · Mathematics 2024-10-04 Bin Gu , Xiyuan Wei , Hualin Zhang , Yi Chang , Heng Huang

Adversarial examples are important for understanding the behavior of neural models, and can improve their robustness through adversarial training. Recent work in natural language processing generated adversarial examples by assuming…

Machine Learning · Computer Science 2019-04-05 Yotam Gil , Yoav Chai , Or Gorodissky , Jonathan Berant

This work considers stochastic optimization problems in which the objective function values can only be computed by a blackbox corrupted by some random noise following an unknown distribution. The proposed method is based on sequential…

Optimization and Control · Mathematics 2023-08-15 Charles Audet , Jean Bigeon , Romain Couderc , Michael Kokkolaras

Deep learning has become an increasingly common technique for various control problems, such as robotic arm manipulation, robot navigation, and autonomous vehicles. However, the downside of using deep neural networks to learn control…

Machine Learning · Computer Science 2020-02-28 Sampo Kuutti , Saber Fallah , Richard Bowden