English
Related papers

Related papers: An Empirical Study of Derivative-Free-Optimization…

200 papers

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

Machine Learning · Computer Science 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Machine learning models are critically susceptible to evasion attacks from adversarial examples. Generally, adversarial examples, modified inputs deceptively similar to the original input, are constructed under whitebox settings by…

Machine Learning · Computer Science 2023-03-27 Viet Quoc Vo , Ehsan Abbasnejad , Damith C. Ranasinghe

Deep neural networks (DNNs) have been showed to be highly vulnerable to imperceptible adversarial perturbations. As a complementary type of adversary, patch attacks that introduce perceptible perturbations to the images have attracted the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhaoyu Chen , Bo Li , Shuang Wu , Shouhong Ding , Wenqiang Zhang

Deep learning models are vulnerable to adversarial examples, which can fool a target classifier by imposing imperceptible perturbations onto natural examples. In this work, we consider the practical and challenging decision-based black-box…

Machine Learning · Computer Science 2021-05-11 Qi-An Fu , Yinpeng Dong , Hang Su , Jun Zhu

Most deep learning models are easily vulnerable to adversarial attacks. Various adversarial attacks are designed to evaluate the robustness of models and develop defense model. Currently, adversarial attacks are brought up to attack their…

Cryptography and Security · Computer Science 2019-06-10 Jinyin Chen , Mengmeng Su , Shijing Shen , Hui Xiong , Haibin Zheng

Current black-box adversarial attacks either require multiple queries or diffusion models to produce adversarial samples that can impair the target model performance. However, these methods require training a surrogate loss or diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Joana C. Costa , Tiago Roxo , Hugo Proença , Pedro R. M. Inácio

This paper provides lower bounds on the convergence rate of Derivative Free Optimization (DFO) with noisy function evaluations, exposing a fundamental and unavoidable gap between the performance of algorithms with access to gradients and…

Machine Learning · Statistics 2012-09-13 Kevin G. Jamieson , Robert D. Nowak , Benjamin Recht

Machine learning (ML), especially deep neural networks (DNNs) have been widely used in various applications, including several safety-critical ones (e.g. autonomous driving). As a result, recent research about adversarial examples has…

Machine Learning · Computer Science 2020-05-29 Huichen Li , Xiaojun Xu , Xiaolu Zhang , Shuang Yang , Bo Li

In this paper, we illustrate a novel method for solving optimization problems when derivatives are not explicitly available. We show that combining implicit filtering (IF), an existing derivative free optimization (DFO) method, with a deep…

Optimization and Control · Mathematics 2021-05-20 Brian Irwin , Eldad Haber , Raviv Gal , Avi Ziv

Adversarial example generation becomes a viable method for evaluating the robustness of a machine learning model. In this paper, we consider hard-label black-box attacks (a.k.a. decision-based attacks), which is a challenging setting that…

Machine Learning · Computer Science 2019-10-15 Zhenxin Xiao , Puyudi Yang , Yuchen Jiang , Kai-Wei Chang , Cho-Jui Hsieh

This paper tackles optimization problems whose objective and constraints involve a trained Neural Network (NN), where the goal is to maximize $f(\Phi(x))$ subject to $c(\Phi(x)) \leq 0$, with $f$ smooth, $c$ general and non-stringent, and…

Optimization and Control · Mathematics 2025-10-03 Pierre-Yves Bouchet , Thibaut Vidal

We present DFO-LS, a software package for derivative-free optimization (DFO) for nonlinear Least-Squares (LS) problems, with optional bound constraints. Inspired by the Gauss-Newton method, DFO-LS constructs simplified linear regression…

Optimization and Control · Mathematics 2018-05-24 Coralia Cartis , Jan Fiala , Benjamin Marteau , Lindon Roberts

Research has shown that deep neural networks (DNNs) have vulnerabilities that can lead to the misrecognition of Adversarial Examples (AEs) with specifically designed perturbations. Various adversarial attack methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Ayane Tajima , Satoshi Ono

In general, adversarial perturbations superimposed on inputs are realistic threats for a deep neural network (DNN). In this paper, we propose a practical generation method of such adversarial perturbation to be applied to black-box attacks…

Machine Learning · Computer Science 2020-02-19 Hisaichi Shibata , Shouhei Hanaoka , Yukihiro Nomura , Naoto Hayashi , Osamu Abe

Machine learning models have been successfully applied to a wide range of applications including computer vision, natural language processing, and speech recognition. A successful implementation of these models however, usually relies on…

Machine Learning · Computer Science 2020-09-29 Arash Rahnama , Andrew Tseng

Although deep neural networks have been very successful in image-classification tasks, they are prone to adversarial attacks. To generate adversarial inputs, there has emerged a wide variety of techniques, such as black- and whitebox…

Machine Learning · Computer Science 2020-08-18 Fuyuan Zhang , Sankalan Pal Chowdhury , Maria Christakis

Deep neural networks (DNNs) have been widely used in many fields such as images processing, speech recognition; however, they are vulnerable to adversarial examples, and this is a security issue worthy of attention. Because the training…

Cryptography and Security · Computer Science 2019-08-08 Wenjian Luo , Chenwang Wu , Nan Zhou , Li Ni

Deep Neural Networks (DNNs) in Computer Vision (CV) are well-known to be vulnerable to Adversarial Examples (AEs), namely imperceptible perturbations added maliciously to cause wrong classification results. Such variability has been a…

Cryptography and Security · Computer Science 2020-07-31 Yi Zeng , Han Qiu , Gerard Memmi , Meikang Qiu

Interest in derivative-free optimization (DFO) and "evolutionary strategies" (ES) has recently surged in the Reinforcement Learning (RL) community, with growing evidence that they can match state of the art methods for policy optimization…

Derivative-Free Optimization (DFO) involves methods that rely solely on evaluations of the objective function. One of the earliest strategies for designing DFO methods is to adapt first-order methods by replacing gradients with…

Optimization and Control · Mathematics 2025-02-12 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia