English
Related papers

Related papers: How to Robustify Black-Box ML Models? A Zeroth-Ord…

200 papers

Deep neural networks are widely used in various fields because of their powerful performance. However, recent studies have shown that deep learning models are vulnerable to adversarial attacks, i.e., adding a slight perturbation to the…

Machine Learning · Computer Science 2022-05-17 Youhuan Yang , Lei Sun , Leyu Dai , Song Guo , Xiuqing Mao , Xiaoqin Wang , Bayi Xu

Deep learning models for medical image segmentation and object detection are becoming increasingly available as clinical products. However, as details are rarely provided about the training data, models may unexpectedly fail when cases…

Image and Video Processing · Electrical Eng. & Systems 2024-07-01 Jack Highton , Quok Zong Chong , Samuel Finestone , Arian Beqiri , Julia A. Schnabel , Kanwal K. Bhatia

The adversarial vulnerability of deep networks has spurred the interest of researchers worldwide. Unsurprisingly, like images, adversarial examples also translate to time-series data as they are an inherent weakness of the model itself…

Machine Learning · Computer Science 2020-09-01 Shoaib Ahmed Siddiqui , Andreas Dengel , Sheraz Ahmed

Machine learning (ML) models, e.g., deep neural networks (DNNs), are vulnerable to adversarial examples: malicious inputs modified to yield erroneous model outputs, while appearing unmodified to human observers. Potential attacks include…

Cryptography and Security · Computer Science 2017-03-21 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow , Somesh Jha , Z. Berkay Celik , Ananthram Swami

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann

We focus on the problem of adversarial attacks against models on discrete sequential data in the black-box setting where the attacker aims to craft adversarial examples with limited query access to the victim model. Existing black-box…

Machine Learning · Computer Science 2022-06-20 Deokjae Lee , Seungyong Moon , Junhyeok Lee , Hyun Oh Song

Machine learning (ML) models are often sensitive to carefully crafted yet seemingly unnoticeable perturbations. Such adversarial examples are considered to be a property of ML models, often associated with their black-box operation and…

Machine Learning · Computer Science 2025-04-29 Elad Sofer , Tomer Shaked , Caroline Chaux , Nir Shlezinger

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

Machine Learning · Computer Science 2020-08-13 Alex Serban , Erik Poll , Joost Visser

Safety alignment for large language models (LLMs) aims to reduce harmful or unsafe behavior while preserving general utility. However, recent findings reveal that alignment effects can be fragile: lightweight post-alignment manipulations,…

Artificial Intelligence · Computer Science 2026-05-29 Zhihao Liu , Yifan Wu , Jian Lou , Di Wang , Yuxi Zhou , Yuke Hu

The fragility of deep neural networks to adversarially-chosen inputs has motivated the need to revisit deep learning algorithms. Including adversarial examples during training is a popular defense mechanism against adversarial attacks. This…

Optimization and Control · Mathematics 2020-05-05 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

The safety and robustness of learning-based decision-making systems are under threats from adversarial examples, as imperceptible perturbations can mislead neural networks to completely different outputs. In this paper, we present an…

Machine Learning · Computer Science 2019-11-28 Chao Tang , Yifei Fan , Anthony Yezzi

Recently, researchers have discovered that the state-of-the-art object classifiers can be fooled easily by small perturbations in the input unnoticeable to human eyes. It is also known that an attacker can generate strong adversarial…

Machine Learning · Computer Science 2018-06-28 Jihun Hamm , Akshay Mehra

Deep neural network (DNN) as a popular machine learning model is found to be vulnerable to adversarial attack. This attack constructs adversarial examples by adding small perturbations to the raw input, while appearing unmodified to human…

Machine Learning · Computer Science 2018-09-14 Pengcheng Li , Jinfeng Yi , Lijun Zhang

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

Machine Learning · Computer Science 2022-02-21 Abderrahmen Amich , Birhanu Eshete

Deep neural networks (DNNs) have been enormously successful across a variety of prediction tasks. However, recent research shows that DNNs are particularly vulnerable to adversarial attacks, which poses a serious threat to their…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Xiang Li , Shihao Ji

Fooling deep neural networks (DNNs) with the black-box optimization has become a popular adversarial attack fashion, as the structural prior knowledge of DNNs is always unknown. Nevertheless, recent black-box adversarial attacks may…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Jie Wang , Zhaoxia Yin , Jing Jiang , Yang Du

Machine learning (ML) systems have introduced significant advances in various fields, due to the introduction of highly complex models. Despite their success, it has been shown multiple times that machine learning models are prone to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Mehmet Kerim Yucel , Ramazan Gokberk Cinbis , Pinar Duygulu

Deep neural networks (DNNs) have achieved remarkable performance across a wide range of applications, while they are vulnerable to adversarial examples, which motivates the evaluation and benchmark of model robustness. However, current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Jun Guo , Wei Bao , Jiakai Wang , Yuqing Ma , Xinghai Gao , Gang Xiao , Aishan Liu , Jian Dong , Xianglong Liu , Wenjun Wu

Deep learning algorithms and networks are vulnerable to perturbed inputs which is known as the adversarial attack. Many defense methodologies have been investigated to defend against such adversarial attack. In this work, we propose a novel…

Machine Learning · Computer Science 2018-02-08 Adnan Siraj Rakin , Zhezhi He , Boqing Gong , Deliang Fan

Machine learning (ML), especially deep learning (DL) techniques have been increasingly used in anomaly-based network intrusion detection systems (NIDS). However, ML/DL has shown to be extremely vulnerable to adversarial attacks, especially…

Cryptography and Security · Computer Science 2021-06-09 Dongqi Han , Zhiliang Wang , Ying Zhong , Wenqi Chen , Jiahai Yang , Shuqiang Lu , Xingang Shi , Xia Yin