中文
相关论文

相关论文: How to Robustify Black-Box ML Models? A Zeroth-Ord…

200 篇论文

Deep neural networks are widely used in various fields because of their powerful performance. However, recent studies have shown that deep learning models are vulnerable to adversarial attacks, i.e., adding a slight perturbation to the…

机器学习 · 计算机科学 2022-05-17 Youhuan Yang , Lei Sun , Leyu Dai , Song Guo , Xiuqing Mao , Xiaoqin Wang , Bayi Xu

Deep learning models for medical image segmentation and object detection are becoming increasingly available as clinical products. However, as details are rarely provided about the training data, models may unexpectedly fail when cases…

图像与视频处理 · 电气工程与系统科学 2024-07-01 Jack Highton , Quok Zong Chong , Samuel Finestone , Arian Beqiri , Julia A. Schnabel , Kanwal K. Bhatia

The adversarial vulnerability of deep networks has spurred the interest of researchers worldwide. Unsurprisingly, like images, adversarial examples also translate to time-series data as they are an inherent weakness of the model itself…

机器学习 · 计算机科学 2020-09-01 Shoaib Ahmed Siddiqui , Andreas Dengel , Sheraz Ahmed

Machine learning (ML) models, e.g., deep neural networks (DNNs), are vulnerable to adversarial examples: malicious inputs modified to yield erroneous model outputs, while appearing unmodified to human observers. Potential attacks include…

密码学与安全 · 计算机科学 2017-03-21 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow , Somesh Jha , Z. Berkay Celik , Ananthram Swami

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

机器学习 · 计算机科学 2017-11-16 Yannic Kilcher , Thomas Hofmann

We focus on the problem of adversarial attacks against models on discrete sequential data in the black-box setting where the attacker aims to craft adversarial examples with limited query access to the victim model. Existing black-box…

机器学习 · 计算机科学 2022-06-20 Deokjae Lee , Seungyong Moon , Junhyeok Lee , Hyun Oh Song

Machine learning (ML) models are often sensitive to carefully crafted yet seemingly unnoticeable perturbations. Such adversarial examples are considered to be a property of ML models, often associated with their black-box operation and…

机器学习 · 计算机科学 2025-04-29 Elad Sofer , Tomer Shaked , Caroline Chaux , Nir Shlezinger

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

机器学习 · 计算机科学 2020-08-13 Alex Serban , Erik Poll , Joost Visser

Safety alignment for large language models (LLMs) aims to reduce harmful or unsafe behavior while preserving general utility. However, recent findings reveal that alignment effects can be fragile: lightweight post-alignment manipulations,…

人工智能 · 计算机科学 2026-05-29 Zhihao Liu , Yifan Wu , Jian Lou , Di Wang , Yuxi Zhou , Yuke Hu

The fragility of deep neural networks to adversarially-chosen inputs has motivated the need to revisit deep learning algorithms. Including adversarial examples during training is a popular defense mechanism against adversarial attacks. This…

最优化与控制 · 数学 2020-05-05 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

The safety and robustness of learning-based decision-making systems are under threats from adversarial examples, as imperceptible perturbations can mislead neural networks to completely different outputs. In this paper, we present an…

机器学习 · 计算机科学 2019-11-28 Chao Tang , Yifei Fan , Anthony Yezzi

Recently, researchers have discovered that the state-of-the-art object classifiers can be fooled easily by small perturbations in the input unnoticeable to human eyes. It is also known that an attacker can generate strong adversarial…

机器学习 · 计算机科学 2018-06-28 Jihun Hamm , Akshay Mehra

Deep neural network (DNN) as a popular machine learning model is found to be vulnerable to adversarial attack. This attack constructs adversarial examples by adding small perturbations to the raw input, while appearing unmodified to human…

机器学习 · 计算机科学 2018-09-14 Pengcheng Li , Jinfeng Yi , Lijun Zhang

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

机器学习 · 计算机科学 2022-02-21 Abderrahmen Amich , Birhanu Eshete

Deep neural networks (DNNs) have been enormously successful across a variety of prediction tasks. However, recent research shows that DNNs are particularly vulnerable to adversarial attacks, which poses a serious threat to their…

计算机视觉与模式识别 · 计算机科学 2019-08-02 Xiang Li , Shihao Ji

Fooling deep neural networks (DNNs) with the black-box optimization has become a popular adversarial attack fashion, as the structural prior knowledge of DNNs is always unknown. Nevertheless, recent black-box adversarial attacks may…

计算机视觉与模式识别 · 计算机科学 2022-01-14 Jie Wang , Zhaoxia Yin , Jing Jiang , Yang Du

Machine learning (ML) systems have introduced significant advances in various fields, due to the introduction of highly complex models. Despite their success, it has been shown multiple times that machine learning models are prone to…

计算机视觉与模式识别 · 计算机科学 2020-08-19 Mehmet Kerim Yucel , Ramazan Gokberk Cinbis , Pinar Duygulu

Deep neural networks (DNNs) have achieved remarkable performance across a wide range of applications, while they are vulnerable to adversarial examples, which motivates the evaluation and benchmark of model robustness. However, current…

计算机视觉与模式识别 · 计算机科学 2022-11-02 Jun Guo , Wei Bao , Jiakai Wang , Yuqing Ma , Xinghai Gao , Gang Xiao , Aishan Liu , Jian Dong , Xianglong Liu , Wenjun Wu

Deep learning algorithms and networks are vulnerable to perturbed inputs which is known as the adversarial attack. Many defense methodologies have been investigated to defend against such adversarial attack. In this work, we propose a novel…

机器学习 · 计算机科学 2018-02-08 Adnan Siraj Rakin , Zhezhi He , Boqing Gong , Deliang Fan

Machine learning (ML), especially deep learning (DL) techniques have been increasingly used in anomaly-based network intrusion detection systems (NIDS). However, ML/DL has shown to be extremely vulnerable to adversarial attacks, especially…

密码学与安全 · 计算机科学 2021-06-09 Dongqi Han , Zhiliang Wang , Ying Zhong , Wenqi Chen , Jiahai Yang , Shuqiang Lu , Xingang Shi , Xia Yin