English
Related papers

Related papers: Semidefinite relaxations for certifying robustness…

200 papers

The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted great attention in the machine learning community. The problem is related to non-flatness and non-smoothness of normally obtained loss landscapes.…

Machine Learning · Computer Science 2023-02-13 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

We introduce the concept of provably robust adversarial examples for deep neural networks - connected input regions constructed from standard adversarial examples which are guaranteed to be robust to a set of real-world perturbations (such…

Machine Learning · Computer Science 2022-03-21 Dimitar I. Dimitrov , Gagandeep Singh , Timon Gehr , Martin Vechev

Recent studies have highlighted the potential of Lipschitz-based methods for training certifiably robust neural networks against adversarial attacks. A key challenge, supported both theoretically and empirically, is that robustness demands…

Machine Learning · Computer Science 2024-06-25 Kai Hu , Klas Leino , Zifan Wang , Matt Fredrikson

The rise of computer vision applications in the real world puts the security of the deep neural networks at risk. Recent works demonstrate that convolutional neural networks are susceptible to adversarial examples - where the input images…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Sina Hajer Ahmadi , Hassan Bahrami

Despite having high accuracy, neural nets have been shown to be susceptible to adversarial examples, where a small perturbation to an input can cause it to become mislabeled. We propose metrics for measuring the robustness of a neural net…

Machine Learning · Computer Science 2017-06-19 Osbert Bastani , Yani Ioannou , Leonidas Lampropoulos , Dimitrios Vytiniotis , Aditya Nori , Antonio Criminisi

As spiking neural networks (SNNs) are deployed increasingly in real-world efficiency critical applications, the security concerns in SNNs attract more attention. Currently, researchers have already demonstrated an SNN can be attacked with…

Neural and Evolutionary Computing · Computer Science 2022-05-04 Ling Liang , Kaidi Xu , Xing Hu , Lei Deng , Yuan Xie

Due to the development of machine learning and speech processing, speech emotion recognition has been a popular research topic in recent years. However, the speech data cannot be protected when it is uploaded and processed on servers in the…

Sound · Computer Science 2022-03-10 Yi Chang , Sofiane Laridi , Zhao Ren , Gregory Palmer , Björn W. Schuller , Marco Fisichella

We study the model robustness against adversarial examples, referred to as small perturbed input data that may however fool many state-of-the-art deep learning models. Unlike previous research, we establish a novel theory addressing the…

Machine Learning · Computer Science 2020-06-11 Shufei Zhang , Kaizhu Huang , Zenglin Xu

Reinforcement learning (RL) has been demonstrated suitable to develop agents that play complex games with human-level performance. However, it is not understood how to effectively use RL to perform cybersecurity tasks. To develop such…

Cryptography and Security · Computer Science 2021-03-16 Andres Molina-Markham , Cory Miniter , Becky Powell , Ahmad Ridley

To obtain, deterministic guarantees of adversarial robustness, specialized training methods are used. We propose, SABR, a novel such certified training method, based on the key insight that propagating interval bounds for a small but…

Machine Learning · Computer Science 2023-03-10 Mark Niklas Müller , Franziska Eckert , Marc Fischer , Martin Vechev

The wide deployment of deep neural networks, though achieving great success in many domains, has severe safety and reliability concerns. Existing adversarial attack generation and automatic verification techniques cannot formally verify…

Machine Learning · Computer Science 2020-06-09 Weidi Sun , Yuteng Lu , Xiyue Zhang , Zhanxing Zhu , Meng Sun

The study of provable adversarial robustness for deep neural networks (DNNs) has mainly focused on static supervised learning tasks such as image classification. However, DNNs have been used extensively in real-world adaptive tasks such as…

Machine Learning · Computer Science 2022-05-31 Aounon Kumar , Alexander Levine , Soheil Feizi

Making classifiers robust to adversarial examples is hard. Thus, many defenses tackle the seemingly easier task of detecting perturbed inputs. We show a barrier towards this goal. We prove a general hardness reduction between detection and…

Machine Learning · Computer Science 2022-06-17 Florian Tramèr

We show how to turn any classifier that classifies well under Gaussian noise into a new classifier that is certifiably robust to adversarial perturbations under the $\ell_2$ norm. This "randomized smoothing" technique has been proposed…

Machine Learning · Computer Science 2019-06-18 Jeremy M Cohen , Elan Rosenfeld , J. Zico Kolter

While great progress has been made at making neural networks effective across a wide range of visual tasks, most models are surprisingly vulnerable. This frailness takes the form of small, carefully chosen perturbations of their input,…

Machine Learning · Computer Science 2019-06-11 Cecilia Summers , Michael J. Dinneen

Certifying the safety or robustness of neural networks against input uncertainties and adversarial attacks is an emerging challenge in the area of safe machine learning and control. To provide such a guarantee, one must be able to bound the…

Optimization and Control · Mathematics 2021-09-16 Mahyar Fazlyab , Manfred Morari , George J. Pappas

The point estimates of ReLU classification networks---arguably the most widely used neural network architecture---have been shown to yield arbitrarily high confidence far away from the training data. This architecture, in conjunction with a…

Machine Learning · Statistics 2020-07-20 Agustinus Kristiadi , Matthias Hein , Philipp Hennig

This study investigates a counterintuitive phenomenon in adversarial machine learning: the potential for noise-based defenses to inadvertently aid evasion attacks in certain scenarios. While randomness is often employed as a defensive…

Cryptography and Security · Computer Science 2024-11-01 Steve Bakos , Pooria Madani , Heidar Davoudi

Deep neural networks have been shown to lack robustness to small input perturbations. The process of generating the perturbations that expose the lack of robustness of neural networks is known as adversarial input generation. This process…

Machine Learning · Computer Science 2019-03-26 Tommaso Dreossi , Shromona Ghosh , Alberto Sangiovanni-Vincentelli , Sanjit A. Seshia

We study the problem of certifying the robustness of Bayesian neural networks (BNNs) to adversarial input perturbations. Given a compact set of input points $T \subseteq \mathbb{R}^m$ and a set of output points $S \subseteq \mathbb{R}^n$,…

Machine Learning · Computer Science 2023-06-26 Matthew Wicker , Andrea Patane , Luca Laurenti , Marta Kwiatkowska