English
Related papers

Related papers: A Tool for Neural Network Global Robustness Certif…

200 papers

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

Deep neural networks for natural language processing are fragile in the face of adversarial examples -- small input perturbations, like synonym substitution or word duplication, which cause a neural network to change its prediction. We…

Machine Learning · Computer Science 2021-09-08 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Recent work have demonstrated that robustness (to "corruption") can be at odds with generalization. Adversarial training, for instance, aims to reduce the problematic susceptibility of modern neural networks to small data perturbations.…

Machine Learning · Statistics 2023-05-19 Amine Bennouna , Ryan Lucas , Bart Van Parys

This paper studies how encouraging semantically-aligned features during deep neural network training can increase network robustness. Recent works observed that Adversarial Training leads to robust models, whose learnt features appear to…

Machine Learning · Computer Science 2021-11-22 Motasem Alfarra , Juan C. Pérez , Adel Bibi , Ali Thabet , Pablo Arbeláez , Bernard Ghanem

Many recent works have proposed methods to train classifiers with local robustness properties, which can provably eliminate classes of evasion attacks for most inputs, but not all inputs. Since data distribution shift is very common in…

Cryptography and Security · Computer Science 2021-12-03 Yizheng Chen , Shiqi Wang , Yue Qin , Xiaojing Liao , Suman Jana , David Wagner

Certifying the robustness of a graph-based machine learning model poses a critical challenge for safety. Current robustness certificates for graph classifiers guarantee output invariance with respect to the total number of node pair flips…

Machine Learning · Computer Science 2023-06-27 Pierre Osselin , Henry Kenlay , Xiaowen Dong

ML models are typically trained using large datasets of high quality. However, training datasets often contain inconsistent or incomplete data. To tackle this issue, one solution is to develop algorithms that can check whether a prediction…

Machine Learning · Computer Science 2022-01-19 Austen Z. Fan , Paraschos Koutris

In this paper, we consider the problem of certifying the robustness of neural networks to perturbed and adversarial input data. Such certification is imperative for the application of neural networks in safety-critical decision-making and…

Machine Learning · Computer Science 2020-09-21 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Machine Learning · Computer Science 2022-02-03 Michael Everett , Bjorn Lutjens , Jonathan P. How

For a given stable recurrent neural network (RNN) that is trained to perform a classification task using sequential inputs, we quantify explicit robustness bounds as a function of trainable weight matrices. The sequential inputs can be…

Machine Learning · Computer Science 2022-03-11 Guangyi Liu , Arash Amini , Martin Takac , Nader Motee

With the development of neural networks based machine learning and their usage in mission critical applications, voices are rising against the \textit{black box} aspect of neural networks as it becomes crucial to understand their limits and…

Machine Learning · Statistics 2017-08-08 El Mahdi El Mhamdi , Rachid Guerraoui , Sebastien Rouault

Robustness verification of neural networks, referring to formally proving that neural networks satisfy robustness properties, is of crucial importance in safety-critical applications, where model failures can result in loss of human life or…

Machine Learning · Computer Science 2026-04-06 Minh Le , Phuong Cao

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

Machine Learning · Computer Science 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Robustness verification that aims to formally certify the prediction behavior of neural networks has become an important tool for understanding model behavior and obtaining safety guarantees. However, previous methods can usually only…

Machine Learning · Computer Science 2020-12-24 Zhouxing Shi , Huan Zhang , Kai-Wei Chang , Minlie Huang , Cho-Jui Hsieh

In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jie Wang , Jun Ai , Minyan Lu , Haoran Su , Dan Yu , Yutao Zhang , Junda Zhu , Jingyu Liu

Convolutional and Recurrent, deep neural networks have been successful in machine learning systems for computer vision, reinforcement learning, and other allied fields. However, the robustness of such neural networks is seldom apprised,…

Neural and Evolutionary Computing · Computer Science 2018-05-01 Biswa Sengupta , Karl J. Friston

In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network. Such instability affects many deep…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Stephan Zheng , Yang Song , Thomas Leung , Ian Goodfellow

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainability in…

Cryptography and Security · Computer Science 2022-10-12 Mark Huasong Meng , Guangdong Bai , Sin Gee Teo , Zhe Hou , Yan Xiao , Yun Lin , Jin Song Dong

Quantization, a commonly used technique to reduce the memory footprint of a neural network for edge computing, entails reducing the precision of the floating-point representation used for the parameters of the network. The impact of such…

Machine Learning · Computer Science 2019-03-27 Abhishek Murthy , Himel Das , Md Ariful Islam

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin