English
Related papers

Related papers: Robustness Certificates for Implicit Neural Networ…

200 papers

In this paper, a robust optimization framework is developed to train shallow neural networks based on reachability analysis of neural networks. To characterize noises of input data, the input training data is disturbed in the description of…

Machine Learning · Computer Science 2021-07-28 Yejiang Yang , Weiming Xiang

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

Modern technologies are producing datasets with complex intrinsic structures, and they can be naturally represented as matrices instead of vectors. To preserve the latent data structures during processing, modern regression approaches…

Machine Learning · Computer Science 2016-11-16 Hang Zhang , Fengyuan Zhu , Shixin Li

Recently, Zhang et al. (2021) developed a new neural network architecture based on $\ell_\infty$-distance functions, which naturally possesses certified $\ell_\infty$ robustness by its construction. Despite the novel design and theoretical…

Machine Learning · Computer Science 2022-03-16 Bohang Zhang , Du Jiang , Di He , Liwei Wang

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these…

Machine Learning · Computer Science 2019-09-13 Chang Song , Zuoguan Wang , Hai Li

Implicit Neural Representations (INRs) encode discrete signals in a continuous manner using neural networks, demonstrating significant value across various multimedia applications. However, the vulnerability of INRs presents a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Yuxin Cheng , Zhengwu Liu , Taiqiang Wu , Chen Zhang , Ngai Wong

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

Machine Learning · Statistics 2019-09-30 Logan Engstrom , Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Brandon Tran , Aleksander Madry

Deep neural networks have achieved impressive results in many image classification tasks. However, since their performance is usually measured in controlled settings, it is important to ensure that their decisions remain correct when…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Apostolos Modas

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Current approaches to novelty or anomaly detection are based on deep neural networks. Despite their effectiveness, neural networks are also vulnerable to imperceptible deformations of the input data. This is a serious issue in critical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Ranya Almohsen , Shivang Patel , Donald A. Adjeroh , Gianfranco Doretto

Deep networks have achieved impressive results across a variety of important tasks. However a known weakness is a failure to perform well when evaluated on data which differ from the training distribution, even if these differences are very…

Adversarial training (i.e., training on adversarially perturbed input data) is a well-studied method for making neural networks robust to potential adversarial attacks during inference. However, the improved robustness does not come for…

Robotics · Computer Science 2023-01-27 Mathias Lechner , Alexander Amini , Daniela Rus , Thomas A. Henzinger

Graph convolutional neural networks (GCNs) are powerful tools for learning graph-based knowledge representations from training data. However, they are vulnerable to small perturbations in the input graph, which makes them susceptible to…

Machine Learning · Computer Science 2025-12-16 Boqi Chen , Kristóf Marussy , Oszkár Semeráth , Gunter Mussbacher , Dániel Varró

Recurrent neural networks (RNNs) are a class of nonlinear dynamical systems often used to model sequence-to-sequence maps. RNNs have excellent expressive power but lack the stability or robustness guarantees that are necessary for many…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

State-of-the-art techniques for enhancing robustness of deep networks mostly rely on empirical risk minimization with suitable data augmentation. In this paper, we propose a complementary approach motivated by communication theory, aimed at…

Machine Learning · Computer Science 2024-03-05 Bhagyashree Puranik , Ahmad Beirami , Yao Qin , Upamanyu Madhow

There has been a rapid development and interest in adversarial training and defenses in the machine learning community in the recent years. One line of research focuses on improving the performance and efficiency of adversarial robustness…

Machine Learning · Computer Science 2022-12-07 Cheng Tang

Learning meaningful representations using deep neural networks involves designing efficient training schemes and well-structured networks. Currently, the method of stochastic gradient descent that has a momentum with dropout is one of the…

Machine Learning · Computer Science 2016-01-15 Taehoon Lee , Minsuk Choi , Sungroh Yoon

A fundamental question in adversarial machine learning is whether a robust classifier exists for a given task. A line of research has made some progress towards this goal by studying the concentration of measure, but we argue standard…

Machine Learning · Computer Science 2022-03-18 Xiao Zhang , David Evans

Convolutional neural networks (CNNs) have made significant advancement, however, they are widely known to be vulnerable to adversarial attacks. Adversarial training is the most widely used technique for improving adversarial robustness to…

Machine Learning · Computer Science 2021-10-12 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon