English
Related papers

Related papers: CEB Improves Model Robustness

200 papers

Despite having high accuracy, neural nets have been shown to be susceptible to adversarial examples, where a small perturbation to an input can cause it to become mislabeled. We propose metrics for measuring the robustness of a neural net…

Machine Learning · Computer Science 2017-06-19 Osbert Bastani , Yani Ioannou , Leonidas Lampropoulos , Dimitrios Vytiniotis , Aditya Nori , Antonio Criminisi

We propose to study and promote the robustness of a model as per its performance through the interpolation of training data distributions. Specifically, (1) we augment the data by finding the worst-case Wasserstein barycenter on the…

Machine Learning · Computer Science 2023-08-29 Jiacheng Zhu , Jielin Qiu , Aritra Guha , Zhuolin Yang , Xuanlong Nguyen , Bo Li , Ding Zhao

We present a novel framework for generating adversarial benchmarks to evaluate the robustness of image classification models. Our framework allows users to customize the types of distortions to be optimally applied to images, which helps…

Adversarial training is an effective method to boost model robustness to malicious, adversarial attacks. However, such improvement in model robustness often leads to a significant sacrifice of standard performance on clean images. In many…

Machine Learning · Computer Science 2022-04-29 Pengyue Hou , Ming Zhou , Jie Han , Petr Musilek , Xingyu Li

Conformal Prediction (CP) is a powerful framework for constructing prediction sets with guaranteed coverage. However, recent studies have shown that integrating confidence calibration with CP can lead to a degradation in efficiency. In this…

Machine Learning · Computer Science 2024-07-25 Rui Luo , Nicolo Colombo

Though deep neural networks have achieved significant progress on various tasks, often enhanced by model ensemble, existing high-performance models can be vulnerable to adversarial attacks. Many efforts have been devoted to enhancing the…

Machine Learning · Computer Science 2019-05-30 Tianyu Pang , Kun Xu , Chao Du , Ning Chen , Jun Zhu

The practical use of Bayesian Optimization (BO) in engineering applications imposes special requirements: high sampling efficiency on the one hand and finding a robust solution on the other hand. We address the case of adversarial…

Machine Learning · Computer Science 2024-06-03 Dorina Weichert , Alexander Kister , Sebastian Houben , Patrick Link , Gunar Ernis

Convolutional neural network-based medical image classifiers have been shown to be especially susceptible to adversarial examples. Such instabilities are likely to be unacceptable in the future of automated diagnoses. Though statistical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Isaac Wasserman

While additional training data improves the robustness of deep neural networks against adversarial examples, it presents the challenge of curating a large number of specific real-world samples. We circumvent this challenge by using…

Machine Learning · Computer Science 2022-03-04 Vikash Sehwag , Saeed Mahloujifar , Tinashe Handina , Sihui Dai , Chong Xiang , Mung Chiang , Prateek Mittal

This paper presents a DNN bottleneck reinforcement scheme to alleviate the vulnerability of Deep Neural Networks (DNN) against adversarial attacks. Typical DNN classifiers encode the input image into a compressed latent representation more…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Wenqing Liu , Miaojing Shi , Teddy Furon , Li Li

Robustness in deep neural networks and machine learning algorithms in general is an open research challenge. In particular, it is difficult to ensure algorithmic performance is maintained on out-of-distribution inputs or anomalous instances…

Machine Learning · Computer Science 2022-11-23 Natalie Abreu , Nathan Vaska , Victoria Helus

A safety verification task involves verifying a system against a desired safety property under certain assumptions about the environment. However, these environmental assumptions may occasionally be violated due to modeling errors or…

Systems and Control · Electrical Eng. & Systems 2023-06-05 Rômulo Meira-Góes , Ian Dardik , Eunsuk Kang , Stéphane Lafortune , Stavros Tripakis

This paper proposes an attack-independent (non-adversarial training) technique for improving adversarial robustness of neural network models, with minimal loss of standard accuracy. We suggest creating a neighborhood around each training…

Machine Learning · Computer Science 2021-07-28 Bronya Roni Chernyak , Bhiksha Raj , Tamir Hazan , Joseph Keshet

The resilience of convolutional neural networks against input variations and adversarial attacks remains a significant challenge in image recognition tasks. Motivated by the need for more robust and reliable image recognition systems, we…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Longwei Wang , Xueqian Li , Zheng Zhang

The last six years have witnessed significant progress in adversarially robust deep learning. As evidenced by the CIFAR-10 dataset category in RobustBench benchmark, the accuracy under $\ell_\infty$ adversarial perturbations improved from…

Machine Learning · Computer Science 2023-12-21 Edoardo Debenedetti , Zishen Wan , Maksym Andriushchenko , Vikash Sehwag , Kshitij Bhardwaj , Bhavya Kailkhura

The weighted ensemble (WE) method stands out as a widely used segment-based sampling technique renowned for its rigorous treatment of kinetics. The WE framework typically involves initially mapping the configuration space onto a…

Computational Physics · Physics 2024-11-19 Dedi Wang , Pratyush Tiwary

Adversarial examples pose a significant challenge to the robustness, reliability and alignment of deep neural networks. We propose a novel, easy-to-use approach to achieving high-quality representations that lead to adversarial robustness…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Stanislav Fort , Balaji Lakshminarayanan

We propose a new approach to train a variational information bottleneck (VIB) that improves its robustness to adversarial perturbations. Unlike the traditional methods where the hard labels are usually used for the classification task, we…

Machine Learning · Computer Science 2021-04-30 Weizhu Qian , Bowei Chen , Xiaowei Huang

Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several…

Machine Learning · Computer Science 2021-10-28 Jingyue Lu , M. Pawan Kumar

Despite excellent performance on many tasks, NLP systems are easily fooled by small adversarial perturbations of inputs. Existing procedures to defend against such perturbations are either (i) heuristic in nature and susceptible to stronger…

Computation and Language · Computer Science 2020-05-05 Erik Jones , Robin Jia , Aditi Raghunathan , Percy Liang