English
Related papers

Related papers: Certifying Neural Network Robustness to Random Inp…

200 papers

We present a new approach to assessing the robustness of neural networks based on estimating the proportion of inputs for which a property is violated. Specifically, we estimate the probability of the event that the property is violated…

Machine Learning · Statistics 2019-02-25 Stefan Webb , Tom Rainforth , Yee Whye Teh , M. Pawan Kumar

This article presents novel methods for synthesizing distributionally robust stabilizing neural controllers and certificates for control systems under model uncertainty. A key challenge in designing controllers with stability guarantees for…

Systems and Control · Electrical Eng. & Systems 2024-08-06 Kehan Long , Jorge Cortes , Nikolay Atanasov

Training a deep neural network (DNN) often involves stochastic optimization, which means each run will produce a different model. Several works suggest this variability is negligible when models have the same performance, which in the case…

Machine Learning · Statistics 2023-10-03 Sinjini Banerjee , Reilly Cannon , Tim Marrinan , Tony Chiang , Anand D. Sarwate

Probabilistic verification problems of neural networks are concerned with formally analysing the output distribution of a neural network under a probability distribution of the inputs. Examples of probabilistic verification problems include…

Machine Learning · Computer Science 2025-07-11 David Boetius , Stefan Leue , Tobias Sutter

Neural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. In this paper, we focus on robustness of text classification against word substitutions,…

Computation and Language · Computer Science 2021-05-06 Emanuele La Malfa , Min Wu , Luca Laurenti , Benjie Wang , Anthony Hartshorn , Marta Kwiatkowska

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

This paper proposes a paradigm of uncertainty injection for training deep learning model to solve robust optimization problems. The majority of existing studies on deep learning focus on the model learning capability, while assuming the…

Machine Learning · Computer Science 2023-02-28 Wei Cui , Wei Yu

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Robust learning methods aim to learn a clean target distribution from noisy and corrupted training data where a specific corruption pattern is often assumed a priori. Our proposed method can not only successfully learn the clean target…

Machine Learning · Computer Science 2023-02-08 Jeongeun Park , Seungyoun Shin , Sangheum Hwang , Sungjoon Choi

Certified robustness is a desirable property for deep neural networks in safety-critical applications, and popular training algorithms can certify robustness of a neural network by computing a global bound on its Lipschitz constant.…

Machine Learning · Computer Science 2021-11-03 Yujia Huang , Huan Zhang , Yuanyuan Shi , J Zico Kolter , Anima Anandkumar

We propose an algorithm to enhance certified robustness of a deep model ensemble by optimally weighting each base model. Unlike previous works on using ensembles to empirically improve robustness, our algorithm is based on optimizing a…

Machine Learning · Statistics 2019-11-01 Huan Zhang , Minhao Cheng , Cho-Jui Hsieh

Certifiable robustness gives the guarantee that small perturbations around an input to a classifier will not change the prediction. There are two approaches to provide certifiable robustness to adversarial examples: a) explicitly training…

Machine Learning · Computer Science 2025-08-04 Meiyu Zhong , Ravi Tandon

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier. In this work, we present a unifying view of randomized…

Machine Learning · Computer Science 2021-02-24 Elan Rosenfeld , Ezra Winston , Pradeep Ravikumar , J. Zico Kolter

Robustness certification against bounded input noise or adversarial perturbations is increasingly important for deployment recurrent neural networks (RNNs) in safety-critical control applications. To address this challenge, we present…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Paul Hamelbeck , Johannes Schiffer

The threat of adversarial examples has motivated work on training certifiably robust neural networks to facilitate efficient verification of local robustness at inference time. We formalize a notion of global robustness, which captures the…

Machine Learning · Computer Science 2021-06-15 Klas Leino , Zifan Wang , Matt Fredrikson

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

With the proliferation of Deep Machine Learning into real-life applications, a particular property of this technology has been brought to attention: robustness Neural Networks notoriously present low robustness and can be highly sensitive…

Computation and Language · Computer Science 2022-07-14 Marco Casadio , Ekaterina Komendantskaya , Verena Rieser , Matthew L. Daggitt , Daniel Kienitz , Luca Arnaboldi , Wen Kokke

We introduce a novel validation framework to measure the true robustness of learning models for real-world applications by creating source-inclusive and source-exclusive partitions in a dataset via clustering. We develop a robustness metric…

Machine Learning · Computer Science 2017-04-04 Ozsel Kilinc , Ismail Uysal

In this paper we investigate formal verification problems for Neural Network computations. Of central importance will be various robustness and minimization problems such as: Given symbolic specifications of allowed inputs and outputs in…

Artificial Intelligence · Computer Science 2024-03-21 Adrian Wurm

Great advances in deep neural networks (DNNs) have led to state-of-the-art performance on a wide range of tasks. However, recent studies have shown that DNNs are vulnerable to adversarial attacks, which have brought great concerns when…

Machine Learning · Computer Science 2023-04-13 Linyi Li , Tao Xie , Bo Li