English
Related papers

Related papers: LinSyn: Synthesizing Tight Linear Bounds for Arbit…

200 papers

Certified robustness is a desirable property for deep neural networks in safety-critical applications, and popular training algorithms can certify robustness of a neural network by computing a global bound on its Lipschitz constant.…

Machine Learning · Computer Science 2021-11-03 Yujia Huang , Huan Zhang , Yuanyuan Shi , J Zico Kolter , Anima Anandkumar

The ubiquity of deep learning algorithms in various applications has amplified the need for assuring their robustness against small input perturbations such as those occurring in adversarial attacks. Existing complete verification…

Machine Learning · Computer Science 2024-06-17 Matthias König , Xiyue Zhang , Holger H. Hoos , Marta Kwiatkowska , Jan N. van Rijn

The robustness of deep neural networks is crucial to modern AI-enabled systems and should be formally verified. Sigmoid-like neural networks have been adopted in a wide range of applications. Due to their non-linearity, Sigmoid-like…

Machine Learning · Computer Science 2022-08-31 Zhaodi Zhang , Yiting Wu , Si Liu , Jing Liu , Min Zhang

Neural networks (NNs) are now routinely implemented on systems that must operate in uncertain environments, but the tools for formally analyzing how this uncertainty propagates to NN outputs are not yet commonplace. Computing tight bounds…

Machine Learning · Computer Science 2020-12-08 Michael Everett , Golnaz Habibi , Jonathan P. How

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

The developments of deep neural networks (DNN) in recent years have ushered a brand new era of artificial intelligence. DNNs are proved to be excellent in solving very complex problems, e.g., visual recognition and text understanding, to…

Machine Learning · Computer Science 2018-12-27 Qiang Hu , Hao Zhang

To improve the robustness of deep classifiers against adversarial perturbations, many approaches have been proposed, such as designing new architectures with better robustness properties (e.g., Lipschitz-capped networks), or modifying the…

Machine Learning · Computer Science 2025-03-27 Mahyar Fazlyab , Taha Entesari , Aniket Roy , Rama Chellappa

Neural networks offer a computationally efficient approximation of model predictive control, but they lack guarantees on the resulting controlled system's properties. Formal certification of neural networks is crucial for ensuring safety,…

Optimization and Control · Mathematics 2025-02-05 Philip Sosnin , Calvin Tsay

A crucial property for achieving secure, trustworthy and interpretable deep learning systems is their robustness: small changes to a system's inputs should not result in large changes to its outputs. Mathematically, this means one strives…

Machine Learning · Computer Science 2024-06-04 Bernd Prach , Christoph H. Lampert

Many industrial and real life problems exhibit highly nonlinear periodic behaviors and the conventional methods may fall short of finding their analytical or closed form solutions. Such problems demand some cutting edge computational tools…

Machine Learning · Computer Science 2023-04-20 Jamshaid Ul Rahman , Faiza Makhdoom , Dianchen Lu

The choice of activation function in deep networks has a significant effect on the training dynamics and task performance. At present, the most effective and widely-used activation function is ReLU. However, because of the non-zero mean,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yuan Zhou , Dandan Li , Shuwei Huo , Sun-Yuan Kung

In the field of formal verification, Neural Networks (NNs) are typically reformulated into equivalent mathematical programs which are optimized over. To overcome the inherent non-convexity of these reformulations, convex relaxations of…

Machine Learning · Computer Science 2024-08-23 Samuel Chevalier , Duncan Starkenburg , Krishnamurthy Dvijotham

A challenging problem for autonomous systems is to synthesize a reactive controller that conforms to a set of given correctness properties. Linear temporal logic (LTL) provides a formal language to specify the desired behavioral properties…

Formal Languages and Automata Theory · Computer Science 2019-10-08 Rayna Dimitrova , Mahsa Ghasemi , Ufuk Topcu

We introduce a variational framework to learn the activation functions of deep neural networks. Our aim is to increase the capacity of the network while controlling an upper-bound of the actual Lipschitz constant of the input-output…

Machine Learning · Computer Science 2023-07-19 Shayan Aziznejad , Harshit Gupta , Joaquim Campos , Michael Unser

Finding minimum distortion of adversarial examples and thus certifying robustness in neural network classifiers for given data points is known to be a challenging problem. Nevertheless, recently it has been shown to be possible to give a…

Machine Learning · Computer Science 2018-11-05 Huan Zhang , Tsui-Wei Weng , Pin-Yu Chen , Cho-Jui Hsieh , Luca Daniel

The robustness of neural network classifiers is important in the safety-critical domain and can be quantified by robustness verification. At present, efficient and scalable verification techniques are always sound but incomplete, and thus,…

Machine Learning · Computer Science 2025-03-31 Yuan Xiao , Yuchen Chen , Shiqing Ma , Chunrong Fang , Tongtong Bai , Mingzheng Gu , Yuxin Cheng , Yanwei Chen , Zhenyu Chen

Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map…

Machine Learning · Computer Science 2021-04-30 Patricia Pauli , Anne Koch , Julian Berberich , Paul Kohler , Frank Allgöwer

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial input uncertainty, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Formal certification of Neural Networks (NNs) is crucial for ensuring their safety, fairness, and robustness. Unfortunately, on the one hand, sound and complete certification algorithms of ReLU-based NNs do not scale to large-scale NNs. On…

Machine Learning · Computer Science 2023-05-24 Haitham Khedr , Yasser Shoukry

We propose an active learning algorithm for linear system identification with optimal centered noise excitation. Notably, our algorithm, based on ordinary least squares and semidefinite programming, attains the minimal sample complexity…

Optimization and Control · Mathematics 2026-04-08 Kaito Ito , Alexandre Proutiere
‹ Prev 1 2 3 10 Next ›