English
Related papers

Related papers: Tightened Convex Relaxations for Neural Network Ro…

200 papers

Randomized smoothing is currently a state-of-the-art method to construct a certifiably robust classifier from neural networks against $\ell_2$-adversarial perturbations. Under the paradigm, the robustness of a classifier is aligned with the…

Machine Learning · Computer Science 2021-11-18 Jongheon Jeong , Sejun Park , Minkyu Kim , Heung-Chang Lee , Doguk Kim , Jinwoo Shin

There is a growing need for computational tools to automatically design and verify autonomous systems, especially complex robotic systems involving perception, planning, control, and hardware in the autonomy stack. Differentiable…

Robotics · Computer Science 2022-04-26 Charles Dawson , Chuchu Fan

Certifying the robustness of a graph-based machine learning model poses a critical challenge for safety. Current robustness certificates for graph classifiers guarantee output invariance with respect to the total number of node pair flips…

Machine Learning · Computer Science 2023-06-27 Pierre Osselin , Henry Kenlay , Xiaowen Dong

This paper investigates the problem of certifying optimality for sparse generalized linear models (GLMs), where sparsity is enforced through an $\ell_0$ cardinality constraint. While branch-and-bound (BnB) frameworks can certify optimality…

Machine Learning · Computer Science 2025-06-12 Jiachang Liu , Soroosh Shafiee , Andrea Lodi

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured…

Machine Learning · Computer Science 2022-01-13 Aounon Kumar , Tom Goldstein

This paper studies how encouraging semantically-aligned features during deep neural network training can increase network robustness. Recent works observed that Adversarial Training leads to robust models, whose learnt features appear to…

Machine Learning · Computer Science 2021-11-22 Motasem Alfarra , Juan C. Pérez , Adel Bibi , Ali Thabet , Pablo Arbeláez , Bernard Ghanem

Certifiable local robustness, which rigorously precludes small-norm adversarial examples, has received significant attention as a means of addressing security concerns in deep learning. However, for some classification problems, local…

Machine Learning · Computer Science 2021-06-15 Klas Leino , Matt Fredrikson

Training modern neural networks is increasingly fragile, with rare but severe destabilizing updates often causing irreversible divergence or silent performance degradation. Existing optimization methods primarily rely on preventive…

Machine Learning · Computer Science 2026-01-27 Barak Or

With neural networks being used to control safety-critical systems, they increasingly have to be both accurate (in the sense of matching inputs to outputs) and robust. However, these two properties are often at odds with each other and a…

Systems and Control · Electrical Eng. & Systems 2024-05-30 Ross Drummond , Chris Guiver , Matthew C. Turner

The superior performance of Deep Neural Networks (DNNs) has led to their application in various aspects of human life. Safety-critical applications are no exception and impose rigorous reliability requirements on DNNs. Quantized Neural…

Machine Learning · Computer Science 2023-06-19 Mohammad Hasan Ahmadilivani , Mahdi Taheri , Jaan Raik , Masoud Daneshtalab , Maksim Jenihhin

We study training of Convolutional Neural Networks (CNNs) with ReLU activations and introduce exact convex optimization formulations with a polynomial complexity with respect to the number of data samples, the number of neurons, and data…

Machine Learning · Computer Science 2021-03-19 Tolga Ergen , Mert Pilanci

Acquisition of training data for the standard semantic segmentation is expensive if requiring that each pixel is labeled. Yet, current methods significantly deteriorate in weakly supervised settings, e.g. where a fraction of pixels is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Dmitrii Marin , Yuri Boykov

Neural networks have recently become popular for a wide variety of uses, but have seen limited application in safety-critical domains such as robotics near and around humans. This is because it remains an open challenge to train a neural…

Machine Learning · Computer Science 2021-07-19 Long Kiu Chung , Adam Dai , Derek Knowles , Shreyas Kousik , Grace X. Gao

Convexification is a core technique in global polynomial optimization. Currently, there are two main approaches competing in theory and practice: the approach of nonlinear programming and the approach based on positivity certificates from…

Optimization and Control · Mathematics 2021-09-29 Gennadiy Averkov , Benjamin Peters , Sebastian Sager

In the field of formal verification, Neural Networks (NNs) are typically reformulated into equivalent mathematical programs which are optimized over. To overcome the inherent non-convexity of these reformulations, convex relaxations of…

Machine Learning · Computer Science 2024-08-23 Samuel Chevalier , Duncan Starkenburg , Krishnamurthy Dvijotham

Recent studies have highlighted the potential of Lipschitz-based methods for training certifiably robust neural networks against adversarial attacks. A key challenge, supported both theoretically and empirically, is that robustness demands…

Machine Learning · Computer Science 2024-06-25 Kai Hu , Klas Leino , Zifan Wang , Matt Fredrikson

In safety-critical applications that rely on the solution of an optimization problem, the certification of the optimization algorithm is of vital importance. Certification and suboptimality results are available for a wide range of…

Optimization and Control · Mathematics 2023-12-06 Pablo Krupa , Omar Inverso , Mirco Tribastone , Alberto Bemporad

As robustness verification methods are becoming more precise, training certifiably robust neural networks is becoming ever more relevant. To this end, certified training methods compute and then optimize an upper bound on the worst-case…

Machine Learning · Computer Science 2024-02-29 Yuhao Mao , Mark Niklas Müller , Marc Fischer , Martin Vechev

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

Certification of neural networks is an important and challenging problem that has been attracting the attention of the machine learning community since few years. In this paper, we focus on randomized smoothing (RS) which is considered as…

Machine Learning · Computer Science 2022-09-14 Pol Labarbarie , Hatem Hajri , Marc Arnaudon