English
Related papers

Related papers: The Price of Robustness: Stable Classifiers Need O…

200 papers

Fair classification has been a topic of intense study in machine learning, and several algorithms have been proposed towards this important task. However, in a recent study, Friedler et al. observed that fair classification algorithms may…

Machine Learning · Computer Science 2020-09-10 Lingxiao Huang , Nisheeth K. Vishnoi

This paper uses the notion of algorithmic stability to derive novel generalization bounds for several families of transductive regression algorithms, both by using convexity and closed-form solutions. Our analysis helps compare the…

Machine Learning · Computer Science 2009-04-07 Corinna Cortes , Mehryar Mohri , Dmitry Pechyony , Ashish Rastogi

A widely believed explanation for the remarkable generalization capacities of overparameterized neural networks is that the optimization algorithms used for training induce an implicit bias towards benign solutions. To grasp this…

Machine Learning · Computer Science 2025-12-19 Maria Matveev , Vit Fojtik , Hung-Hsu Chou , Gitta Kutyniok , Johannes Maly

Robustness is a basic property of any control system. In the context of linear output regulation, it was proved that embedding an internal model of the exogenous signals is necessary and sufficient to achieve tracking of the desired…

Systems and Control · Electrical Eng. & Systems 2021-04-23 Michelangelo Bin , Daniele Astolfi , Lorenzo Marconi

Preserving stability is a central problem in data-driven model order reduction of dynamical systems. For linear systems whose dynamics depend on geometric or physical parameters, multivariate rational approximation algorithms such as the…

Systems and Control · Electrical Eng. & Systems 2026-05-26 Antonio Carlucci

This paper discusses a general and useful stability principle which, roughly speaking, says that given a uniformly continuous function defined on an arbitrary metric space, if the function is bounded on the constraint set and we slightly…

Optimization and Control · Mathematics 2020-09-04 Daniel Reem , Simeon Reich , Alvaro De Pierro

Stability is an important aspect of a classification procedure because unstable predictions can potentially reduce users' trust in a classification system and also harm the reproducibility of scientific conclusions. The major goal of our…

Machine Learning · Statistics 2017-01-23 Will Wei Sun , Guang Cheng , Yufeng Liu

The reliability of a learning model is key to the successful deployment of machine learning in various applications. However, it is difficult to describe the phenomenon due to the complicated nature of the problems in machine learning. It…

Machine Learning · Computer Science 2025-05-27 Ramin Barati , Reza Safabakhsh , Mohammad Rahmati

This article offers a comprehensive treatment of polynomial functional regression, culminating in the establishment of a novel finite sample bound. This bound encompasses various aspects, including general smoothness conditions, capacity…

Numerical Analysis · Mathematics 2024-05-08 Markus Holzleitner , Sergei Pereverzyev

In this paper we criticize the robustness measure traditionally employed to assess the performance of machine learning models deployed in adversarial settings. To mitigate the limitations of robustness, we introduce a new measure called…

Machine Learning · Computer Science 2021-12-07 Stefano Calzavara , Lorenzo Cazzaro , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando

Modern learning systems often interpolate training data while still generalizing well, yet it remains unclear when algorithmic stability explains this behavior. We model training as a function-space trajectory and measure sensitivity to…

Machine Learning · Computer Science 2026-02-12 Ronald Katende

As attribution-based explanation methods are increasingly used to establish model trustworthiness in high-stakes situations, it is critical to ensure that these explanations are stable, e.g., robust to infinitesimal perturbations to an…

We introduce a new notion of the stability of computations, which holds under post-processing and adaptive composition. We show that the notion is both necessary and sufficient to ensure generalization in the face of adaptivity, for any…

Machine Learning · Computer Science 2020-01-01 Katrina Ligett , Moshe Shenfeld

In adversarial machine learning, deep neural networks can fit the adversarial examples on the training dataset but have poor generalization ability on the test set. This phenomenon is called robust overfitting, and it can be observed when…

Machine Learning · Computer Science 2022-11-01 Jiancong Xiao , Yanbo Fan , Ruoyu Sun , Jue Wang , Zhi-Quan Luo

We propose novel parameter estimation algorithms for a class of dynamical systems with nonlinear parametrization. The class is initially restricted to smooth monotonic functions with respect to a linear functional of the parameters. We show…

Dynamical Systems · Mathematics 2007-05-23 Ivan Tyukin , Danil Prokhorov , Cees van Leeuwen

Design of reliable systems must guarantee stability against input perturbations. In machine learning, such guarantee entails preventing overfitting and ensuring robustness of models against corruption of input data. In order to maximize…

Machine Learning · Statistics 2019-08-08 Judy Hoffman , Daniel A. Roberts , Sho Yaida

Deep models, while being extremely versatile and accurate, are vulnerable to adversarial attacks: slight perturbations that are imperceptible to humans can completely flip the prediction of deep models. Many attack and defense mechanisms…

Machine Learning · Computer Science 2019-07-30 Kaiwen Wu , Yaoliang Yu

Models with nonlinear architectures/parameterizations such as deep neural networks (DNNs) are well known for their mysteriously good generalization performance at overparameterization. In this work, we tackle this mystery from a novel…

Machine Learning · Computer Science 2022-11-22 Yaoyu Zhang , Zhongwang Zhang , Leyang Zhang , Zhiwei Bai , Tao Luo , Zhi-Qin John Xu

The robustness of classifiers has become a question of paramount importance in the past few years. Indeed, it has been shown that state-of-the-art deep learning architectures can easily be fooled with imperceptible changes to their inputs.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Théo Giraudon , Vincent Gripon , Matthias Löwe , Franck Vermet

We develop a framework to give upper bounds on the "practical" computational complexity of stability problems for a wide range of nonlinear continuous and hybrid systems. To do so, we describe stability properties of dynamical systems using…

Systems and Control · Computer Science 2014-06-05 Sicun Gao , Soonho Kong , Edmund Clarke