English
Related papers

Related papers: Stability Bounds for the Unfolded Forward-Backward…

200 papers

We investigate robust nonparametric regression in the presence of heavy-tailed noise, where the hypothesis class may contain unbounded functions and robustness is ensured via a robust loss function $\ell_\sigma$. Using Huber regression as a…

Machine Learning · Computer Science 2025-10-14 Yunlong Feng , Qiang Wu

We present a model of roundoff error analysis that combines simplicity with predictive power. Though not considering all sources of roundoff within an algorithm, the model is related to a recursive roundoff error analysis and therefore…

Numerical Analysis · Mathematics 2010-06-01 Folkmar Bornemann

We present an algorithm for robust model predictive control with consideration of uncertainty and safety constraints. Our framework considers a nonlinear dynamical system subject to disturbances from an unknown but bounded uncertainty set.…

Optimization and Control · Mathematics 2021-04-23 Dongchan Lee , Konstantin Turitsyn , Jean-Jacques Slotine

This paper considers the inversion of ill-posed linear operators. To regularise the problem the solution is enforced to lie in a non-convex subset. Theoretical properties for the stable inversion are derived and an iterative algorithm akin…

Numerical Analysis · Mathematics 2009-11-30 Thomas Blumensath

We consider solving a probably infinite dimensional operator equation, where the operator is not modeled by physical laws but is specified indirectly via training pairs of the input-output relation of the operator. Neural operators have…

Numerical Analysis · Mathematics 2026-05-06 Otmar Scherzer , Thi Lan Nhi Vu , Jikai Yan

This paper introduces new parameterizations of equilibrium neural networks, i.e. networks defined by implicit equations. This model class includes standard multilayer and residual networks as special cases. The new parameterization admits a…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

We present a general variational framework for the training of freeform nonlinearities in layered computational architectures subject to some slope constraints. The regularization that we add to the traditional training loss penalizes the…

Machine Learning · Statistics 2025-03-31 Michael Unser , Alexis Goujon , Stanislas Ducotterd

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Machine Learning · Computer Science 2022-02-03 Michael Everett , Bjorn Lutjens , Jonathan P. How

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

The paper considers the problem of performing a task defined on a model parameter that is only observed indirectly through noisy data in an ill-posed inverse problem. A key aspect is to formalize the steps of reconstruction and task as…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jonas Adler , Sebastian Lunz , Olivier Verdier , Carola-Bibiane Schönlieb , Ozan Öktem

While generalizing well over natural inputs, neural networks are vulnerable to adversarial inputs. Existing defenses against adversarial inputs have largely been detached from the real world. These defenses also come at a cost to accuracy.…

Machine Learning · Computer Science 2019-12-05 Varun Chandrasekaran , Brian Tang , Nicolas Papernot , Kassem Fawaz , Somesh Jha , Xi Wu

The existence of instabilities, for example in the form of adversarial examples, has given rise to a highly active area of research concerning itself with understanding and enhancing the stability of neural networks. We focus on a popular…

Numerical Analysis · Mathematics 2025-10-28 Matthias J. Ehrhardt , Davide Murari , Ferdia Sherry

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

The diffusion-driven Turing instability is a potential mechanism for spatial pattern formation in numerous biological and chemical systems. However, engineering these patterns and demonstrating that they are produced by this mechanism is…

Biological Physics · Physics 2025-12-02 Antonio Matas-Gil , Robert G. Endres

Robustness against adversarial attack in neural networks is an important research topic in the machine learning community. We observe one major source of vulnerability of neural nets is from overparameterized fully-connected layers. In this…

Machine Learning · Computer Science 2021-02-01 Bingyuan Liu , Christopher Malon , Lingzhou Xue , Erik Kruus

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

Optimization and Control · Mathematics 2021-04-09 Richard Clancy , Stephen Becker

We consider nonlinear inverse problems described by operator equations in Banach spaces. Assuming conditional stability of the inverse problem, that is, assuming that stability holds on a closed, convex subset of the domain of the operator,…

Numerical Analysis · Mathematics 2012-06-19 Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

Inverse problems correspond to a certain type of optimization problems formulated over appropriate input distributions. Recently, there has been a growing interest in understanding the computational hardness of these optimization problems,…

Machine Learning · Statistics 2018-09-03 Alex Nowak , Soledad Villar , Afonso S. Bandeira , Joan Bruna