English
Related papers

Related papers: Lipschitz behavior of the robust regularization

200 papers

This paper investigates strong metric subregularity around a reference point as introduced by H. Gfrerer and J. V. Outrata. In the setting of Banach spaces, we analyse its stability under Lipschitz continuous perturbations and establish its…

Optimization and Control · Mathematics 2025-05-07 Tomáš Roubal

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

Recent quasi-optimal error estimates for the finite element approximation of total-variation regularized minimization problems require the existence of a Lipschitz continuous dual solution. We discuss the validity of this condition and…

Numerical Analysis · Mathematics 2021-06-28 Sören Bartels , Robert Tovey , Friedrich Wassmer

Although the property of strong metric subregularity of set-valued mappings has been present in the literature under various names and with various definitions for more than two decades, it has attracted much less attention than its older…

Optimization and Control · Mathematics 2018-05-15 Radek Cibulka , Asen Dontchev , Alexander Kruger

We study real-valued valuations on the space of Lipschitz functions over the Euclidean unit sphere $S^{n-1}$. After introducing an appropriate notion of convergence, we show that continuous valuations are bounded on sets which are bounded…

Metric Geometry · Mathematics 2020-05-13 Andrea Colesanti , Daniele Pagnini , Pedro Tradacete , Ignacio Villanueva

It was already known that a p-adic, locally Lipschitz continuous semi-algebraic function is piecewise Lipschitz continuous, where the pieces can be taken semi-algebraic. We prove that if the function has locally Lipschitz constant 1, then…

Logic · Mathematics 2010-10-01 Raf Cluckers , Immanuel Halupczok

On a compact connected group $G$, consider the infinitesimal generator $-L$ of a central symmetric Gaussian convolution semigroup $(\mu_t)_{t>0}$. We establish several regularity results of the solution to the Poisson equation $LU=F$, both…

Analysis of PDEs · Mathematics 2025-04-23 Alexander Bendikov , Li Chen , Laurent Saloff-Coste

We show optimal Lipschitz regularity for very weak solutions of the (measure-valued) elliptic PDE $-\mathrm{div}(A(x) \nabla u) = Q \; \mathcal{H}^{n-1} \llcorner \Gamma$ in a smooth domain $\Omega \subset \mathbb{R}^n$. Here $\Gamma$ is a…

Analysis of PDEs · Mathematics 2023-09-25 Marius Müller

In this paper we present a cubic regularized Newton's method to minimize a smooth function over a Riemannian manifold. The proposed algorithm is shown to reach a second-order $\epsilon$-stationary point within…

Optimization and Control · Mathematics 2018-05-16 Junyu Zhang , Shuzhong Zhang

We show how to infer sharp partial regularity results for relaxed minimizers of degenerate, nonuniformly elliptic quasiconvex functionals, using tools from Nonlinear Potential Theory. In particular, in the setting of functionals with…

Analysis of PDEs · Mathematics 2022-04-12 Cristiana De Filippis

We initiate the study of the inherent tradeoffs between the size of a neural network and its robustness, as measured by its Lipschitz constant. We make a precise conjecture that, for any Lipschitz activation function and for most datasets,…

Machine Learning · Computer Science 2020-11-26 Sébastien Bubeck , Yuanzhi Li , Dheeraj Nagaraj

Lipschitz continuity is a crucial functional property of any predictive model, that naturally governs its robustness, generalisation, as well as adversarial vulnerability. Contrary to other works that focus on obtaining tighter bounds and…

Machine Learning · Computer Science 2024-05-16 Grigory Khromov , Sidak Pal Singh

In this paper, stability and sensitivity properties of a class of parametric constrained optimization problem, whose feasible region is defined by a set-valued inclusion, are investigated through the associated optimal value function.…

Optimization and Control · Mathematics 2024-12-06 Amos Uderzo

This paper identifies necessary and sufficient conditions for the exactness of penalty functions in optimization problems whose constraint sets are not necessarily bounded. The case where the data of problems is locally Lipschitz,…

Optimization and Control · Mathematics 2025-10-21 Liguo Jiao , Tien-Son Pham , Nguyen Van Tuyen

This paper considers stochastic weakly convex optimization without the standard Lipschitz continuity assumption. Based on new adaptive regularization (stepsize) strategies, we show that a wide class of stochastic algorithms, including the…

Optimization and Control · Mathematics 2024-11-07 Wenzhi Gao , Qi Deng

Lipschitz-constrained neural networks have many applications in machine learning. Since designing and training expressive Lipschitz-constrained networks is very challenging, there is a need for improved methods and a better theoretical…

Machine Learning · Computer Science 2022-04-14 Sebastian Neumayer , Alexis Goujon , Pakshal Bohra , Michael Unser

In this paper, we introduce a new class of nonsmooth convex functions called SOS-convex semialgebraic functions extending the recently proposed notion of SOS-convex polynomials. This class of nonsmooth convex functions covers many common…

Optimization and Control · Mathematics 2017-02-09 N. H. Chieu , J. W. Feng , W. Gao , G. Li , D. Wu

We consider the problem of minimizing a continuous function given quantum access to a stochastic gradient oracle. We provide two new methods for the special case of minimizing a Lipschitz convex function. Each method obtains a dimension…

Quantum Physics · Physics 2024-07-26 Aaron Sidford , Chenyi Zhang

This note shows that, for a fixed Lipschitz constant $L > 0$, one layer neural networks that are $L$-Lipschitz are dense in the set of all $L$-Lipschitz functions with respect to the uniform norm on bounded sets.

Machine Learning · Statistics 2020-09-30 Stephan Eckstein

We study the optimal rectangular-discrepancy approximation of permutons by finite permutations. We transfer bounds from discrepancy theory to this more restricted setup. Moreover, we show that superlinear approximation can occur only for…

Combinatorics · Mathematics 2026-05-05 Balázs Maga