English
Related papers

Related papers: Lipschitz behavior of the robust regularization

200 papers

There is a basic paradigm, called here the radius of well-posedness, which quantifies the "distance" from a given well-posed problem to the set of ill-posed problems of the same kind. In variational analysis, well-posedness is often…

Optimization and Control · Mathematics 2022-06-17 Asen L. Dontchev , Helmut Gfrerer , Alexander Y. Kruger , Jiří V. Outrata

We prove local Lipschitz regularity for local minimiser of \[ W^{1,1}(\Omega)\ni v\mapsto \int_\Omega F(Dv)\, dx \] where $\Omega\subseteq {\mathbb R}^N$, $N\ge 2$ and $F:{\mathbb R}^N\to {\mathbb R}$ is a quasiuniformly convex integrand in…

Analysis of PDEs · Mathematics 2023-04-05 Greta Marino , Sunra Mosconi

Rational functions of total degree $l$ in n variables have a representation in the Bernstein form defined over $n$ dimensional simplex. The range of a rational function is bounded by the smallest and the largest rational Bernstein…

Optimization and Control · Mathematics 2019-06-27 Tareq Hamadneh , Hassan Al-Zoubi , Hamza Alzaareer , Rafael Wisniewski

Randomized smoothing is a widely adopted technique for optimizing nonsmooth objective functions. However, its efficiency analysis typically relies on global Lipschitz continuity, a condition rarely met in practical applications. To address…

Optimization and Control · Mathematics 2025-09-10 Jingfan Xia , Zhenwei Lin , Qi Deng

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

The purpose of this article is to study Lipschitz CR mappings from an $h$-extendible (or semi-regular) hypersurface in $\mbb C^n$. Under various assumptions on the target hypersurface, it is shown that such mappings must be smooth. A…

Complex Variables · Mathematics 2011-02-15 G. P. Balakumar , Kaushal Verma

Robust risk minimisation has several advantages: it has been studied with regards to improving the generalisation properties of models and robustness to adversarial perturbation. We bound the distributionally robust risk for a model class…

Machine Learning · Statistics 2018-09-06 Zac Cranko , Simon Kornblith , Zhan Shi , Richard Nock

This paper is devoted to the proof of Lipschitz regularity, down to the microscopic scale, for solutions of an elliptic system with highly oscillating coefficients, over a highly oscillating Lipschitz boundary. The originality of this…

Analysis of PDEs · Mathematics 2015-04-08 Carlos Kenig , Christophe Prange

Since the control of the Lipschitz constant has a great impact on the training stability, generalization, and robustness of neural networks, the estimation of this value is nowadays a real scientific challenge. In this paper we introduce a…

Machine Learning · Computer Science 2023-06-21 Blaise Delattre , Quentin Barthélemy , Alexandre Araujo , Alexandre Allauzen

A rational approximation by a ratio of polynomial functions is a flexible alternative to polynomial approximation. In particular, rational functions exhibit accurate estimations to nonsmooth and non- Lipschitz functions, where polynomial…

Optimization and Control · Mathematics 2020-02-27 V. Peiris , N. Sharon , N. Sukhorukova J. Ugon

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

Beside the minimization of the prediction error, two of the most desirable properties of a regression scheme are stability and interpretability. Driven by these principles, we propose continuous-domain formulations for one-dimensional…

Machine Learning · Computer Science 2021-12-28 Shayan Aziznejad , Thomas Debarre , Michael Unser

The Lipschitz constant is an important quantity that arises in analysing the convergence of gradient-based optimization methods. It is generally unclear how to estimate the Lipschitz constant of a complex model. Thus, this paper studies an…

Machine Learning · Statistics 2023-02-10 Calypso Herrera , Florian Krach , Josef Teichmann

We establish the Lipschitz regularity of the a priori bounded local minimizers of integral functionals with non autonomous energy densities satisfying non standard growth conditions under a sharp bound on the gap between the growth and the…

Analysis of PDEs · Mathematics 2023-10-10 Michela Eleuteri , Antonia Passarelli di Napoli

In the context of structured nonconvex optimization, we estimate the increase in minimum value for a decision that is robust to parameter perturbations as compared to the value of a nominal problem. The estimates rely on detailed…

Optimization and Control · Mathematics 2022-11-22 Johannes O. Royset

We obtain Lipschitz estimates for bounded minimizers of functionals with nonstandard $(p,q)$-growth satisfying the dimension-independent restriction $q<p+2$ with $p \geq 2$. This relation improves existing restrictions when $p \leq N-1$,…

Analysis of PDEs · Mathematics 2021-08-16 Karthik Adimurthi , Vivek Tewary

We establish risk bounds for Regularized Empirical Risk Minimizers (RERM) when the loss is Lipschitz and convex and the regularization function is a norm. In a first part, we obtain these results in the i.i.d. setup under subgaussian…

Statistics Theory · Mathematics 2021-01-07 Geoffrey Chinot , Guillaume Lecué , Matthieu Lerasle

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

This paper introduces new parameterizations of equilibrium neural networks, i.e. networks defined by implicit equations. This model class includes standard multilayer and residual networks as special cases. The new parameterization admits a…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

A set in the Euclidean plane is constructed whose image under the classical Radon transform is Lipschitz in every direction. It is also shown that, under mild hypotheses, for any such set the function which maps a direction to the…

Classical Analysis and ODEs · Mathematics 2016-09-22 Jonas Azzam , Jonathan Hickman , Sean Li