English
Related papers

Related papers: Lipschitz constants in experimental optimization

200 papers

We study expansion/contraction properties of some common classes of mappings of the Euclidean space ${\mathbb R}^n, n\ge 2\,,$ with respect to the distance ratio metric. The first main case is the behavior of M\"obius transformations of the…

Complex Variables · Mathematics 2013-07-11 Slavko Simić , Matti Vuorinen , Gendi Wang

An invertible function is bi-Lipschitz if both the function and its inverse have bounded Lipschitz constants. Nowadays, most Normalizing Flows are bi-Lipschitz by design or by training to limit numerical errors (among other things). In this…

Machine Learning · Computer Science 2024-03-08 Alexandre Verine , Benjamin Negrevergne , Fabrice Rossi , Yann Chevaleyre

The scalar G{\"u}nter derivatives of a function defined on the boundary of a three-dimensional domain are expressed as components (or their opposites) of the tangential vector rotational of this function in the canonical orthonormal basis…

Numerical Analysis · Mathematics 2016-11-15 A. Bendali , S Tordeux

Softening material models are known to trigger spurious localizations.This may be shown theoretically by the existence of solutions with zero dissipation when localization occurs and numerically with spurious mesh dependency and…

Computational Engineering, Finance, and Science · Computer Science 2021-08-10 Nicolas Moes , Nicolas Chevaugeon

This paper considers stochastic weakly convex optimization without the standard Lipschitz continuity assumption. Based on new adaptive regularization (stepsize) strategies, we show that a wide class of stochastic algorithms, including the…

Optimization and Control · Mathematics 2024-11-07 Wenzhi Gao , Qi Deng

Model predictive control (MPC) solves a receding-horizon optimization problem in real-time, which can be computationally demanding when there are thousands of constraints. To accelerate online computation of MPC, we utilize data to…

Systems and Control · Electrical Eng. & Systems 2024-03-29 Zhinan Hou , Feiran Zhao , Keyou You

The need of fast distributed solvers for optimization problems in networked systems has motivated the recent development of the Fast-Lipschitz optimization framework. In such an optimization, problems satisfying certain qualifying…

Optimization and Control · Mathematics 2016-11-17 Martin Jakobsson , Carlo Fischione , Pradeep Chathuranga Weeraddana

The local Lipschitz constant of a neural network is a useful metric with applications in robustness, generalization, and fairness evaluation. We provide novel analytic results relating the local Lipschitz constant of nonsmooth vector-valued…

Machine Learning · Statistics 2021-01-12 Matt Jordan , Alexandros G. Dimakis

We show several variants of concentration inequalities on the sphere stated as subgaussian estimates with optimal constants. For a Lipschitz function, we give one-sided and two-sided bounds for deviation from the median as well as from the…

Probability · Mathematics 2026-04-02 Guillaume Aubrun , Justin Jenkinson , Stanislaw J. Szarek

Unbiased and consistent variance estimators generally do not exist for design-based treatment effect estimators because experimenters never observe more than one potential outcome for any unit. The problem is exacerbated by interference and…

Methodology · Statistics 2024-07-04 Christopher Harshaw , Joel A. Middleton , Fredrik Sävje

Extracting dynamic models from data is of enormous importance in understanding the properties of unknown systems. In this work, we employ Lipschitz neural networks, a class of neural networks with a prescribed upper bound on their Lipschitz…

Systems and Control · Electrical Eng. & Systems 2025-08-21 Shiqing Wei , Prashanth Krishnamurthy , Farshad Khorrami

Preconditioning is a crucial operation in gradient-based numerical optimisation. It helps decrease the local condition number of a function by appropriately transforming its gradient. For a convex function, where the gradient can be…

Optimization and Control · Mathematics 2023-08-29 Dmitrii A. Pasechnyuk , Alexander Gasnikov , Martin Takáč

In this paper, a new method of H_infinity observer design for Lipschitz nonlinear systems is proposed in the form of an LMI optimization problem. The proposed observer has guaranteed decay rate (exponential convergence) and is robust…

Systems and Control · Computer Science 2010-10-06 Masoud Abbaszadeh , Horacio J. Marquez

This paper investigates the elastic scattering by unbounded deterministic and random rough surfaces, which both are assumed to be graphs of Lipschitz continuous functions. For the deterministic case, an a priori bound explicitly dependent…

Analysis of PDEs · Mathematics 2023-02-28 Tianjiao Wang , Yiwen Lin , Xiang Xu

In this work, we propose a framework to learn feedback control policies with guarantees on closed-loop generalization and adversarial robustness. These policies are learned directly from expert demonstrations, contained in a dataset of…

Machine Learning · Computer Science 2022-11-03 Abed AlRahman Al Makdah , Vishaal Krishnan , Fabio Pasqualetti

Randomized smoothing is a widely adopted technique for optimizing nonsmooth objective functions. However, its efficiency analysis typically relies on global Lipschitz continuity, a condition rarely met in practical applications. To address…

Optimization and Control · Mathematics 2025-09-10 Jingfan Xia , Zhenwei Lin , Qi Deng

In stochastic convex optimization problems, most existing adaptive methods rely on prior knowledge about the diameter bound $D$ when the smoothness or the Lipschitz constant is unknown. This often significantly affects performance as only a…

Optimization and Control · Mathematics 2025-10-08 Clément Lezane , Alexandre d'Aspremont

The paper investigates stability properties of solutions of optimal control problems for semilinear parabolic partial differential equations. H\"older or Lipschitz dependence of the optimal solution on perturbations are obtained for…

Optimization and Control · Mathematics 2025-11-18 Alberto Domínguez Corella , Nicolai Jork , Vladimir M. Veliov

Kalu\v{z}a, Kopeck\'a and the author have shown that the best Lipschitz constant for mappings taking a given $n^{d}$-element set in the integer lattice $\mathbb{Z}^{d}$, with $n\in \mathbb{N}$, surjectively to the regular $n$ times $n$ grid…

Functional Analysis · Mathematics 2023-09-14 Michael Dymond

In this work, we propose a dissipativity-based method for Lipschitz constant estimation of 1D convolutional neural networks (CNNs). In particular, we analyze the dissipativity properties of convolutional, pooling, and fully connected layers…

Machine Learning · Computer Science 2023-06-21 Patricia Pauli , Dennis Gramlich , Frank Allgöwer