English
Related papers

Related papers: Training Lipschitz continuous operators using repr…

200 papers

We consider positive semidefinite kernels which have values given by bounded linear operators on certain bundles of Hilbert spaces and which are invariant under actions of $*$-semigroupoids. For these kernels, we prove that there exist…

Functional Analysis · Mathematics 2026-02-20 Aurelian Gheondea

In this note, we introduce a novel norm, termed the $t-$Berezin norm, on the algebra of all bounded linear operators defined on a reproducing kernel Hilbert space $\mathcal{H}$ as $$\|A\|_{t-ber} = \sup_{ \lambda, \mu \in \Omega} \left\{…

Functional Analysis · Mathematics 2025-04-10 Raj Kumar Nayak , Pintu Bhunia

While the class of Polynomial Nets demonstrates comparable performance to neural networks (NN), it currently has neither theoretical generalization characterization nor robustness guarantees. To this end, we derive new complexity bounds for…

Machine Learning · Computer Science 2022-02-11 Zhenyu Zhu , Fabian Latorre , Grigorios G Chrysos , Volkan Cevher

While monotone operator theory is often studied on Hilbert spaces, many interesting problems in machine learning and optimization arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as…

Optimization and Control · Mathematics 2025-08-26 Alexander Davydov , Saber Jafarpour , Anton V. Proskurnikov , Francesco Bullo

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach

In this paper, we analyze the properties of invertible neural networks, which provide a way of solving inverse problems. Our main focus lies on investigating and controlling the Lipschitz constants of the corresponding inverse networks.…

Machine Learning · Computer Science 2021-09-01 Paul Hagemann , Sebastian Neumayer

In this paper, the framework of kernel machines with two layers is introduced, generalizing classical kernel methods. The new learning methodology provide a formal connection between computational architectures with multiple layers and the…

Machine Learning · Computer Science 2010-01-18 Francesco Dinuzzo

We consider periodic homogenization of nonlinearly elastic composite materials. Under suitable assumptions on the stored energy function (frame indifference; minimality, non-degeneracy and smoothness at identity; $p\geq d$-growth from…

Analysis of PDEs · Mathematics 2018-07-25 Stefan Neukamm , Mathias Schäffner

We consider the least-square regression problem with regularization by a block 1-norm, i.e., a sum of Euclidean norms over spaces of dimensions larger than one. This problem, referred to as the group Lasso, extends the usual regularization…

Machine Learning · Computer Science 2008-01-28 Francis Bach

In this paper, we characterize all closed linear operators in a separable Hilbert space which are unitarily equivalent to an integral bi-Carleman operator in $L_2(R)$ with bounded and arbitrarily smooth kernel on $R^2$. In addition, we give…

Spectral Theory · Mathematics 2007-05-23 Igor M. Novitskii

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

Stability and robustness are critical for deploying Transformers in safety-sensitive settings. A principled way to enforce such behavior is to constrain the model's Lipschitz constant. However, approximation-theoretic guarantees for…

Machine Learning · Computer Science 2026-02-18 Takashi Furuya , Davide Murari , Carola-Bibiane Schönlieb

We study uniform Lipschitz regularity estimates for elliptic systems in divergence form with continuous coefficients, based on rapidly oscillating periodic coefficients derived from homogenization theory. We extend a result by Avellaneda…

Analysis of PDEs · Mathematics 2025-10-28 Sungjin Lee

A crucial property for achieving secure, trustworthy and interpretable deep learning systems is their robustness: small changes to a system's inputs should not result in large changes to its outputs. Mathematically, this means one strives…

Machine Learning · Computer Science 2024-06-04 Bernd Prach , Christoph H. Lampert

The Lipschitz bound, a technique from robust statistics, can limit the maximum changes in the output concerning the input, taking into account associated irrelevant biased factors. It is an efficient and provable method for examining the…

Machine Learning · Computer Science 2023-12-13 Yaning Jia , Chunhui Zhang

We provide a general approach to Lipschitz regularity of solutions for a large class of vector-valued, nonautonomous variational problems exhibiting nonuniform ellipticity. The functionals considered here range amongst those with unbalanced…

Analysis of PDEs · Mathematics 2021-08-02 Cristiana De Filippis , Giuseppe Mingione

This paper addresses explainability of the operator-regularization approach under the use of monotone Lipschitz-gradient (MoL-Grad) denoiser -- an operator that can be expressed as the Lipschitz continuous gradient of a differentiable…

Optimization and Control · Mathematics 2025-09-26 Masahiro Yukawa , Isao Yamada

We use the theory of rectifiable metric spaces to define a Dirichlet energy of Lipschitz functions defined on the support of integral currents. This energy is obtained by integration of the square of the norm of the tangential derivative,…

Differential Geometry · Mathematics 2014-11-07 Jacobus W. Portegies

This paper proposes a new regularization technique for reinforcement learning (RL) towards making policy and value functions smooth and stable. RL is known for the instability of the learning process and the sensitivity of the acquired…

Robotics · Computer Science 2023-07-04 Taisuke Kobayashi