Related papers: Training Lipschitz continuous operators using repr…
We consider positive semidefinite kernels which have values given by bounded linear operators on certain bundles of Hilbert spaces and which are invariant under actions of $*$-semigroupoids. For these kernels, we prove that there exist…
In this note, we introduce a novel norm, termed the $t-$Berezin norm, on the algebra of all bounded linear operators defined on a reproducing kernel Hilbert space $\mathcal{H}$ as $$\|A\|_{t-ber} = \sup_{ \lambda, \mu \in \Omega} \left\{…
While the class of Polynomial Nets demonstrates comparable performance to neural networks (NN), it currently has neither theoretical generalization characterization nor robustness guarantees. To this end, we derive new complexity bounds for…
While monotone operator theory is often studied on Hilbert spaces, many interesting problems in machine learning and optimization arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as…
Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…
We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…
In this paper, we analyze the properties of invertible neural networks, which provide a way of solving inverse problems. Our main focus lies on investigating and controlling the Lipschitz constants of the corresponding inverse networks.…
In this paper, the framework of kernel machines with two layers is introduced, generalizing classical kernel methods. The new learning methodology provide a formal connection between computational architectures with multiple layers and the…
We consider periodic homogenization of nonlinearly elastic composite materials. Under suitable assumptions on the stored energy function (frame indifference; minimality, non-degeneracy and smoothness at identity; $p\geq d$-growth from…
We consider the least-square regression problem with regularization by a block 1-norm, i.e., a sum of Euclidean norms over spaces of dimensions larger than one. This problem, referred to as the group Lasso, extends the usual regularization…
In this paper, we characterize all closed linear operators in a separable Hilbert space which are unitarily equivalent to an integral bi-Carleman operator in $L_2(R)$ with bounded and arbitrarily smooth kernel on $R^2$. In addition, we give…
Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…
Stability and robustness are critical for deploying Transformers in safety-sensitive settings. A principled way to enforce such behavior is to constrain the model's Lipschitz constant. However, approximation-theoretic guarantees for…
We study uniform Lipschitz regularity estimates for elliptic systems in divergence form with continuous coefficients, based on rapidly oscillating periodic coefficients derived from homogenization theory. We extend a result by Avellaneda…
A crucial property for achieving secure, trustworthy and interpretable deep learning systems is their robustness: small changes to a system's inputs should not result in large changes to its outputs. Mathematically, this means one strives…
The Lipschitz bound, a technique from robust statistics, can limit the maximum changes in the output concerning the input, taking into account associated irrelevant biased factors. It is an efficient and provable method for examining the…
We provide a general approach to Lipschitz regularity of solutions for a large class of vector-valued, nonautonomous variational problems exhibiting nonuniform ellipticity. The functionals considered here range amongst those with unbalanced…
This paper addresses explainability of the operator-regularization approach under the use of monotone Lipschitz-gradient (MoL-Grad) denoiser -- an operator that can be expressed as the Lipschitz continuous gradient of a differentiable…
We use the theory of rectifiable metric spaces to define a Dirichlet energy of Lipschitz functions defined on the support of integral currents. This energy is obtained by integration of the square of the norm of the tangential derivative,…
This paper proposes a new regularization technique for reinforcement learning (RL) towards making policy and value functions smooth and stable. RL is known for the instability of the learning process and the sensitivity of the acquired…