Related papers: Sharp inverse statements for kernel approximation:…
For an arbitrary self-adjoint operator $B$ in a Hilbert space $H$, we present direct and inverse theorems establishing the relationship between the degree of smoothness of a vector $x \in H$ with respect to the operator $B$, the rate of…
The main purpose of the paper is to study sharp estimates of approximation of periodic functions in the H\"older spaces $H_p^{r,\alpha}$ for all $0<p\le\infty$ and $0<\alpha\le r$. By using modifications of the classical moduli of…
Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…
Matrix approximations are a key element in large-scale algebraic machine learning approaches. The recently proposed method MEKA (Si et al., 2014) effectively employs two common assumptions in Hilbert spaces: the low-rank property of an…
We present and analyze an approximation scheme for a class of highly oscillatory kernel functions, taking the 2D and 3D Helmholtz kernels as examples. The scheme is based on polynomial interpolation combined with suitable pre- and…
This paper studies Tikhonov regularization for finitely smoothing operators in Banach spaces when the penalization enforces too much smoothness in the sense that the penalty term is not finite at the true solution. In a Hilbert space…
A new representation is proposed for functions in a Sobolev space with dominating mixed smoothness on an $N$-dimensional hyperrectangle. In particular, it is shown that these functions can be expressed in terms of their highest-order mixed…
We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…
This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…
Feature maps associated with positive definite kernels play a central role in kernel methods and learning theory, where regularity properties such as Lipschitz continuity are closely related to robustness and stability guarantees. Despite…
In this paper we study direct and inverse approximation inequalities in $L^{p}(\mathbb{R}^{d})$, $1<p<\infty$, with the Dunkl weight. We obtain these estimates in their sharp form substantially improving previous results. We also establish…
We prove rates of convergence in the statistical sense for kernel-based least squares regression using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is directly related…
By studying $\mathbb{A}^1$-curves on varieties, we propose a geometric approach to strong approximation problem over function fields of complex curves. We prove that strong approximation holds for smooth, low degree affine complete…
In this paper, we discuss the convergence analysis of the conjugate gradient-based algorithm for the functional linear model in the reproducing kernel Hilbert space framework, utilizing early stopping results in regularization against…
A number of years ago, Kumar Murty pointed out to me that the computation of the fundamental group of a Hilbert modular surface ([7],IV,${\S}$6), and the computation of the congruence subgroup kernel of SL(2) ([6]) were surprisingly…
We consider piecewise linear interpolation from the perspective of kernel interpolation and quadrature. If the Sobolev space $W_2^1(0, 1)$ is equipped with a suitable inner product, its reproducing kernel is piecewise linear and gives rise…
Some sharp results related to the convergence of means and families of operators generated by the generalized Bochner-Riesz kernels are obtained. The exact order of approximation of functions by these methods via $K$-functional (or its…
This paper introduces a new parameterization of deep neural networks (both fully-connected and convolutional) with guaranteed $\ell^2$ Lipschitz bounds, i.e. limited sensitivity to input perturbations. The Lipschitz guarantees are…
We give an intrinsic characterization of the restrictions of Sobolev, Triebel-Lizorkin and Besov spaces to regular subsets of $R^n$ via sharp maximal functions and local approximations.
In Musilak-Orlicz type spaces ${\mathcal S}_{\bf M}$, direct and inverse approximation theorems are obtained in terms of the best approximations of functions and generalized moduli of smoothness. The question of the exact constants in…