English
Related papers

Related papers: Local Regularity Estimation through Sobolev-Scale …

200 papers

Local Polynomial Regression (LPR) is a widely used nonparametric method for modeling complex relationships due to its flexibility and simplicity. It estimates a regression function by fitting low-degree polynomials to localized subsets of…

Methodology · Statistics 2025-07-22 Yaniv Shulman

An asymptotic theory is established for linear functionals of the predictive function given by kernel ridge regression, when the reproducing kernel Hilbert space is equivalent to a Sobolev space. The theory covers a wide variety of linear…

Statistics Theory · Mathematics 2025-08-25 Rui Tuo , Lu Zou

We study $s$-fractional $p$-Laplacian type equations with discontinuous kernel coefficients in divergence form to establish $W^{s+\sigma,q}$ estimates for any choice of pairs $( \sigma,q)$ with $q\in(p,\infty)$ and…

Analysis of PDEs · Mathematics 2023-03-16 Sun-Sig Byun , Kyeongbae Kim

We propose a vector-valued regression problem whose solution is equivalent to the reproducing kernel Hilbert space (RKHS) embedding of the Bayesian posterior distribution. This equivalence provides a new understanding of kernel Bayesian…

Machine Learning · Statistics 2016-10-27 Yang Song , Jun Zhu , Yong Ren

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

Machine Learning · Statistics 2024-03-12 Paul Dommel , Alois Pichler

Limit cycle oscillations are phenomena arising in nonlinear dynamical systems and characterized by periodic, locally-stable, and self-sustained state trajectories. Systems controlled in a closed loop along a periodic trajectory can also be…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Defne E. Ozan , Mingzhou Yin , Andrea Iannelli , Roy S. Smith

We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive…

Statistics Theory · Mathematics 2012-11-13 Ming Yuan , T. Tony Cai

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

We revisit the local well-posedness theory of nonlinear Schr\"odinger and wave equations in Sobolev spaces $H^s$ and $\dot{H}^s$, $0< s\leq 1$. The theory has been well established over the past few decades under Sobolev initial data…

Analysis of PDEs · Mathematics 2023-04-04 Youngwoo Koh , Yoonjung Lee , Ihyeok Seo

We propose a new method for feature learning and function estimation in supervised learning via regularised empirical risk minimisation. Our approach considers functions as expectations of Sobolev functions over all possible one-dimensional…

Machine Learning · Statistics 2025-05-01 Bertille Follain , Francis Bach

Radial basis functions (RBFs) are prominent examples for reproducing kernels with associated reproducing kernel Hilbert spaces (RKHSs). The convergence theory for the kernel-based interpolation in that space is well understood and optimal…

Classical Analysis and ODEs · Mathematics 2023-09-15 Thomas Hangelbroek , Christian Rieger

This article develops direct and inverse estimates for certain finite dimensional spaces arising in kernel approximation. Both the direct and inverse estimates are based on approximation spaces spanned by local Lagrange functions which are…

Numerical Analysis · Mathematics 2017-09-08 Thomas Hangelbroek , Francis J. Narcowich , Christian Rieger , Joseph D. Ward

For the past 30 years or so, machine learning has stimulated a great deal of research in the study of approximation capabilities (expressive power) of a multitude of processes, such as approximation by shallow or deep neural networks,…

Machine Learning · Computer Science 2025-01-07 Hrushikesh Mhaskar

Learning rates for least-squares regression are typically expressed in terms of $L_2$-norms. In this paper we extend these rates to norms stronger than the $L_2$-norm without requiring the regression function to be contained in the…

Machine Learning · Statistics 2020-10-27 Simon Fischer , Ingo Steinwart

We study Sobolev and BV spaces on local trees which are metric spaces locally isometric to real trees. Such spaces are equipped with a Radon measure satisfying a locally uniform volume growth condition. Using the intrinsic geodesic…

Analysis of PDEs · Mathematics 2025-05-16 Fabrice Baudoin , Li Chen , Meng Yang

We present the first optimal rates for infinite-dimensional vector-valued ridge regression on a continuous scale of norms that interpolate between $L_2$ and the hypothesis space, which we consider as a vector-valued reproducing kernel…

Machine Learning · Statistics 2024-08-07 Zhu Li , Dimitri Meunier , Mattes Mollenhauer , Arthur Gretton

We study the estimation of quadratic Sobolev-type integral functionals of an unknown density on the unit sphere. The functional is defined through fractional powers of the Laplace--Beltrami operator and provides a global measure of…

Statistics Theory · Mathematics 2026-02-05 Claudio Durastanti

This paper provides a new similarity detection algorithm. Given an input set of multi-dimensional data points, where each data point is assumed to be multi-dimensional, and an additional reference data point for similarity finding, the…

Artificial Intelligence · Computer Science 2017-07-12 Yariv Aizenbud , Amir Averbuch , Gil Shabat , Guy Ziv

This paper presents a convergence analysis of kernel-based quadrature rules in misspecified settings, focusing on deterministic quadrature in Sobolev spaces. In particular, we deal with misspecified settings where a test integrand is less…

Numerical Analysis · Mathematics 2018-10-31 Motonobu Kanagawa , Bharath K. Sriperumbudur , Kenji Fukumizu

The massive amount of available data potentially used to discover patters in machine learning is a challenge for kernel based algorithms with respect to runtime and storage capacities. Local approaches might help to relieve these issues.…

Machine Learning · Statistics 2017-03-21 Florian Dumpert