English
Related papers

Related papers: Convergence Types and Rates in Generic Karhunen-Lo…

200 papers

We present an orthogonal expansion for real, function-regulated, second-order random measures over $\mathbb{R}^{d}$ with measure covariance. Such a expansion, which can be seen as a Karhunen-Lo\`eve decomposition, consists in a series of…

Probability · Mathematics 2025-06-23 Ricardo Carrizo Vergara

We develop a generalisation of Mercer's theorem to operator-valued kernels in infinite dimensional Hilbert spaces. We then apply our result to deduce a Karhunen-Lo\`eve theorem, valid for mean-square continuous Hilbertian functional data,…

Probability · Mathematics 2023-03-03 Leonardo V. Santoro , Kartik G. Waghmare , Victor M. Panaretos

Axially symmetric processes on spheres, for which the second-order dependency structure may substantially vary with shifts in latitude, are a prominent alternative to model the spatial uncertainty of natural variables located over large…

Statistics Theory · Mathematics 2020-07-07 Alfredo Alegría , Francisco Cuevas-Pacheco

The Karhunen-Lo\`eve Expansion (KLE) of a stochastic process is a well understood eigenfunction expansion used widely in time series analysis, stochastic PDEs, and signal processing. Karhunen-Lo\`eve expansions have also been proven to…

Functional Analysis · Mathematics 2026-04-15 Trajan Murphy

This paper generalizes regularized regression problems in a hyper-reproducing kernel Hilbert space (hyper-RKHS), illustrates its utility for kernel learning and out-of-sample extensions, and proves asymptotic convergence results for the…

Machine Learning · Computer Science 2022-10-20 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

We analyse the convergence of sampling algorithms for functions in reproducing kernel Hilbert spaces (RKHS). To this end, we discuss approximation properties of kernel regression under minimalistic assumptions on both the kernel and the…

Machine Learning · Statistics 2025-04-21 Armin Iske

We prove convergence of eigenvector processes of the form $(\sqrt{N}\langle \mathbf{u}_k,A_t\mathbf{u}_k\rangle)_{t\in[0,1]}$ where $\mathbf{u}_k$ is a bulk eigenvector of generalized Wigner matrices and $(A_t)$ a family of symmetric…

Probability · Mathematics 2025-09-25 Lucas Benigni , Mohammadreza Rezaei Feyzabady

We investigate for which Gaussian processes there do or do not exist reproducing kernel Hilbert spaces (RKHSs) that contain almost all of their paths. In particular, we establish a new result that makes it possible to exclude the existence…

Probability · Mathematics 2026-02-12 Ingo Steinwart

It is known that the membership in a given reproducing kernel Hilbert space (RKHS) of the samples of a Gaussian process $X$ is controlled by a certain nuclear dominance condition. However, it is less clear how to identify a "small" set of…

Probability · Mathematics 2022-03-16 Toni Karvonen

We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimator under the…

Machine Learning · Statistics 2026-04-09 Prem Talwai , Ali Shameli , David Simchi-Levi

In this work we introduce a reduced-rank algorithm for Gaussian process regression. Our numerical scheme converts a Gaussian process on a user-specified interval to its Karhunen-Lo\`eve expansion, the $L^2$-optimal reduced-rank…

Computation · Statistics 2022-08-25 Philip Greengard , Michael O'Neil

Often in the analysis of first-order methods for both smooth and nonsmooth optimization, assuming the existence of a growth/error bound or KL condition facilitates much stronger convergence analysis. Hence separate analysis is typically…

Optimization and Control · Mathematics 2023-01-10 Benjamin Grimmer

The family of Mat\'ern kernels are often used in spatial statistics, function approximation and Gaussian process methods in machine learning. One reason for their popularity is the presence of a smoothness parameter that controls, for…

Statistics Theory · Mathematics 2025-06-06 Moritz Korte-Stapff , Toni Karvonen , Eric Moulines

We propose a novel test procedure for comparing mean functions across two groups within the reproducing kernel Hilbert space (RKHS) framework. Our proposed method is adept at handling sparsely and irregularly sampled functional data when…

Methodology · Statistics 2025-01-29 Chi Zhang , Peijun Sang , Yingli Qin

Covariate shift occurs prevalently in practice, where the input distributions of the source and target data are substantially different. Despite its practical importance in various learning problems, most of the existing methods only focus…

Machine Learning · Statistics 2023-10-20 Xingdong Feng , Xin He , Caixing Wang , Chao Wang , Jingnan Zhang

Gaussian process regression is a classical kernel method for function estimation and data interpolation. In large data applications, computational costs can be reduced using low-rank or sparse approximations of the kernel. This paper…

Numerical Analysis · Mathematics 2024-10-04 Daniel Sanz-Alonso , Ruiyi Yang

The Karhunen-Lo\`{e}ve (KL) expansion is a popular method for approximating random fields by transforming an infinite-dimensional stochastic domain into a finite-dimensional parameter space. Its numerical approximation is of central…

Numerical Analysis · Mathematics 2019-08-02 Michael Griebel , Guanglian Li

This paper reproduces results from Chapter 11 of the forthcoming book \cite{dzh25}. It discusses series expansions of processes with stationary increments (si-processes) and certain associated processes. Making use of de Branges theory of…

Probability · Mathematics 2025-04-15 Kacha Dzhaparidze

This paper makes two main contributions. First, we present a pedagogical review of the derivation of the three-term recurrence relation for Legendre polynomials, without relying on the classical Legendre differential equation, Rodrigues'…

Computational Engineering, Finance, and Science · Computer Science 2025-07-15 Michal Béreš

We consider linearizations of stochastic differential equations with additive noise using the Karhunen-Lo\`eve expansion. We obtain our linearizations by truncating the expansion and writing the solution as a series of matrix-vector…

Numerical Analysis · Mathematics 2020-04-14 Antti Koskela , Samuel D. Relton
‹ Prev 1 2 3 10 Next ›