English
Related papers

Related papers: Nonparametric approximation of conditional expecta…

200 papers

We develop a stochastic approximation framework for learning nonlinear operators between infinite-dimensional spaces utilizing general Mercer operator-valued kernels. Our framework encompasses two key classes: (i) compact kernels, which…

Machine Learning · Statistics 2026-01-13 Jia-Qi Yang , Lei Shi

multiplication operator on a Hilbert space may be approximated with finite sections by choosing an orthonormal basis of the Hilbert space. Nonzero multiplication operators on $L^2$ spaces of functions are never compact and then such…

Numerical Analysis · Mathematics 2007-05-23 Stefano Serra Capizzano

Regularized kernel methods such as, e.g., support vector machines and least-squares support vector regression constitute an important class of standard learning algorithms in machine learning. Theoretical investigations concerning…

Machine Learning · Statistics 2012-03-21 Robert Hable

Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of…

Machine Learning · Computer Science 2012-06-22 Samuel Gershman , Matt Hoffman , David Blei

Motivated by the problem of understanding theoretical bounds for the performance of the Belkin-Niyogi Laplacian eigencoordinate approach to dimension reduction in machine learning problems, we consider the convergence of random graph…

Functional Analysis · Mathematics 2025-03-10 Bernard Akwei , Luke Rogers , Alexander Teplyaev

We consider $L^2$-approximation on weighted reproducing kernel Hilbert spaces of functions depending on infinitely many variables. We focus on unrestricted linear information, admitting evaluations of arbitrary continuous linear…

Numerical Analysis · Mathematics 2026-01-13 Kumar Harsha , Michael Gnewuch , Marcin Wnuk

The paper considers probability distribution, density, conditional distribution and density and conditional moments as well as their kernel estimators in spaces of generalized functions. This approach does not require restrictions on…

Statistics Theory · Mathematics 2013-03-07 Victoria Zinde-Walsh

In this paper, we introduce the spectral projection operators $\mathbb{P}_m$ on non-degenerate nilpotent Lie groups $\mathcal{N}$ of step two, associated to the joint spectrum of sub-Laplacian and derivatives in step two. We construct their…

Functional Analysis · Mathematics 2024-04-05 Qianqian Kang , Der-Chen Chang , Wei Wang

We consider a class of non-trivial perturbations ${\mathscr A}$ of the degenerate Ornstein-Uhlenbeck operator in ${\mathbb R}^N$. In fact we perturb both the diffusion and the drift part of the operator (say $Q$ and $B$) allowing the…

Analysis of PDEs · Mathematics 2008-03-05 B. Farkas , L. Lorenzi

This paper presents a novel Koopman composition operator representation framework for control systems in reproducing kernel Hilbert spaces (RKHSs) that is free of explicit dictionary or input parametrizations. By establishing fundamental…

Systems and Control · Electrical Eng. & Systems 2025-09-03 Petar Bevanda , Bas Driessen , Lucian Cristian Iacob , Stefan Sosnowski , Roland Tóth , Sandra Hirche

Conditional kernel mean embeddings are nonparametric models that encode conditional expectations in a reproducing kernel Hilbert space. While they provide a flexible and powerful framework for probabilistic inference, their performance is…

Machine Learning · Statistics 2018-11-09 Kelvin Hsu , Richard Nock , Fabio Ramos

Kernel methods are powerful learning methodologies that allow to perform non-linear data analysis. Despite their popularity, they suffer from poor scalability in big data scenarios. Various approximation methods, including random feature…

Machine Learning · Statistics 2022-06-14 Bharath Sriperumbudur , Nicholas Sterge

The goal of this paper is to introduce a process that generates, given Hilbert space $H$ and symmetric operator $A$, an embedding of $H$ into an $L_2$-space through which $A$ is extended by a multiplication operator. This process will…

Functional Analysis · Mathematics 2024-11-12 Fabrice Nonez

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi

We present an operator-free, measure-theoretic approach to the conditional mean embedding (CME) as a random variable taking values in a reproducing kernel Hilbert space. While the kernel mean embedding of unconditional distributions has…

Machine Learning · Computer Science 2021-01-11 Junhyung Park , Krikamol Muandet

The linear conditional expectation (LCE) provides a best linear (or rather, affine) estimate of the conditional expectation and hence plays an important r\^ole in approximate Bayesian inference, especially the Bayes linear approach. This…

Statistics Theory · Mathematics 2021-08-26 Ilja Klebanov , Björn Sprungk , T. J. Sullivan

We consider linear approximation based on function evaluations in reproducing kernel Hilbert spaces of certain analytic weighted power series kernels and stationary kernels on the interval $[-1,1]$. Both classes contain the popular Gaussian…

Numerical Analysis · Mathematics 2025-10-03 Toni Karvonen , Yuya Suzuki

We develop a unified framework for nonparametric functional estimation based on kernel transport along orbits of discrete group actions, which we term \emph{Twin Spaces}. Given a base kernel $K$ and a group $G = \langle\varphi\rangle$…

Statistics Theory · Mathematics 2025-12-12 Jocelyn Nembe

Using and extending fractional order statistic theory, we characterize the $O(n^{-1})$ coverage probability error of the previously proposed confidence intervals for population quantiles using $L$-statistics as endpoints in Hutson (1999).…

Statistics Theory · Mathematics 2018-02-28 Matt Goldman , David M. Kaplan

A key challenge in probabilistic regression is ensuring that predictive distributions accurately reflect true empirical uncertainty. Minimizing overall prediction error often encourages models to prioritize informativeness over calibration,…

Machine Learning · Statistics 2026-02-17 Ádám Jung , Domokos M. Kelen , András A. Benczúr