English
Related papers

Related papers: Reproducing kernel Hilbert spaces of Gaussian prio…

200 papers

We study classes of reproducing kernels $K$ on general domains; these are kernels which arise commonly in machine learning models; models based on certain families of reproducing kernel Hilbert spaces. They are the positive definite kernels…

Functional Analysis · Mathematics 2017-08-22 Palle Jorgensen , Feng Tian

For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. The covariance is the central object for uncertainty…

Statistics Theory · Mathematics 2025-08-13 Giuseppe Carere , Han Cheng Lie

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

We study integration and $L^2$-approximation in the worst-case setting for deterministic linear algorithms based on function evaluations. The underlying function space is a reproducing kernel Hilbert space with a Gaussian kernel of tensor…

Numerical Analysis · Mathematics 2025-12-08 Michael Gnewuch , Klaus Ritter , Robin Rüßmann

Let $G$ be a locally compact abelian group with a Haar measure, and $Y$ be a measure space. Suppose that $H$ is a reproducing kernel Hilbert space of functions on $G\times Y$, such that $H$ is naturally embedded into $L^2(G\times Y)$ and is…

Functional Analysis · Mathematics 2025-04-28 Crispin Herrera-Yañez , Egor A. Maximenko , Gerardo Ramos-Vazquez

Gaussian time-series models are often specified through their spectral density. Such models present several computational challenges, in particular because of the non-sparse nature of the covariance matrix. We derive a fast approximation of…

Computation · Statistics 2012-11-20 Nicolas Chopin , Judith Rousseau , Brunero Liseo

Nonlinear kernel regression models are often used in statistics and machine learning because they are more accurate than linear models. Variable selection for kernel regression models is a challenge partly because, unlike the linear…

Methodology · Statistics 2017-06-13 Lorin Crawford , Kris C. Wood , Xiang Zhou , Sayan Mukherjee

Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the…

Machine Learning · Statistics 2024-10-24 Ambrus Tamás , Balázs Csanád Csáji

In these notes, we investigate the tail behaviour of the norm of subgaussian vectors in a Hilbert space. The subgaussian variance proxy is given as a trace class operator, allowing for a precise control of the moments along each dimension…

Probability · Mathematics 2023-10-04 Mattes Mollenhauer , Claudia Schillings

In this paper, we extend the correspondence between Bayes' estimation and optimal interpolation in a Reproducing Kernel Hilbert Space (RKHS) to the case of linear inequality constraints such as boundedness, monotonicity or convexity. In the…

Probability · Mathematics 2016-02-09 Xavier Bay , Laurence Grammont , Hassan Maatouk

Motivated by applications to the study of stochastic processes, we introduce a new analysis of positive definite kernels $K$, their reproducing kernel Hilbert spaces (RKHS), and an associated family of feature spaces that may be chosen in…

Functional Analysis · Mathematics 2017-07-27 Palle Jorgensen , Feng Tian

For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. Using the Feldman-Hajek theorem, we analyse the prior-to-posterior…

Statistics Theory · Mathematics 2025-04-07 Giuseppe Carere , Han Cheng Lie

The Gibbs reference posterior distribution provides an objective full-Bayesian solution to the problem of prediction of a stationary Gaussian process with Mat\'ern anisotropic kernel. A full-Bayesian approach is possible, because the…

Statistics Theory · Mathematics 2018-01-16 Joseph Muré

This article is concerned with solving the time fractional Vakhnenko Parkes equation using the reproducing kernels. Reproducing kernel theory, the normal basis, some important Hilbert spaces, homogenization of constraints, and the…

Numerical Analysis · Mathematics 2024-12-17 Gayatri Das , S. Saha Ray

A structure-preserving kernel ridge regression method is presented that allows the recovery of nonlinear Hamiltonian functions out of datasets made of noisy observations of Hamiltonian vector fields. The method proposes a closed-form…

Machine Learning · Statistics 2025-04-07 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

This paper is devoted to the study of vector valued reproducing kernel Hilbert spaces. We focus on two aspects: vector valued feature maps and universal kernels. In particular we characterize the structure of translation invariant kernels…

Functional Analysis · Mathematics 2008-07-11 C. Carmeli , E. De Vito , A. Toigo , V. Umanità

Prior information often takes the form of parameter constraints. Bayesian methods include such information through prior distributions having constrained support. By using posterior sampling algorithms, one can quantify uncertainty without…

Methodology · Statistics 2018-09-25 Leo L Duan , Alexander L Young , Akihiko Nishimura , David B Dunson

In the Bayes paradigm and for a given loss function, we propose the construction of a new type of posterior distributions, that extends the classical Bayes one, for estimating the law of an $n$-sample. The loss functions we have in mind are…

Statistics Theory · Mathematics 2024-01-05 Yannick Baraud

The hyperparameters in Gaussian process regression (GPR) model with a specified kernel are often estimated from the data via the maximum marginal likelihood. Due to the non-convexity of marginal likelihood with respect to the…

Machine Learning · Statistics 2018-01-15 Zexun Chen , Bo Wang

Density estimation represents one of the most successful applications of Bayesian nonparametrics. In particular, Dirichlet process mixtures of normals are the gold standard for density estimation and their asymptotic properties have been…

Statistics Theory · Mathematics 2015-07-02 Antonio Canale , Pierpaolo De Blasi