English
Related papers

Related papers: H\"offding's Kernels and Periodic Covariance Repre…

200 papers

Kernel methods have been widely applied to machine learning and other questions of approximating an unknown function from its finite sample data. To ensure arbitrary accuracy of such approximation, various denseness conditions are imposed…

Machine Learning · Statistics 2013-10-25 Benxun Wang , Haizhang Zhang

The ability to identify useful features or representations of the input data based on training data that achieves low prediction error on test data across multiple prediction tasks is considered the key to multitask learning success. In…

Machine Learning · Statistics 2025-02-12 Soumya Mukherjee , Bharath K. Sriperumbudur

We connect shift-invariant characteristic kernels to infinitely divisible distributions on $\mathbb{R}^{d}$. Characteristic kernels play an important role in machine learning applications with their kernel means to distinguish any two…

Machine Learning · Statistics 2016-10-26 Yu Nishiyama , Kenji Fukumizu

Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of…

Machine Learning · Computer Science 2012-06-22 Samuel Gershman , Matt Hoffman , David Blei

Positive semi-definite kernels are used to induce pseudo-metrics, or ``distances'', between measures. We write these as an expected quadratic variation of, or expected inner product between, a random field and the difference of measures.…

Probability · Mathematics 2025-05-30 Ian Langmore

This works extends the Random Embedding Bayesian Optimization approach by integrating a warping of the high dimensional subspace within the covariance kernel. The proposed warping, that relies on elementary geometric considerations, allows…

Optimization and Control · Mathematics 2015-03-19 Mickaël Binois , David Ginsbourger , Olivier Roustant

This work explores new classes of nonstationary stochastic sequences associated with polynomial hypergroups. Their covariance structures are analyzed through positive definite kernels and corresponding Hilbert spaces. Novel consistent…

Functional Analysis · Mathematics 2024-11-27 Volker Hösel

Kernel-based modal statistical methods include mode estimation, regression, and clustering. Estimation accuracy of these methods depends on the kernel used as well as the bandwidth. We study effect of the selection of the kernel function to…

Machine Learning · Statistics 2023-04-21 Ryoya Yamasaki , Toshiyuki Tanaka

Estimation of the mean and covariance parameters for functional data is a critical task, with local linear smoothing being a popular choice. In recent years, many scientific domains are producing multivariate functional data for which $p$,…

Statistics Theory · Mathematics 2024-09-24 Alexander Petersen

The universality properties of kernels characterize the class of functions that can be approximated in the associated reproducing kernel Hilbert space and are of fundamental importance in the theoretical underpinning of kernel methods in…

Machine Learning · Computer Science 2025-06-25 Franziskus Steinert , Salem Said , Cyrus Mostajeran

We consider the problem of high-dimensional non-linear variable selection for supervised learning. Our approach is based on performing linear selection among exponentially many appropriately defined positive definite kernels that…

Machine Learning · Computer Science 2009-09-08 Francis Bach

We estimate the derivative of a probability density function defined on $[0,\infty)$. For this purpose, we choose the class of kernel estimators with asymmetric gamma kernel functions. The use of gamma kernels is fruitful due to the fact…

Statistics Theory · Mathematics 2015-02-10 L. A. Markovich

This paper introduces a novel approach to probabilistic deep learning, kernel density matrices, which provide a simpler yet effective mechanism for representing joint probability distributions of both continuous and discrete random…

Machine Learning · Computer Science 2024-05-01 Fabio A. González , Raúl Ramos-Pollán , Joseph A. Gallego-Mejia

We make use of the Bergman kernel function to study quadrature domains for square-integrable holomorphic functions of several variables. Emphasis is given to generalizing biholomorphic mapping properties of planar quadrature domains to the…

Complex Variables · Mathematics 2016-10-25 Alan R. Legg

We prove that under H\"ormander's type conditions on the coefficients of the unobservable component of a partially observable diffusion process the filtering density is infinitely differentiable and can be represented as the integral of an…

Probability · Mathematics 2013-09-24 N. V. Krylov

Improved performance in higher-order spectral density estimation is achieved using a general class of infinite-order kernels. These estimates are asymptotically less biased but with the same order of variance as compared to the classical…

Statistics Theory · Mathematics 2007-06-13 Arthur Berg , Dimitris Politis

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

Machine Learning · Statistics 2024-03-12 Paul Dommel , Alois Pichler

The statistical analysis of covariance matrices occurs in many important applications, e.g. in diffusion tensor imaging and longitudinal data analysis. We consider the situation where it is of interest to estimate an average covariance…

Methodology · Statistics 2010-10-20 Ian L. Dryden , Alexey Kolydenko , Diwei Zhou , Bai Li

Despite the increasing importance of stochastic processes on linear networks and graphs, current literature on multivariate (vector-valued) Gaussian random fields on metric graphs is elusive. This paper challenges several aspects related to…

Statistics Theory · Mathematics 2025-01-20 Tobia Filosi , Emilio Porcu , Xavier Emery , Claudio Agostinelli , Alfredo Alegrìa

The present work develops certain analytical tools required to construct and compute invariant kernels on the space of complex covariance matrices. The main result is the $\mathrm{L}^1$--Godement theorem, which states that any invariant…

Functional Analysis · Mathematics 2025-04-17 Salem Said , Franziskus Steinert , Cyrus Mostajeran