English
Related papers

Related papers: Expected Signature Kernels for L\'evy Rough Paths

200 papers

We present a novel approach to learn a kernel-based regression function. It is based on the useof conical combinations of data-based parameterized kernels and on a new stochastic convex optimization procedure of which we establish…

Machine Learning · Computer Science 2012-01-13 Pierre Machart , Thomas Peel , Liva Ralaivola , Sandrine Anthoine , Hervé Glotin

Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the…

Machine Learning · Statistics 2024-10-24 Ambrus Tamás , Balázs Csanád Csáji

Gaussian process regression (GPR) model is a popular nonparametric regression model. In GPR, features of the regression function such as varying degrees of smoothness and periodicities are modeled through combining various covarinace…

Statistics Theory · Mathematics 2023-03-07 Jaehoan Kim , Jaeyong Lee

In this paper we study the problem of statistical inference for a continuous-time moving average L\'evy process of the form $$Z_{t} = \int_{\mathbb{R}}\mathcal{K}(t-s)\, dL_{s},\quad t\in\mathbb{R}$$ with a deterministic kernel (\K\) and a…

Statistics Theory · Mathematics 2016-08-19 Denis Belomestny , Vladimir Panov , Jeannette Woerner

This paper is an attempt to bridge the conceptual gaps between researchers working on the two widely used approaches based on positive definite kernels: Bayesian learning or inference using Gaussian processes on the one side, and…

Machine Learning · Statistics 2018-07-10 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K Sriperumbudur

We investigate densities of vaguely continuous convolution semigroups of probability measures on $\mathbb{R}^d$. First, we provide results that give upper estimates in a situation when the corresponding jump measure is allowed to be highly…

Probability · Mathematics 2020-07-30 Tomasz Grzywny , Karol Szczypkowski

Gaussian process regression (GPR) or kernel ridge regression is a widely used and powerful tool for nonlinear prediction. Therefore, active learning (AL) for GPR, which actively collects data labels to achieve an accurate prediction with…

We introduce two kernels that extend the mean map, which embeds probability measures in Hilbert spaces. The generative mean map kernel (GMMK) is a smooth similarity measure between probabilistic models. The latent mean map kernel (LMMK)…

Machine Learning · Computer Science 2010-05-04 Nishant A. Mehta , Alexander G. Gray

In the last decade, the concept of path signature has achieved significant success in data science applications. It offers a powerful set of features that effectively capture and describe the characteristics of paths or sequential data.…

Rings and Algebras · Mathematics 2025-01-13 Ilya Chevyrev , Joscha Diehl , Kurusch Ebrahimi-Fard , Nikolas Tapia

Conditional density estimation (density regression) estimates the distribution of a response variable y conditional on covariates x. Utilizing a partition model framework, a conditional density estimation method is proposed using logistic…

Methodology · Statistics 2017-03-22 Richard D. Payne , Nilabja Guha , Yu Ding , Bani K. Mallick

Gaussian random field is a ubiquitous model for spatial phenomena in diverse scientific disciplines. Its approximation is often crucial for computational feasibility in simulation, inference, and uncertainty quantification. The…

Computation · Statistics 2026-01-23 Joaquin Cavieres , Sebastian Krumscheid

We present a novel kernel over the space of probability measures based on the dual formulation of optimal regularized transport. We propose an Hilbertian embedding of the space of probabilities using their Sinkhorn potentials, which are…

Machine Learning · Statistics 2022-10-14 François Bachoc , Louis Béthune , Alberto Gonzalez-Sanz , Jean-Michel Loubes

For a class of one-dimensional determinantal point processes including those induced by orthogonal projections with integrable kernels satisfying a growth condition, it is proved that their conditional measures, with respect to the…

Probability · Mathematics 2016-05-05 Alexander I. Bufetov

We introduce a priori Sobolev-space error estimates for the solution of nonlinear, and possibly parametric, PDEs using Gaussian process and kernel based methods. The primary assumptions are: (1) a continuous embedding of the reproducing…

Numerical Analysis · Mathematics 2023-05-10 Pau Batlle , Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

We investigate how the training curve of isotropic kernel methods depends on the symmetry of the task to be learned, in several settings. (i) We consider a regression task, where the target function is a Gaussian random field that depends…

Machine Learning · Computer Science 2020-12-16 Jonas Paccolat , Stefano Spigler , Matthieu Wyart

Forecasting in probabilistic time series is a complex endeavor that extends beyond predicting future values to also quantifying the uncertainty inherent in these predictions. Gaussian process regression stands out as a Bayesian machine…

In this contribution, we propose a kernel-based method for the identification of linear systems from noisy and incomplete input-output datasets. We model the impulse response of the system as a Gaussian process whose covariance matrix is…

Systems and Control · Computer Science 2017-01-18 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

With the dramatic growth in the number of application domains that generate probabilistic, noisy and uncertain data, there has been an increasing interest in designing algorithms for geometric or combinatorial optimization problems over…

Data Structures and Algorithms · Computer Science 2016-05-24 Lingxiao Huang , Jian Li , Jeff M. Phillips , Haitao Wang

It is well-known that non-linear approximation has an advantage over linear schemes in the sense that it provides comparable approximation rates to those of the linear schemes, but to a larger class of approximands. This was established for…

Classical Analysis and ODEs · Mathematics 2010-04-28 Thomas Hangelbroek , Amos Ron

We derive the optimal signed variable in general case kernels for the classical statistic density estimation, which are some generalization of the famous Epanechnikov's ones.

Statistics Theory · Mathematics 2021-02-17 M. R. Formica , E. Ostrovsky , L. Sirota