English
Related papers

Related papers: Kernel entropy estimation for linear processes

200 papers

We propose a data-driven approach to quantify the uncertainty of models constructed by kernel methods. Our approach minimizes the needed distributional assumptions, hence, instead of working with, for example, Gaussian processes or…

Machine Learning · Computer Science 2019-08-06 Balázs Csanád Csáji , Krisztián Balázs Kis

Let $(X_i)_{i\geq 1}$ be a stationary mean-zero Gaussian process with covariances $\rho(k)=\PE(X_{1}X_{k+1})$ satisfying: $\rho(0)=1$ and $\rho(k)=k^{-D} L(k)$ where $D$ is in $(0,1)$ and $L$ is slowly varying at infinity. Consider the…

Statistics Theory · Mathematics 2010-12-08 Céline Lévy-Leduc , Hélène Boistard , Eric Moulines , Murad S. Taqqu , Valderio A. Reisen

We consider a recurrent Markov process which is an It\^o semi-martingale. The L\'evy kernel describes the law of its jumps. Based on observations X(0),X({\Delta}),...,X(n{\Delta}), we construct an estimator for the L\'evy kernel's density.…

Statistics Theory · Mathematics 2013-05-14 Florian A. J. Ueltzhöfer

This paper deals with the kernel-based approximation of a multivariate periodic function by interpolation at the points of an integration lattice -- a setting that, as pointed out by Zeng, Leung, Hickernell (MCQMC2004, 2006) and Zeng,…

Numerical Analysis · Mathematics 2022-01-25 Vesa Kaarnioja , Yoshihito Kazashi , Frances Y. Kuo , Fabio Nobile , Ian H. Sloan

Consider the nonparametric regression model Y=m(X)+E, where the function m is smooth but unknown, and E is independent of X. An estimator of the density of the error term E is proposed and its weak consistency is obtained. The contribution…

Statistics Theory · Mathematics 2011-12-25 Rawane Samb

The main purpose is to estimate the regression function of a real random variable with functional explanatory variable by using a recursive nonparametric kernel approach. The mean square error and the almost sure convergence of a family of…

Statistics Theory · Mathematics 2013-08-07 Aboubacar Amiri , Christophe Crambes , Baba Thiam

Regularized kernel methods such as, e.g., support vector machines and least-squares support vector regression constitute an important class of standard learning algorithms in machine learning. Theoretical investigations concerning…

Machine Learning · Statistics 2012-03-21 Robert Hable

We prove new explicit upper bounds on the leverage scores of Fourier sparse functions under both the Gaussian and Laplace measures. In particular, we study $s$-sparse functions of the form $f(x) = \sum_{j=1}^s a_j e^{i \lambda_j x}$ for…

Data Structures and Algorithms · Computer Science 2021-07-09 Tamás Erdélyi , Cameron Musco , Christopher Musco

Tensor algebras give rise to one of the most powerful measures of similarity for sequences of arbitrary length called the signature kernel accompanied with attractive theoretical guarantees from stochastic analysis. Previous algorithms to…

Machine Learning · Statistics 2024-11-25 Csaba Toth , Harald Oberhauser , Zoltan Szabo

This paper is devoted to the estimation of the common marginal density function of weakly dependent processes. The accuracy of estimation is measured using pointwise risks. We propose a datadriven procedure using kernel rules. The bandwidth…

Statistics Theory · Mathematics 2016-04-04 Karine Bertin , Nicolas Klutchnikoff

This paper presents a sequential randomized lowrank matrix factorization approach for incrementally predicting values of an unknown function at test points using the Gaussian Processes framework. It is well-known that in the Gaussian…

Machine Learning · Computer Science 2017-11-21 Shaunak D. Bopardikar , George S. Eskander Ekladious

A diagrammatic kinetic theory of density fluctuations in simple dense liquids at long times, described in the preceding paper, is applied to a high density Lennard-Jones liquid to calculate various equilibrium time correlation functions.…

Statistical Mechanics · Physics 2015-06-18 Kevin R. Pilkiewicz , Hans C. Andersen

We study the density estimation problem with observations generated by certain dynamical systems that admit a unique underlying invariant Lebesgue density. Observations drawn from dynamical systems are not independent and moreover, usual…

Machine Learning · Statistics 2016-07-14 Hanyuan Hang , Ingo Steinwart , Yunlong Feng , Johan A. K. Suykens

We present a new method for estimating the frontier of a multidimensional sample. The estimator is based on a kernel regression on the power-transformed data. We assume that the exponent of the transformation goes to infinity while the…

Methodology · Statistics 2011-03-31 Stéphane Girard , Pierre Jacob

We obtain strong consistency and asymptotic normality of a least squares estimator of the drift coefficient for complex-valued Ornstein-Uhlenbeck processes disturbed by fractional noise, extending the result of Y. Hu and D. Nualart,…

Probability · Mathematics 2017-01-27 Yong Chen , Yaozhong Hu , Zhi Wang

In modern data analysis, nonparametric measures of discrepancies between random variables are particularly important. The subject is well-studied in the frequentist literature, while the development in the Bayesian setting is limited where…

Methodology · Statistics 2022-01-25 Qinyi Zhang , Veit Wild , Sarah Filippi , Seth Flaxman , Dino Sejdinovic

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

We consider the problem of inferring the interaction kernel of stochastic interacting particle systems from observations of a single particle. We adopt a semi-parametric approach and represent the interaction kernel in terms of a…

Statistics Theory · Mathematics 2025-10-31 Grigorios A. Pavliotis , Andrea Zanoni

We introduce the loss kernel, an interpretability method for measuring similarity between data points according to a trained neural network. The kernel is the covariance matrix of per-sample losses computed under a distribution of…

Machine Learning · Computer Science 2025-10-01 Maxwell Adam , Zach Furman , Jesse Hoogland

The estimation of entropy rates for stationary discrete-valued stochastic processes is a well studied problem in information theory. However, estimating the entropy rate for stationary continuous-valued stochastic processes has not received…

Information Theory · Computer Science 2021-05-26 Andrew Feutrill , Matthew Roughan