English
Related papers

Related papers: Minimax Estimation of Kernel Mean Embeddings

200 papers

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

Machine Learning · Statistics 2024-03-12 Paul Dommel , Alois Pichler

We study the problem of embedding minimal dynamical systems into the shift action on the Hilbert cube $\left([0,1]^N\right)^{\mathbb{Z}}$. This problem is intimately related to the theory of mean dimension, which counts the averaged number…

Dynamical Systems · Mathematics 2015-11-06 Yonatan Gutman , Masaki Tsukamoto

Regularized empirical risk minimization using kernels and their corresponding reproducing kernel Hilbert spaces (RKHSs) plays an important role in machine learning. However, the actually used kernel often depends on one or on a few…

Machine Learning · Statistics 2017-09-25 Andreas Christmann , Daohong Xiang , Ding-Xuan Zhou

Statistical depth is the act of gauging how representative a point is compared to a reference probability measure. The depth allows introducing rankings and orderings to data living in multivariate, or function spaces. Though widely applied…

Statistics Theory · Mathematics 2021-05-28 George Wynne , Stanislav Nagy

We propose a method to remedy finite sample coverage problems and improve upon the efficiency of commonly employed procedures for the construction of nonparametric confidence intervals in regression kink designs. The proposed interval is…

Econometrics · Economics 2021-11-23 Majed Dodin

In this paper, we present the general theory of embedding independence tests on Hilbert spaces that generalizes the concepts of distance covariance, distance multivariance and HSIC. This is done by defining new types of kernel on an $n$…

Functional Analysis · Mathematics 2024-11-14 Jean Carlo Guella

Kernel Estimation provides an unbinned and non-parametric estimate of the probability density function from which a set of data is drawn. In the first section, after a brief discussion on parametric and non-parametric methods, the theory of…

High Energy Physics - Experiment · Physics 2009-10-31 Kyle S. Cranmer

We investigate minimax estimators for quantum state tomography under general Bregman divergences. First, generalizing the work of Komaki et al. $\href{http://dx.doi.org/10.3390/e19110618}{\textrm{[Entropy 19, 618 (2017)]}}$ for relative…

Quantum Physics · Physics 2019-03-12 Maria Quadeer , Marco Tomamichel , Christopher Ferrie

We study minimax convergence rates of nonparametric density estimation in the Huber contamination model, in which a proportion of the data comes from an unknown outlier distribution. We provide the first results for this problem under a…

Statistics Theory · Mathematics 2021-09-08 Ananya Uppal , Shashank Singh , Barnabas Poczos

We apply kernel mean embedding methods to sample-based stochastic optimization and control. Specifically, we use the reduced-set expansion method as a way to discard sampled scenarios. The effect of such constraint removal is improved…

Optimization and Control · Mathematics 2020-04-24 Jia-Jie Zhu , Moritz Diehl , Bernhard Schölkopf

Under the reproducing kernel Hilbert spaces (RKHS), we consider the penalized least-squares of the partially functional linear models (PFLM), whose predictor contains both functional and traditional multivariate parts, and the multivariate…

Statistics Theory · Mathematics 2022-10-03 Huiming Zhang , Xiaoyu Lei

Kernel density estimation is a technique for approximating probability distributions. Here, it is applied to the calculation of mutual information on a metric space. This is motivated by the problem in neuroscience of calculating the mutual…

Information Theory · Computer Science 2014-05-20 R. Joshua Tobin , Conor J. Houghton

An important estimation problem that is closely related to large-scale multiple testing is that of estimating the null density and the proportion of nonnull effects. A few estimators have been introduced in the literature; however, several…

Statistics Theory · Mathematics 2010-01-12 T. Tony Cai , Jiashun Jin

We study theoretically, for the first time, the Dirichlet kernel estimator introduced by Aitchison and Lauder (1985) for the estimation of multivariate densities supported on the $d$-dimensional simplex. The simplex is an important case as…

Statistics Theory · Mathematics 2021-10-12 Frédéric Ouimet , Raimon Tolosana-Delgado

Conditional mean embeddings (CMEs) have proven themselves to be a powerful tool in many machine learning applications. They allow the efficient conditioning of probability distributions within the corresponding reproducing kernel Hilbert…

Statistics Theory · Mathematics 2020-07-16 Ilja Klebanov , Ingmar Schuster , T. J. Sullivan

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the…

Machine Learning · Computer Science 2018-05-25 Romain Brault , Florence d'Alché-Buc , Markus Heinonen

Semicontinuous outcomes occur frequently in health services, insurance, and cost studies. Standard nonparametric density estimators are not well suited to such data because they do not naturally accommodate the mixed structure, the…

Methodology · Statistics 2026-05-06 Guanjie Lyu , Frédéric Ouimet , Cindy Feng

Various convergence results for the Bergman kernel of the Hilbert space of all polynomials in \C^{n} of total degree at most k, equipped with a weighted norm, are obtained. The weight function is assumed to be C^{1,1}, i.e. it is…

Complex Variables · Mathematics 2008-04-21 Robert Berman

Let $(X_1,\ldots,X_n)$ be an i.i.d. sequence of random variables in $\mathbb{R}^d$, $d\geq 1$. We show that, for any function $\varphi :\mathbb{R}^d\rightarrow\mathbb{R}$, under regularity conditions, \[n^…

Statistics Theory · Mathematics 2016-06-07 Bernard Delyon , François Portier

In this work we study the self-integral of a function-measure kernel and its importance on stochastic integration. A continuous-function measure kernel $K$ over $D \subset \mathbb{R}^{d}$ is a function of two variables which acts as a…

Probability · Mathematics 2023-03-09 Ricardo Carrizo Vergara
‹ Prev 1 8 9 10 Next ›