English
Related papers

Related papers: The Minimax Lower Bound of Kernel Stein Discrepanc…

200 papers

We obtain minimax-optimal convergence rates in the supremum norm, including information-theoretic lower bounds, for estimating the covariance kernel of a stochastic process which is repeatedly observed at discrete, synchronous design…

Statistics Theory · Mathematics 2025-09-03 Max Berger , Hajo Holzmann

We noisily observe solutions of an ordinary differential equation $\dot u = f(u)$ at given times, where $u$ lives in a $d$-dimensional state space. The model function $f$ is unknown and belongs to a H\"older-type smoothness class with…

Statistics Theory · Mathematics 2024-07-23 Christof Schötz , Maximilian Siebel

We study the quantitative convergence of Wasserstein gradient flows of Kernel Mean Discrepancy (KMD) (also known as Maximum Mean Discrepancy (MMD)) functionals. Our setting covers in particular the training dynamics of shallow neural…

Analysis of PDEs · Mathematics 2026-03-03 Lénaïc Chizat , Maria Colombo , Roberto Colombo , Xavier Fernández-Real

Gaussian process regression generally does not scale to beyond a few thousands data points without applying some sort of kernel approximation method. Most approximations focus on the high eigenvalue part of the spectrum of the kernel…

Machine Learning · Statistics 2018-01-31 Yi Ding , Risi Kondor , Jonathan Eskreis-Winkler

Given additional distributional information in the form of moment restrictions, kernel density and distribution function estimators with implied generalised empirical likelihood probabilities as weights achieve a reduction in variance due…

Methodology · Statistics 2019-10-08 Vitaliy Oryshchenko , Richard J. Smith

Stein kernel has recently shown promising performance on classifying images represented by symmetric positive definite (SPD) matrices. It evaluates the similarity between two SPD matrices through their eigenvalues. In this paper, we argue…

Computer Vision and Pattern Recognition · Computer Science 2015-05-19 Jianjia Zhang , Lei Wang , Luping Zhou , Wanqing Li

Generalized Bayesian Inference (GBI) provides a flexible framework for updating prior distributions using various loss functions instead of the traditional likelihoods, thereby enhancing the model robustness to model misspecification.…

Machine Learning · Computer Science 2026-01-08 Elham Afzali , Saman Muthukumarana , Liqun Wang

Semi-implicit variational inference (SIVI) extends traditional variational families with semi-implicit distributions defined in a hierarchical manner. Due to the intractable densities of semi-implicit distributions, classical SIVI often…

Machine Learning · Statistics 2024-05-30 Ziheng Cheng , Longlin Yu , Tianyu Xie , Shiyue Zhang , Cheng Zhang

We establish sharp upper and lower estimates of the Dunkl kernel in the case of dihedral groups.

Classical Analysis and ODEs · Mathematics 2023-10-24 Jean-Philippe Anker , Bartosz Trojan

We provide improved upper and lower bounds for the Min-Sum-Radii (MSR) and Min-Sum-Diameters (MSD) clustering problems with a bounded number of clusters $k$. In particular, we propose an exact MSD algorithm with running-time $n^{O(k)}$. We…

Data Structures and Algorithms · Computer Science 2025-02-05 Sandip Banerjee , Yair Bartal , Lee-Ad Gottlieb , Alon Hovav

Support Vector Data Description (SVDD) provides a useful approach to construct a description of multivariate data for single-class classification and outlier detection with various practical applications. Gaussian kernel used in SVDD…

Machine Learning · Computer Science 2018-11-02 Sergiy Peredriy , Deovrat Kakde , Arin Chaudhuri

In this paper, we study the minimax estimation of the Bochner integral $$\mu_k(P):=\int_{\mathcal{X}} k(\cdot,x)\,dP(x),$$ also called as the kernel mean embedding, based on random samples drawn i.i.d.~from $P$, where…

Statistics Theory · Mathematics 2017-08-02 Ilya Tolstikhin , Bharath Sriperumbudur , Krikamol Muandet

We study the fundamental problem of clustering $n$ points into $K$ groups drawn from a mixture of isotropic Gaussians in $\mathbb{R}^d$. Specifically, we investigate the requisite minimal distance $\Delta$ between mean vectors to partially…

Statistics Theory · Mathematics 2026-02-27 Alexandra Carpentier , Nicolas Verzelen

We establish the first nonasymptotic error bounds for Kaplan-Meier-based nearest neighbor and kernel survival probability estimators where feature vectors reside in metric spaces. Our bounds imply rates of strong consistency for these…

Machine Learning · Statistics 2022-09-16 George H. Chen

We consider the problem of robust mean and location estimation w.r.t. any pseudo-norm of the form $x\in\mathbb{R}^d\to ||x||_S = \sup_{v\in S}<v,x>$ where $S$ is any symmetric subset of $\mathbb{R}^d$. We show that the deviation-optimal…

Statistics Theory · Mathematics 2021-02-02 Jules Depersin , Guillaume Lecué

Non-conservative uncertainty bounds are essential for making reliable predictions about latent functions from noisy data, and thus, a key enabler for safe learning-based control. In this domain, kernel methods such as Gaussian process…

Machine Learning · Computer Science 2026-05-26 Amon Lahr , Anna Scampicchio , Johannes Köhler , Melanie N. Zeilinger

In this paper, we study the statistical properties of kernel $k$-means and obtain a nearly optimal excess clustering risk bound, substantially improving the state-of-art bounds in the existing clustering risk analyses. We further analyze…

Machine Learning · Computer Science 2020-05-15 Yong Liu , Lizhong Ding , Weiping Wang

Building on recent studies of large-dimensional kernel regression, particularly those involving inner product kernels on the sphere $\mathbb{S}^{d}$, we investigate the Pinsker bound for inner product kernel regression in such settings.…

Statistics Theory · Mathematics 2025-06-05 Weihao Lu , Jialin Ding , Haobo Zhang , Qian Lin

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

Statistics Theory · Mathematics 2022-07-20 Wenjia Wang , Bing-Yi Jing

In this work we investigate the min-max-min robust optimization problem and the k-adaptability robust optimization problem for binary problems with uncertain costs. The idea of the first approach is to calculate a set of k feasible…

Optimization and Control · Mathematics 2023-08-16 Jannis Kurtz