English
Related papers

Related papers: Controlling Moments with Kernel Stein Discrepancie…

200 papers

In this paper, we study the statistical and geometrical properties of the Kullback-Leibler divergence with kernel covariance operators (KKL) introduced by Bach [2022]. Unlike the classical Kullback-Leibler (KL) divergence that involves…

Machine Learning · Statistics 2025-03-12 Clémentine Chazal , Anna Korba , Francis Bach

Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals with non-smooth Riesz kernels show a rich structure as singular measures can become absolutely continuous ones and conversely. In this paper we contribute to the…

Machine Learning · Computer Science 2024-03-22 Fabian Altekrüger , Johannes Hertrich , Gabriele Steidl

Detecting the emergence of abrupt property changes in time series is a challenging problem. Kernel two-sample test has been studied for this task which makes fewer assumptions on the distributions than traditional parametric approaches.…

Machine Learning · Statistics 2019-01-21 Wei-Cheng Chang , Chun-Liang Li , Yiming Yang , Barnabás Póczos

The paper studies the robustness properties of discrete-time stochastic optimal control under Wasserstein model approximation for both discounted-cost and average-cost criteria. Specifically, we study the performance loss when applying an…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Yichen Zhou , Yanglei Song , Serdar Yüksel

This work studies the convergence and finite sample approximations of entropic regularized Wasserstein distances in the Hilbert space setting. Our first main result is that for Gaussian measures on an infinite-dimensional Hilbert space,…

Machine Learning · Statistics 2021-02-16 Minh Ha Quang

A quantum neural network (QNN) is a parameterized mapping efficiently implementable on near-term Noisy Intermediate-Scale Quantum (NISQ) computers. It can be used for supervised learning when combined with classical gradient-based…

Quantum Physics · Physics 2023-03-28 Xuchen You , Shouvanik Chakrabarti , Boyang Chen , Xiaodi Wu

We study the Stein Variational Gradient Descent (SVGD) algorithm, which optimises a set of particles to approximate a target probability distribution $\pi\propto e^{-V}$ on $\mathbb{R}^d$. In the population limit, SVGD performs gradient…

Machine Learning · Statistics 2021-01-05 Anna Korba , Adil Salim , Michael Arbel , Giulia Luise , Arthur Gretton

We study the worst case error of kernel density estimates via subset approximation. A kernel density estimate of a distribution is the convolution of that distribution with a fixed kernel (e.g. Gaussian kernel). Given a subset (i.e. a point…

Computational Geometry · Computer Science 2012-04-05 Jeff M. Phillips

Distributionally robust control (DRC) aims to effectively manage distributional ambiguity in stochastic systems. While most existing works address inaccurate distributional information in fully observable settings, we consider a partially…

Systems and Control · Electrical Eng. & Systems 2022-12-23 Astghik Hakobyan , Insoon Yang

This paper is motivated by the problem of quantitatively bounding the convergence of adaptive control methods for stochastic systems to a stationary distribution. Such bounds are useful for analyzing statistics of trajectories and…

Optimization and Control · Mathematics 2021-10-19 Tyler Lekang , Andrew Lamperski

Uncertainty quantification is essential for deploying machine learning models in high-stakes domains such as scientific discovery and healthcare. Conformal Prediction (CP) provides finite-sample coverage guarantees under exchangeability, an…

Machine Learning · Computer Science 2026-03-30 Siddhartha Laghuvarapu , Rohan Deb , Jimeng Sun

Stochastic gradient descent (SGD) is the main algorithm behind a large body of work in machine learning. In many cases, constraints are enforced via projections, leading to projected stochastic gradient algorithms. In recent years, a large…

Optimization and Control · Mathematics 2025-10-06 Yuping Zheng , Andrew Lamperski

Existing two-sample testing techniques, particularly those based on choosing a kernel for the Maximum Mean Discrepancy (MMD), often assume equal sample sizes from the two distributions. Applying these methods in practice can require…

Machine Learning · Statistics 2025-12-17 Aaron Wei , Milad Jalali , Danica J. Sutherland

This paper carries out a large dimensional analysis of a variation of kernel ridge regression that we call \emph{centered kernel ridge regression} (CKRR), also known in the literature as kernel ridge regression with offset. This modified…

Machine Learning · Statistics 2020-04-22 Khalil Elkhalil , Abla Kammoun , Xiangliang Zhang , Mohamed-Slim Alouini , Tareq Al-Naffouri

We derive the asymptotic distribution of the supremum distance of the deconvolution kernel density estimator to its expectation for certain supersmooth deconvolution problems. It turns out that the asymptotics are essentially different from…

Statistics Theory · Mathematics 2018-04-17 Bert van Es , Shota Gugushvili

The aim of this article is to establish asymptotic distributions and consistency of subsampling for spectral density and for magnitude of coherence for non-stationary, almost periodically correlated time series. We show the asymptotic…

Statistics Theory · Mathematics 2011-02-11 Łukasz Lenart

State estimation in the presence of uncertain or data-driven noise distributions remains a critical challenge in control and robotics. Although the Kalman filter is the most popular choice, its performance degrades significantly when…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Minhyuk Jang , Astghik Hakobyan , Insoon Yang

Kernel density estimation is a technique for approximating probability distributions. Here, it is applied to the calculation of mutual information on a metric space. This is motivated by the problem in neuroscience of calculating the mutual…

Information Theory · Computer Science 2014-05-20 R. Joshua Tobin , Conor J. Houghton

Electron Wigner solids (WSs)1-12 provide an ideal system for understanding the competing effects of electron-electron and electron-disorder interactions, a central unsolved problem in condensed matter physics. Progress in this topic has…

The distribution closeness testing (DCT) assesses whether the distance between a distribution pair is at least $\epsilon$-far. Existing DCT methods mainly measure discrepancies between a distribution pair defined on discrete one-dimensional…

Machine Learning · Computer Science 2025-10-10 Zhijian Zhou , Liuhua Peng , Xunye Tian , Feng Liu