English
Related papers

Related papers: Controlling Moments with Kernel Stein Discrepancie…

200 papers

We present a sequential version of the kernelized Stein discrepancy goodness-of-fit test, which allows for conducting goodness-of-fit tests for unnormalized densities that are continuously monitored and adaptively stopped. That is, the…

Machine Learning · Statistics 2025-04-18 Diego Martinez-Taboada , Aaditya Ramdas

Knowing the error distribution is important in many multivariate time series applications. To alleviate the risk of error distribution mis-specification, testing methodologies are needed to detect whether the chosen error distribution is…

Econometrics · Economics 2020-08-04 Donghang Luo , Ke Zhu , Huan Gong , Dong Li

Distances between probability distributions are a key component of many statistical machine learning tasks, from two-sample testing to generative modeling, among others. We introduce a novel distance between measures that compares them…

Machine Learning · Statistics 2025-07-09 Arturo Castellanos , Anna Korba , Pavlo Mozharovskyi , Hicham Janati

Uncertainty evaluation is critical in scientific and engineering inverse problems. However, existing benchmarks on Diffusion Inverse Solvers (DIS) primarily focus on reconstruction accuracy but overlook uncertainty and distributional…

Machine Learning · Computer Science 2026-05-12 Xiaoyu Qiu , Taewon Yang , Zhanhao Liu , Guanyang Wang , Liyue Shen

We develop a multidimensional Stein methodology for non-degenerate self-decomposable random vectors in $\mathbb{R}^d$ having finite first moment. Building on previous univariate findings, we solve an integro-partial differential Stein…

Probability · Mathematics 2019-04-08 Benjamin Arras , Christian Houdré

Studying the stability of partially observed Markov decision processes (POMDPs) with respect to perturbations in either transition or observation kernels is a significant problem. While asymptotic robustness/stability results as approximate…

Optimization and Control · Mathematics 2025-09-15 Yunus Emre Demirci , Ali Devran Kara , Serdar Yüksel

Diffusion models show promise for image restoration, but existing methods often struggle with inconsistent fidelity and undesirable artifacts. To address this, we introduce Kernel Density Steering (KDS), a novel inference-time framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuyang Hu , Kangfu Mei , Mojtaba Sahraee-Ardakan , Ulugbek S. Kamilov , Peyman Milanfar , Mauricio Delbracio

Survival Analysis and Reliability Theory are concerned with the analysis of time-to-event data, in which observations correspond to waiting times until an event of interest such as death from a particular disease or failure of a component…

Machine Learning · Statistics 2020-08-28 Tamara Fernandez , Nicolas Rivera , Wenkai Xu , Arthur Gretton

Existing example-based prediction explanation methods often bridge test and training data points through the model's parameters or latent representations. While these methods offer clues to the causes of model predictions, they often…

Machine Learning · Computer Science 2025-05-20 Mahtab Sarvmaili , Hassan Sajjad , Ga Wu

Stein variational gradient descent (SVGD) and its variants have shown promising successes in approximate inference for complex distributions. In practice, we notice that the kernel used in SVGD-based methods has a decisive effect on the…

Machine Learning · Computer Science 2022-11-29 Qingzhong Ai , Shiyu Liu , Lirong He , Zenglin Xu

This paper provides a new theoretical lens for understanding the finite-sample performance of kernel-based specification tests, such as the Kernel Conditional Moment (KCM) test. Rather than introducing a fundamentally new test, we isolate…

Econometrics · Economics 2025-10-15 Cui Rui , Li Yuhao , Song Xiaojun

We describe a construction of Stein kernels using moment maps, which are solutions to a variant of the Monge-Amp\`ere equation. As a consequence, we show how regularity bounds on these maps control the rate of convergence in the classical…

Probability · Mathematics 2023-06-08 Max Fathi

Estimating truncated density models is difficult, as these models have intractable normalising constants and hard to satisfy boundary conditions. Score matching can be adapted to solve the truncated density estimation problem, but requires…

Machine Learning · Statistics 2024-04-15 Daniel J. Williams , Song Liu

With the aim of generalizing histogram statistics to higher dimensional cases, density estimation via discrepancy based sequential partition (DSP) has been proposed to learn an adaptive piecewise constant approximation defined on a binary…

Machine Learning · Statistics 2025-12-23 Zhengyang Lei , Lirong Qu , Sihong Shao , Yunfeng Xiong

Kernel techniques are among the most popular and flexible approaches in data science allowing to represent probability measures without loss of information under mild conditions. The resulting mapping called mean embedding gives rise to a…

Machine Learning · Statistics 2024-11-27 Linda Chamakh , Zoltan Szabo

The paper introduces a new kernel-based Maximum Mean Discrepancy (MMD) statistic for measuring the distance between two distributions given finitely-many multivariate samples. When the distributions are locally low-dimensional, the proposed…

Machine Learning · Statistics 2018-09-03 Xiuyuan Cheng , Alexander Cloninger , Ronald R. Coifman

Persistence diagrams (PDs) play a key role in topological data analysis (TDA), in which they are routinely used to describe topological properties of complicated shapes. PDs enjoy strong stability properties and have proven their utility in…

Computational Geometry · Computer Science 2017-11-10 Mathieu Carrière , Marco Cuturi , Steve Oudot

Comparing conditional distributions is a fundamental challenge in statistics and machine learning, with applications across a wide range of domains. While proposed methods for measuring discrepancies using kernel embeddings of distributions…

Machine Learning · Statistics 2026-05-05 Peter Moskvichev , Siu Lun Chau , Dino Sejdinovic

An important feature of kernel mean embeddings (KME) is that the rate of convergence of the empirical KME to the true distribution KME can be bounded independently of the dimension of the space, properties of the distribution and smoothness…

Statistics Theory · Mathematics 2025-04-17 Geoffrey Wolfer , Pierre Alquier

Suppose $k$ centers are fit to $m$ points by heuristically minimizing the $k$-means cost; what is the corresponding fit over the source distribution? This question is resolved here for distributions with $p\geq 4$ bounded moments; in…

Machine Learning · Computer Science 2013-11-11 Matus Telgarsky , Sanjoy Dasgupta