English
Related papers

Related papers: Minimum Stein Discrepancy Estimators

200 papers

While robust divergence such as density power divergence and $\gamma$-divergence is helpful for robust statistical inference in the presence of outliers, the tuning parameter that controls the degree of robustness is chosen in a…

Methodology · Statistics 2021-09-15 Shonosuke Sugasawa , Shouto Yonekura

Flow matching (FM) has gained significant attention as a simulation-free generative model. Unlike diffusion models, which are based on stochastic differential equations, FM employs a simpler approach by solving an ordinary differential…

Machine Learning · Computer Science 2024-10-14 Kenji Fukumizu , Taiji Suzuki , Noboru Isobe , Kazusato Oko , Masanori Koyama

For an arbitrary initial configuration of discrete loads over vertices of a distributed graph, we consider the problem of minimizing the {\em discrepancy} between the maximum and minimum loads among all vertices. For this problem, this…

Data Structures and Algorithms · Computer Science 2018-05-15 Takeharu Shiraga

The Stein Variational Gradient Descent (SVGD) algorithm is a deterministic particle method for sampling. However, a mean-field analysis reveals that the gradient flow corresponding to the SVGD algorithm (i.e., the Stein Variational Gradient…

Machine Learning · Statistics 2024-05-10 Ye He , Krishnakumar Balasubramanian , Bharath K. Sriperumbudur , Jianfeng Lu

We propose a kernel-based nonparametric test of relative goodness of fit, where the goal is to compare two models, both of which may have unobserved latent variables, such that the marginal distribution of the observed variables is…

Machine Learning · Statistics 2023-05-10 Heishiro Kanagawa , Wittawat Jitkrittum , Lester Mackey , Kenji Fukumizu , Arthur Gretton

Comparing images to recommend items from an image-inventory is a subject of continued interest. Added with the scalability of deep-learning architectures the once `manual' job of hand-crafting features have been largely alleviated, and…

Information Retrieval · Computer Science 2017-11-15 Y Qian , E Vazquez , B Sengupta

This work focuses on a parameter-free joint piecewise smooth image denoising and contour detection. Formulated as the minimization of a discrete Mumford-Shah functional and estimated via a theoretically grounded alternating minimization…

Image and Video Processing · Electrical Eng. & Systems 2023-02-01 Charles-Gérard Lucas , Barbara Pascal , Nelly Pustelnik , Patrice Abry

The analysis of panel count data has garnered considerable attention in the literature, leading to the development of multiple statistical techniques. In inferential analysis, most works focus on leveraging estimating equation-based…

Methodology · Statistics 2025-10-08 Udita Goswami , Shuvashree Mondal

Existing example-based prediction explanation methods often bridge test and training data points through the model's parameters or latent representations. While these methods offer clues to the causes of model predictions, they often…

Machine Learning · Computer Science 2025-05-20 Mahtab Sarvmaili , Hassan Sajjad , Ga Wu

Distributionally balanced sampling designs are low-discrepancy probability designs obtained by minimizing the expected discrepancy between the auxiliary-variable distribution of a random sample and the target population distribution.…

Methodology · Statistics 2026-03-26 Anton Grafström , Wilmer Prentius

Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is…

Bias evaluation is fundamental to trustworthy AI, both in terms of checking data quality and in terms of checking the outputs of AI systems. In testing data quality, for example, one may study the distance of a given dataset, viewed as a…

Machine Learning · Computer Science 2025-06-12 Jiří Němeček , Mark Kozdoba , Illia Kryvoviaz , Tomáš Pevný , Jakub Mareček

We investigate robust parameter estimation and testing procedure for multivariate diffusion processes observed at high frequency via the minimum density power divergence estimator (MDPDE). Within a general diffusion framework and under…

Methodology · Statistics 2026-03-17 Sourojyoti Barick

Ensembles of deep neural networks have achieved great success recently, but they do not offer a proper Bayesian justification. Moreover, while they allow for averaging of predictions over several hypotheses, they do not provide any…

Machine Learning · Computer Science 2021-06-23 Francesco D'Angelo , Vincent Fortuin , Florian Wenzel

Measure transport underpins several recent algorithms for posterior approximation in the Bayesian context, wherein a transport map is sought to minimise the Kullback--Leibler divergence (KLD) from the posterior to the approximation. The KLD…

Computation · Statistics 2020-10-27 Matthew A. Fisher , Tui Nolan , Matthew M. Graham , Dennis Prangle , Chris J. Oates

Diffusion models are recent state-of-the-art methods for image generation and likelihood estimation. In this work, we generalize continuous-time diffusion models to arbitrary Riemannian manifolds and derive a variational framework for…

Machine Learning · Computer Science 2022-08-18 Chin-Wei Huang , Milad Aghajohari , Avishek Joey Bose , Prakash Panangaden , Aaron Courville

We present a local density estimator based on first order statistics. To estimate the density at a point, $x$, the original sample is divided into subsets and the average minimum sample distance to $x$ over all such subsets is used to…

Methodology · Statistics 2014-12-10 Vikram V. Garg , Luis Tenorio , Karen Willcox

In this paper, we investigate the diffusion least mean square (DLMS) algorithm over fading channel, where in addition to channel noise and path-loss the inter-node-interference (INI) among neighboring nodes of a host node is also taken into…

Signal Processing · Electrical Eng. & Systems 2023-03-21 Mohammadjavad Mirzazadeh Moallem , Mehdi Korki

Two-sample hypothesis testing-determining whether two sets of data are drawn from the same distribution-is a fundamental problem in statistics and machine learning with broad scientific applications. In the context of nonparametric testing,…

Machine Learning · Statistics 2026-04-21 Antoine Chatalic , Marco Letizia , Nicolas Schreuder , Lorenzo Rosasco

The distortion-perception (DP) tradeoff reveals a fundamental conflict between distortion metrics (e.g., MSE and PSNR) and perceptual quality. Recent research has increasingly concentrated on evaluating denoising algorithms within the DP…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuhan Wang , Suzhi Bi , Ying-Jun Angela Zhang , Xiaojun Yuan