English
Related papers

Related papers: Score Matching for Truncated Density Estimation on…

200 papers

Truncated densities are probability density functions defined on truncated domains. They share the same parametric form with their non-truncated counterparts up to a normalizing constant. Since the computation of their normalizing constants…

Machine Learning · Statistics 2022-04-21 Song Liu , Takafumi Kanamori , Daniel J. Williams

One of the major problems for maximum likelihood estimation in the well-established directional models is that the normalising constants can be difficult to evaluate. A new general method of "score matching estimation" is presented here on…

Statistics Theory · Mathematics 2016-04-29 Kanti V Mardia , John T Kent , Arnab K Laha

Compositional data and multivariate count data with known totals are challenging to analyse due to the non-negativity and sum-to-one constraints on the sample space. It is often the case that many of the compositional components are highly…

Methodology · Statistics 2020-12-24 Janice L. Scealy , Andrew T. A. Wood

Score matching is a popular method for estimating unnormalized statistical models. However, it has been so far limited to simple, shallow models or low-dimensional data, due to the difficulty of computing the Hessian of log-density…

Machine Learning · Computer Science 2019-06-28 Yang Song , Sahaj Garg , Jiaxin Shi , Stefano Ermon

We examine theoretical properties of the denoising score matching estimate. We model the density of observations with a nonparametric Gaussian mixture. We significantly relax the standard manifold assumption allowing the samples step away…

Machine Learning · Computer Science 2026-01-01 Konstantin Yakovlev , Nikita Puchkin

Estimating means on Riemannian manifolds is generally computationally expensive because the Riemannian distance function is not known in closed-form for most manifolds. To overcome this, we show that Riemannian diffusion means can be…

Other Statistics · Statistics 2025-02-19 Frederik Möbius Rygaard , Steen Markvorsen , Søren Hauberg , Stefan Sommer

Estimating truncated density models is difficult, as these models have intractable normalising constants and hard to satisfy boundary conditions. Score matching can be adapted to solve the truncated density estimation problem, but requires…

Machine Learning · Statistics 2024-04-15 Daniel J. Williams , Song Liu

The observational limitations of astronomical surveys lead to significant statistical inference challenges. One such challenge is the estimation of luminosity functions given redshift $z$ and absolute magnitude $M$ measurements from an…

Astrophysics · Physics 2011-02-11 Chad M. Schafer

We show a statistical version of Taylor's theorem and apply this result to non-parametric density estimation from truncated samples, which is a classical challenge in Statistics \cite{woodroofe1985estimating, stute1993almost}. The…

Statistics Theory · Mathematics 2021-07-01 Constantinos Daskalakis , Vasilis Kontonis , Christos Tzamos , Manolis Zampetakis

In this paper, we have established a new framework of truncated inverse sampling for estimating mean values of non-negative random variables such as binomial, Poisson, hyper-geometrical, and bounded variables. We have derived explicit…

Statistics Theory · Mathematics 2013-11-05 Xinjia Chen

We study the problem of estimating the score function using both implicit score matching and denoising score matching. Assuming that the data distribution exhibiting a low-dimensional structure, we prove that implicit score matching is able…

Statistics Theory · Mathematics 2026-01-01 Konstantin Yakovlev , Anna Markovich , Nikita Puchkin

The problem of searching for a model-based scene interpretation is analyzed within a probabilistic framework. Object models are formulated as generative models for range data of the scene. A new statistical criterion, the truncated object…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Ulrich Hillenbrand , Gerd Hirzinger

Score matching provides an effective approach to learning flexible unnormalized models, but its scalability is limited by the need to evaluate a second-order derivative. In this paper, we present a scalable approximation to a general family…

Machine Learning · Statistics 2020-02-19 Ziyu Wang , Shuyu Cheng , Yueru Li , Jun Zhu , Bo Zhang

We propose a new approach for estimating the parameters of a probability distribution. It consists on combining two new methods of estimation. The first is based on the definition of a new distance measuring the difference between…

Methodology · Statistics 2008-12-30 Ahmed Guellil , Tewfik Kernane

Score matching is an estimation procedure that has been developed for statistical models whose probability density function is known up to proportionality but whose normalizing constant is intractable, so that maximum likelihood is…

Methodology · Statistics 2024-04-23 Jiazhen Xu , Janice L. Scealy , Andrew T. A. Wood , Tao Zou

We study the theoretical behavior of denoising score matching--the learning task associated to diffusion models--when the data distribution is supported on a low-dimensional manifold and the score is parameterized using a random feature…

Machine Learning · Computer Science 2026-04-14 Anand Jerry George , Nicolas Macris

Simulation from the truncated multivariate normal distribution in high dimensions is a recurrent problem in statistical computing, and is typically only feasible using approximate MCMC sampling. In this article we propose a minimax tilting…

Computation · Statistics 2016-03-15 Z. I. Botev

A procedure based on a Mixture Density Model for correcting experimental data for distortions due to finite resolution and limited detector acceptance is presented. Addressing the case that the solution is known to be non-negative, in the…

Data Analysis, Statistics and Probability · Physics 2015-03-09 Nikolai Gagunashvili

Score matching is a recently developed parameter learning method that is particularly effective to complicated high dimensional density models with intractable partition functions. In this paper, we study two issues that have not been…

Machine Learning · Computer Science 2012-05-14 Siwei Lyu

A new test of normality based on a standardised empirical process is introduced in this article. The first step is to introduce a Cram\'er-von Mises type statistic with weights equal to the inverse of the standard normal density function…

Statistics Theory · Mathematics 2019-03-22 Juan Kalemkerian
‹ Prev 1 2 3 10 Next ›