English
Related papers

Related papers: Score Matching for Truncated Density Estimation on…

200 papers

In this paper, we develop a general theory of truncated inverse binomial sampling. In this theory, the fixed-size sampling and inverse binomial sampling are accommodated as special cases. In particular, the classical Chernoff-Hoeffding…

Statistics Theory · Mathematics 2019-08-20 Xinjia Chen

We provide an efficient algorithm for the classical problem, going back to Galton, Pearson, and Fisher, of estimating, with arbitrary accuracy the parameters of a multivariate normal distribution from truncated samples. Truncated samples…

Statistics Theory · Mathematics 2020-10-26 Constantinos Daskalakis , Themis Gouleakis , Christos Tzamos , Manolis Zampetakis

Density estimation is a crucial component of many machine learning methods, and manifold learning in particular, where geometry is to be constructed from data alone. A significant practical limitation of the current density estimation…

Classical Analysis and ODEs · Mathematics 2016-01-06 Tyrus Berry , Timothy Sauer

Score matching estimators have garnered significant attention in recent years because they eliminate the need to compute normalizing constants, thereby mitigating the computational challenges associated with maximum likelihood estimation…

Machine Learning · Computer Science 2025-12-05 Haoqun Cao , Yixuan Zhang , Feng Zhou

Probability distributions in Stiefel manifold such as the von-Mises Fisher and Bingham distributions find diverse applications in signal processing and other applied sciences. Use of these statistical models in practice is complicated by…

Statistics Theory · Mathematics 2016-02-15 Lu Wei , Jukka Corander

Conditional density estimation is a general framework for solving various problems in machine learning. Among existing methods, non-parametric and/or kernel-based methods are often difficult to use on large datasets, while methods based on…

Machine Learning · Statistics 2018-06-06 Hiroaki Sasaki , Aapo Hyvärinen

Astronomical data often suffer from noise and incompleteness. We extend the common mixtures-of-Gaussians density estimation approach to account for situations with a known sample incompleteness by simultaneous imputation from the current…

Instrumentation and Methods for Astrophysics · Physics 2020-09-17 Peter Melchior , Andy D. Goulding

Many probabilistic models that have an intractable normalizing constant may be extended to contain covariates. Since the evaluation of the exact likelihood is difficult or even impossible for these models, score matching was proposed to…

Statistics Theory · Mathematics 2022-03-21 Jiazhen Xu , Janice L. Scealy , Andrew T. A. Wood , Tao Zou

We use Stein characterisations to derive new moment-type estimators for the parameters of several truncated multivariate distributions in the i.i.d. case; we also derive the asymptotic properties of these estimators. Our examples include…

Statistics Theory · Mathematics 2024-06-18 Adrian Fischer , Robert E. Gaunt , Yvik Swan

Kernel density estimation is a popular method for estimating unseen probability distributions. However, the convergence of these classical estimators to the true density slows down in high dimensions. Moreover, they do not define meaningful…

Statistics Theory · Mathematics 2025-05-30 Jack Kendrick

The finite sensitivity of instruments or detection methods means that data sets in many areas of astronomy, for example cosmological or exoplanet surveys, are necessarily systematically incomplete. Such data sets, where the population being…

Instrumentation and Methods for Astrophysics · Physics 2020-10-14 Adam B. Mantz

We propose a new distribution, called the soft tMVN distribution, which provides a smooth approximation to the truncated multivariate normal (tMVN) distribution with linear constraints. An efficient blocked Gibbs sampler is developed to…

Computation · Statistics 2019-09-04 Allyson Souris , Anirban Bhattacharya , Debdeep Pati

We develop a systematic, omnibus approach to goodness-of-fit testing for parametric distributional models when the variable of interest is only partially observed due to censoring and/or truncation. In many such designs, tests based on the…

Methodology · Statistics 2026-02-10 Juan Carlos Escanciano , Jacobo de Uña-Álvarez

Spectral compressed sensing involves reconstructing a spectral-sparse signal from a subset of uniformly spaced samples, with applications in radar imaging and wireless channel estimation. By fully exploiting the signal structures, this…

Optimization and Control · Mathematics 2025-11-25 Wenlong Wang , Wen Huang , Zai Yang

We explore the geometric implications of introducing a spectral cut-off on Riemannian manifolds. This is naturally phrased in the framework of non-commutative geometry, where we work with spectral triples that are \emph{truncated} by…

Mathematical Physics · Physics 2020-06-16 Lisa Glaser , Abel B. Stern

A novel framework for density estimation under expectation constraints is proposed. The framework minimizes the Wasserstein distance between the estimated density and a prior, subject to the constraints that the expected value of a set of…

Machine Learning · Statistics 2026-02-24 Yinan Hu , Esteban G. Tabak

Diffusion models achieve state-of-the-art performance in various generation tasks. However, their theoretical foundations fall far behind. This paper studies score approximation, estimation, and distribution recovery of diffusion models,…

Machine Learning · Computer Science 2023-02-15 Minshuo Chen , Kaixuan Huang , Tuo Zhao , Mengdi Wang

Consensus algorithms are popular distributed algorithms for computing aggregate quantities, such as averages, in ad-hoc wireless networks. However, existing algorithms mostly address the case where the measurements lie in a Euclidean space.…

Dynamical Systems · Mathematics 2012-02-02 Roberto Tron , Bijan Afsari , René Vidal

Linear Mixed Effects (LME) models have been widely applied in clustered data analysis in many areas including marketing research, clinical trials, and biomedical studies. Inference can be conducted using maximum likelihood approach if…

Methodology · Statistics 2022-11-10 Hao Chen , Lanshan Han , Alvin Lim

We consider the problem of density estimation on Riemannian manifolds. Density estimation on manifolds has many applications in fluid-mechanics, optics and plasma physics and it appears often when dealing with angular variables (such as…

Machine Learning · Statistics 2016-11-10 Mevlana C. Gemici , Danilo Rezende , Shakir Mohamed