English
Related papers

Related papers: Score matching estimators for directional distribu…

200 papers

A common challenge in estimating parameters of probability density functions is the intractability of the normalizing constant. While in such cases maximum likelihood estimation may be implemented using numerical integration, the approach…

Machine Learning · Statistics 2019-05-21 Shiqing Yu , Mathias Drton , Ali Shojaie

Score matching is a vital tool for learning the distribution of data with applications across many areas including diffusion processes, energy based modelling, and graphical model estimation. Despite all these applications, little work…

Machine Learning · Statistics 2025-06-03 Josh Givens , Song Liu , Henry W J Reeve

Proposed in Hyv\"arinen (2005), score matching is a parameter estimation procedure that does not require computation of distributional normalizing constants. In this work we utilize the geometric median of means to develop a robust score…

Machine Learning · Statistics 2025-06-23 Richard Schwank , Andrew McCormack , Mathias Drton

Score matching is a popular method for estimating unnormalized statistical models. However, it has been so far limited to simple, shallow models or low-dimensional data, due to the difficulty of computing the Hessian of log-density…

Machine Learning · Computer Science 2019-06-28 Yang Song , Sahaj Garg , Jiaxin Shi , Stefano Ermon

We discuss generalized linear models for directional data where the conditional distribution of the response is a von Mises-Fisher distribution in arbitrary dimension or a Bingham distribution on the unit circle. To do this properly, we…

Methodology · Statistics 2025-07-15 Lutz Duembgen , Caroline Haslebacher

Normalizing flows have shown great promise for modelling flexible probability distributions in a computationally tractable way. However, whilst data is often naturally described on Riemannian manifolds such as spheres, torii, and hyperbolic…

Machine Learning · Statistics 2020-12-10 Emile Mathieu , Maximilian Nickel

Autoregressive models use chain rule to define a joint probability distribution as a product of conditionals. These conditionals need to be normalized, imposing constraints on the functional families that can be used. To increase…

Machine Learning · Computer Science 2020-10-27 Chenlin Meng , Lantao Yu , Yang Song , Jiaming Song , Stefano Ermon

As the most fundamental problem in statistics, robust location estimation has many prominent solutions, such as the trimmed mean, Winsorized mean, Hodges Lehmann estimator, Huber M estimator, and median of means. Recent studies suggest that…

Statistics Theory · Mathematics 2024-09-12 Li Tuobang

This paper proposes an efficient numerical integration formula to compute the normalizing constant of Fisher--Bingham distributions. This formula uses a numerical integration formula with the continuous Euler transform to a Fourier-type…

Computation · Statistics 2020-05-01 Yici Chen , Kenichiro Tanaka

We characterise the unbiasedness of the score function, viewed as an inference function for a class of finite mixture models. The models studied represent the situation where there is a stratification of the observations in a finite number…

Statistics Theory · Mathematics 2023-05-16 Rodrigo Labouriau

We consider the problem of estimating the common mean of independently sampled data, where samples are drawn in a possibly non-identical manner from symmetric, unimodal distributions with a common mean. This generalizes the setting of…

Statistics Theory · Mathematics 2019-07-09 Ankit Pensia , Varun Jog , Po-Ling Loh

We introduce a new paradigm, $\textit{measure synchronization}$, for synchronizing graphs with measure-valued edges. We formulate this problem as maximization of the cycle-consistency in the space of probability measures over relative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Tolga Birdal , Michael Arbel , Umut Şimşekli , Leonidas Guibas

A new acceptance-rejection method is proposed and investigated for the Bingham distribution on the sphere using the angular central Gaussian distribution as an envelope. It is shown to have high efficiency and to be straightfoward to use.…

Statistics Theory · Mathematics 2013-10-31 John T. Kent , Asaad M. Ganeiber , Kanti V. Mardia

We consider the problem of density estimation on Riemannian manifolds. Density estimation on manifolds has many applications in fluid-mechanics, optics and plasma physics and it appears often when dealing with angular variables (such as…

Machine Learning · Statistics 2016-11-10 Mevlana C. Gemici , Danilo Rezende , Shakir Mohamed

Score-based diffusion models provide a powerful way to model images using the gradient of the data distribution. Leveraging the learned score function as a prior, here we introduce a way to sample data from a conditional distribution given…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Hyungjin Chung , Jong Chul Ye

The von Mises-Fisher (vMF) distribution has long been a mainstay for inference with data on the unit hypersphere in directional statistics. The performance of statistical inference based on the vMF distribution, however, may suffer when…

Methodology · Statistics 2025-04-23 Kisung You , Dennis Shung

Stochastic optimisation in Riemannian manifolds, especially the Riemannian stochastic gradient method, has attracted much recent attention. The present work applies stochastic optimisation to the task of recursive estimation of a…

Statistics Theory · Mathematics 2020-01-08 Jialun Zhou , Salem Said

We use Stein characterizations to obtain new moment-type estimators for the parameters of three classical spherical distributions (namely the Fisher-Bingham, the von Mises-Fisher, and the Watson distributions) in the i.i.d. case. This leads…

Statistics Theory · Mathematics 2024-07-05 Adrian Fischer , Robert E. Gaunt , Yvik Swan

Likelihood-based estimation methods involve the normalising constant of the model distributions, expressed as a function of the parameter. However in many problems this function is not easily available, and then less efficient but more…

Methodology · Statistics 2019-04-30 Silvia Columbu , Valentina Mameli , Monica Musio , A. Philip Dawid

A stochastic algorithm is proposed, finding the set of generalized means associated to a probability measure on a compact Riemannian manifold M and a continuous cost function on the product of M by itself. Generalized means include p-means…

Probability · Mathematics 2013-05-28 Marc Arnaudon , Laurent Miclo