English
Related papers

Related papers: Cluster Sampling Filters for Non-Gaussian Data Ass…

200 papers

We present a Hamiltonian Monte Carlo algorithm to sample from multivariate Gaussian distributions in which the target space is constrained by linear and quadratic inequalities or products thereof. The Hamiltonian equations of motion can be…

Computation · Statistics 2013-06-06 Ari Pakman , Liam Paninski

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

A model-based approach is developed for clustering categorical data with no natural ordering. The proposed method exploits the Hamming distance to define a family of probability mass functions to model the data. The elements of this family…

Methodology · Statistics 2024-07-02 Raffaele Argiento , Edoardo Filippi-Mazzola , Lucia Paci

We introduce an exact Bayesian approach to search for non-Gaussianity of local type in Cosmic Microwave Background (CMB) radiation data. Using simulated CMB temperature maps, the newly developed technique is compared against the…

Cosmology and Nongalactic Astrophysics · Physics 2010-11-15 Franz Elsner , Benjamin D. Wandelt

This paper constructs an ensemble-based sampling smoother for four-dimensional data assimilation using a Hybrid/Hamiltonian Monte-Carlo approach. The smoother samples efficiently from the posterior probability density of the solution at the…

Numerical Analysis · Computer Science 2015-05-19 Ahmed Attia , Vishwas Rao , Adrian Sandu

The Gaussian mixture model (GMM) provides a simple yet principled framework for clustering, with properties suitable for statistical inference. In this paper, we propose a new model-based clustering algorithm, called EGMM (evidential GMM),…

Machine Learning · Computer Science 2022-11-29 Lianmeng Jiao , Thierry Denoeux , Zhun-ga Liu , Quan Pan

Bayesian clustering typically relies on mixture models, with each component interpreted as a different cluster. After defining a prior for the component parameters and weights, Markov chain Monte Carlo (MCMC) algorithms are commonly used to…

Methodology · Statistics 2024-07-30 Alexander Dombowsky , David B. Dunson

Generalized linear mixed models (GLMMs) are often used for analyzing correlated non-Gaussian data. The likelihood function in a GLMM is available only as a high dimensional integral, and thus closed-form inference and prediction are not…

Methodology · Statistics 2022-06-27 Vivekananda Roy

Hamiltonian Monte Carlo (HMC) is widely used for sampling from high dimensional target distributions with densities known up to proportionality. While HMC exhibits favorable scaling properties in high dimensions, it struggles with strongly…

Computation · Statistics 2025-07-30 Joonha Park

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected…

Numerical Analysis · Mathematics 2023-08-08 Tony Lelièvre , Régis Santet , Gabriel Stoltz

The problem of the reconstruction of the large scale density and velocity fields from peculiar velocities surveys is addressed here within a Bayesian framework by means of Hamiltonian Monte Carlo (HMC) sampling. The HAmiltonian Monte carlo…

Cosmology and Nongalactic Astrophysics · Physics 2022-06-01 Aurélien Valade , Yehuda Hoffman , Noam I Libeskind , Romain Graziani

The Hamiltonian Monte Carlo (HMC) method allows sampling from continuous densities. Favorable scaling with dimension has led to wide adoption of HMC by the statistics community. Modern auto-differentiating software should allow more…

Computation · Statistics 2022-08-17 Ian Langmore , Michael Dikovsky , Scott Geraedts , Peter Norgaard , Rob von Behren

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

We propose a new framework for Hamiltonian Monte Carlo (HMC) on truncated probability distributions with smooth underlying density functions. Traditional HMC requires computing the gradient of potential function associated with the target…

Machine Learning · Statistics 2017-09-12 Kexin Yi , Finale Doshi-Velez

In the framework of Bayesian model-based clustering based on a finite mixture of Gaussian distributions, we present a joint approach to estimate the number of mixture components and identify cluster-relevant variables simultaneously as well…

Methodology · Statistics 2016-06-23 Gertraud Malsiner-Walli , Sylvia Frühwirth-Schnatter , Bettina Grün

The Bayesian approach to inference stands out for naturally allowing borrowing information across heterogeneous populations, with different samples possibly sharing the same distribution. A popular Bayesian nonparametric model for…

Methodology · Statistics 2022-01-25 Antonio Lijoi , Igor Prünster , Giovanni Rebaudo

Probabilistic programming uses programs to express generative models whose posterior probability is then computed by built-in inference engines. A challenging goal is to develop general purpose inference algorithms that work out-of-the-box…

Machine Learning · Computer Science 2022-11-03 Carol Mak , Fabian Zaiser , Luke Ong

This paper focuses on variational inference with intractable likelihood functions that can be unbiasedly estimated. A flexible variational approximation based on Gaussian mixtures is developed, by adopting the mixture population Monte Carlo…

Numerical Analysis · Mathematics 2021-12-02 Zhijian He , Shifeng Huo , Tianhui Yang

The dependence of galaxy clustering on local density provides an effective method for extracting non-Gaussian information from galaxy surveys. The two-point correlation function (2PCF) provides a complete statistical description of a…

Bayesian inference in the presence of an intractable likelihood function is computationally challenging. When following a Markov chain Monte Carlo (MCMC) approach to approximate the posterior distribution in this context, one typically…

Methodology · Statistics 2019-10-03 Johan Alenlöv , Arnaud Doucet , Fredrik Lindsten