English
Related papers

Related papers: Computational AstroStatistics: Fast Algorithms and…

200 papers

In this paper, we study convergence properties of the gradient Expectation-Maximization algorithm \cite{lange1995gradient} for Gaussian Mixture Models for general number of clusters and mixing coefficients. We derive the convergence rate…

Statistics Theory · Mathematics 2017-12-05 Bowei Yan , Mingzhang Yin , Purnamrita Sarkar

A line of recent work has analyzed the behavior of the Expectation-Maximization (EM) algorithm in the well-specified setting, in which the population likelihood is locally strongly concave around its maximizing argument. Examples include…

Statistics Theory · Mathematics 2020-04-30 Raaz Dwivedi , Nhat Ho , Koulik Khamaru , Michael I. Jordan , Martin J. Wainwright , Bin Yu

We present a new framework to detect various types of variable objects within massive astronomical time-series data. Assuming that the dominant population of objects is non-variable, we find outliers from this population by using a…

Instrumentation and Methods for Astrophysics · Physics 2010-01-17 Min-Su Shin , Michael Sekora , Yong-Ik Byun

A mixture of shifted asymmetric Laplace distributions is introduced and used for clustering and classification. A variant of the EM algorithm is developed for parameter estimation by exploiting the relationship with the general inverse…

Methodology · Statistics 2017-10-09 Brian C. Franczak , Ryan P. Browne , Paul D. McNicholas

Interstellar medium widely exists in the universe at multi-scales. In this study, we introduce the {\it Multi-scale Decomposition Reconstruction} method, an equation-based model designed to derive width maps of interstellar medium…

Astrophysics of Galaxies · Physics 2025-12-23 Mengke Zhao , Guang-Xing Li , Duo Xu , Keping Qiu

Future cosmological galaxy surveys such as the Large Synoptic Survey Telescope (LSST) will photometrically observe very large numbers of galaxies. Without spectroscopy, the redshifts required for the analysis of these data will need to be…

Cosmology and Nongalactic Astrophysics · Physics 2019-10-07 Daniel M. Jones , Alan F. Heavens

This paper concerns the use of the expectation-maximisation (EM) algorithm for inference in partially observed diffusion processes. In this context, a well known problem is that all except a few diffusion processes lack closed-form…

Statistics Theory · Mathematics 2010-08-18 Jimmy Olsson , Jonas Ströjby

(abridged) We develop an algorithm for estimating parameters of a distribution sampled with contamination, employing a statistical technique known as ``expectation maximization'' (EM). Given models for both member and contaminant…

Clustering algorithms are a cornerstone of machine learning applications. Recently, a quantum algorithm for clustering based on the k-means algorithm has been proposed by Kerenidis, Landman, Luongo and Prakash. Based on their work, we…

Quantum Physics · Physics 2020-01-23 Hideyuki Miyahara , Kazuyuki Aihara , Wolfgang Lechner

This paper studies the problem of estimating the means $\pm\theta_{*}\in\mathbb{R}^{d}$ of a symmetric two-component Gaussian mixture $\delta_{*}\cdot N(\theta_{*},I)+(1-\delta_{*})\cdot N(-\theta_{*},I)$ where the weights $\delta_{*}$ and…

Statistics Theory · Mathematics 2021-03-30 Nir Weinberger , Guy Bresler

The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of…

Machine Learning · Statistics 2022-11-15 Hideitsu Hino , Shotaro Akaho , Noboru Murata

Probit models are useful for modeling correlated discrete responses in many disciplines, including consumer choice data in economics and marketing. However, the Gaussian latent variable feature of probit models coupled with identification…

Methodology · Statistics 2024-09-30 Patrick Ding , Guido Imbens , Zhaonan Qu , Yinyu Ye

Clustering has become an indispensable tool in the presence of increasingly large and complex data sets. Most clustering algorithms depend, either explicitly or implicitly, on the sampled density. However, estimated densities are fragile…

Chemical Physics · Physics 2023-08-21 Moritz Thürlemann , Sereina Riniker

Mixture models are a fundamental tool in applied statistics and machine learning for treating data taken from multiple subpopulations. The current practice for estimating the parameters of such models relies on local search heuristics…

Machine Learning · Computer Science 2012-09-07 Animashree Anandkumar , Daniel Hsu , Sham M. Kakade

We investigate the potential and accuracy of clustering-based redshift estimation using the method proposed by M\'enard et al. (2013). This technique enables the inference of redshift distributions from measurements of the spatial…

Astrophysics of Galaxies · Physics 2015-06-22 Mubdi Rahman , Brice Ménard , Ryan Scranton , Samuel J. Schmidt , Christopher B. Morrison

Initialisation of the EM algorithm in model-based clustering is often crucial. Various starting points in the parameter space often lead to different local maxima of the likelihood function and, so to different clustering partitions. Among…

Methodology · Statistics 2015-07-28 Luca Scrucca , Adrian E. Raftery

The non-Gaussisan spatial distribution of galaxies traces the large-scale structure of the Universe and therefore constitutes a prime observable to constrain cosmological parameters. We conduct Bayesian inference of the $\Lambda$CDM…

Model error covariances play a central role in the performance of data assimilation methods applied to nonlinear state-space models. However, these covariances are largely unknown in most of the applications. A misspecification of the model…

Computation · Statistics 2019-11-06 María Magdalena Lucini , Peter Jan van Leeuwen , Manuel Pulido

The Expectation-Maximization (EM) algorithm has been predominantly used to approximate the maximum likelihood estimation of the location-scale Gaussian mixtures. However, when the models are over-specified, namely, the chosen number of…

Machine Learning · Statistics 2022-05-24 Tongzheng Ren , Fuheng Cui , Sujay Sanghavi , Nhat Ho

We present an algorithm capable of detecting diffuse, dim sources of any size in an astronomical image. These sources often defeat traditional methods for source finding, which expand regions around points of high intensity. Extended…

Instrumentation and Methods for Astrophysics · Physics 2016-01-05 T. Butler-Yeoman , M. Frean , C. P. Hollitt , D. W. Hogg , M. Johnston-Hollitt
‹ Prev 1 3 4 5 6 7 10 Next ›