English
Related papers

Related papers: Algebraic and Analytic Approaches for Parameter Le…

200 papers

We approximate the distribution of the sum of independent but not necessarily identically distributed Bernoulli random variables using a shifted binomial distribution where the three parameters (the number of trials, the probability of…

Probability · Mathematics 2010-04-02 Vydas Čekanavičius , Erol A. Peköz , Adrian Röllin , Michael Shwartz

Deep learning architectures have achieved promising results in different areas (e.g., medicine, agriculture, and security). However, using those powerful techniques in many real applications becomes challenging due to the large labeled…

Machine Learning · Computer Science 2022-08-30 Luiz H. Buris , Daniel C. G. Pedronette , Joao P. Papa , Jurandy Almeida , Gustavo Carneiro , Fabio A. Faria

One of the most popular algorithms for clustering in Euclidean space is the $k$-means algorithm; $k$-means is difficult to analyze mathematically, and few theoretical guarantees are known about it, particularly when the data is {\em…

Machine Learning · Computer Science 2009-12-02 Kamalika Chaudhuri , Sanjoy Dasgupta , Andrea Vattani

Finite mixtures of matrix normal distributions are a powerful tool for classifying three-way data in unsupervised problems. The distribution of each component is assumed to be a matrix variate normal density. The mixture model can be…

Methodology · Statistics 2013-03-07 Cinzia Viroli

Probabilistic clustering models (or equivalently, mixture models) are basic building blocks in countless statistical models and involve latent random variables over discrete spaces. For these models, posterior inference methods can be…

Machine Learning · Statistics 2020-06-24 Ari Pakman , Yueqi Wang , Catalin Mitelut , JinHyung Lee , Liam Paninski

Predictive recursion is an accurate and computationally efficient algorithm for nonparametric estimation of mixing densities in mixture models. In semiparametric mixture models, however, the algorithm fails to account for any uncertainty in…

Methodology · Statistics 2015-03-19 Ryan Martin , Surya T. Tokdar

We present a Bayesian methodology for infinite as well as finite dimensional parameter identification for partial differential equation models. The Bayesian framework provides a rigorous mathematical framework for incorporating prior…

Quantitative Methods · Quantitative Biology 2016-05-17 Eduard Campillo-Funollet , Chandrasekhar Venkataraman , Anotida Madzvamuse

We consider the problem of learning mixtures of generalized linear models (GLM) which arise in classification and regression problems. Typical learning approaches such as expectation maximization (EM) or variational Bayes can get stuck in…

Machine Learning · Computer Science 2016-01-14 Hanie Sedghi , Majid Janzamin , Anima Anandkumar

We consider estimating the parameters of a Gaussian mixture density with a given number of components best representing a given set of weighted samples. We adopt a density interpretation of the samples by viewing them as a discrete Dirac…

Machine Learning · Statistics 2025-04-03 Daniel Frisch , Uwe D. Hanebeck

We exploit a suitable moment-based characterization of the mixture of Poisson distribution for developing Bayesian inference for the unknown size of a finite population whose units are subject to multiple occurrences during an enumeration…

Methodology · Statistics 2018-06-19 Danilo Alunni Fegatelli , Luca Tardella

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard problem from a…

Statistics Theory · Mathematics 2023-01-05 Yuling Yan , Kaizheng Wang , Philippe Rigollet

Within the context of the binomial model, we analyse sequences of values that are almost-uniform and we discuss a prediction method called the frequent outcome approach, in which the outcome that has occurred the most in the observed trials…

Statistics Theory · Mathematics 2022-09-29 Ben O'Neill

We present an integrated approach for structure and parameter estimation in latent tree graphical models. Our overall approach follows a "divide-and-conquer" strategy that learns models over small groups of variables and iteratively merges…

Machine Learning · Computer Science 2019-12-19 Furong Huang , Niranjan U. N. , Ioakeim Perros , Robert Chen , Jimeng Sun , Anima Anandkumar

This paper provides a mixture modeling framework using the bivariate generalized exponential distribution. We study different properties of this mixture distribution. Hierarchical EM algorithm is developed for finding the estimates of the…

Computation · Statistics 2018-04-03 Arabin Kumar Dey , Debasis Kundu , Tumati Kiran Kumar

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

In learned image compression, probabilistic models play an essential role in characterizing the distribution of latent variables. The Gaussian model with mean and scale parameters has been widely used for its simplicity and effectiveness.…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Haotian Zhang , Li Li , Dong Liu

We describe and analyze a broad class of mixture models for real-valued multivariate data in which the probability density of observations within each component of the model is represented as an arbitrary combination of basis functions.…

Methodology · Statistics 2025-02-28 M. E. J. Newman

In particle physics, as in many areas of science, parameter inference relies on simulations to bridge the gap between theory and experiment. Recent developments in simulation-based inference have boosted the sensitivity of analyses;…

High Energy Physics - Phenomenology · Physics 2026-04-23 Ezequiel Alvarez , Sean Benevedes , Manuel Szewc , Jesse Thaler

Factor analysis for high-dimensional data is a canonical problem in statistics and has a wide range of applications. However, there is currently no factor model tailored to effectively analyze high-dimensional count responses with…

Methodology · Statistics 2024-08-21 Wei Liu , Qingzhi Zhong

A mixture of multivariate Poisson-log normal factor analyzers is introduced by imposing constraints on the covariance matrix, which resulted in flexible models for clustering purposes. In particular, a class of eight parsimonious mixture…

Methodology · Statistics 2023-11-15 Andrea Payne , Anjali Silva , Steven J. Rothstein , Paul D. McNicholas , Sanjeena Subedi