English
Related papers

Related papers: Computationally Efficient Estimation of Large Prob…

200 papers

In this paper, we firstly give a brief introduction of expectation maximization (EM) algorithm, and then discuss the initial value sensitivity of expectation maximization algorithm. Subsequently, we give a short proof of EM's convergence.…

Machine Learning · Computer Science 2013-05-06 Fuqiang Chen

We give convergence guarantees for estimating the coefficients of a symmetric mixture of two linear regressions by expectation maximization (EM). In particular, we show that the empirical EM iterates converge to the target parameter vector…

Machine Learning · Statistics 2018-10-17 Jason M. Klusowski , Dana Yang , W. D. Brinda

In this paper, a long-term survival model under competing risks is considered. The unobserved number of competing risks is assumed to follow a negative binomial distribution that can capture both over- and under-dispersion. Considering the…

Methodology · Statistics 2021-07-22 Suvra Pal

Exact inference in the linear regression model with spike and slab priors is often intractable. Expectation propagation (EP) can be used for approximate inference. However, the regular sequential form of EP (R-EP) may fail to converge in…

Machine Learning · Statistics 2011-12-13 José Miguel Hernández-Lobato , Daniel Hernández-Lobato

Estimation of Distribution Algorithms (EDAs) and Innovation Method are recognized methods for solving global optimization problems and for the estimation of parameters in diffusion processes, respectively. Well known is also that the…

Numerical Analysis · Mathematics 2018-04-10 Zochil González Arenas , Juan Carlos Jimenez , Li-Vang Lozada-Chang , Roberto Santana

Predictive models for binary data are fundamental in various fields, and the growing complexity of modern applications has motivated several flexible specifications for modeling the relationship between the observed predictors and the…

Computation · Statistics 2022-01-31 Jian Cao , Daniele Durante , Marc G. Genton

This report presents an Expectation-Maximization (EM) algorithm for estimation of the maximum-likelihood parameter values of constrained multivariate autoregressive Gaussian state-space (MARSS) models. The MARSS model can be written:…

Methodology · Statistics 2013-02-19 Elizabeth E. Holmes

Modelling highly multi-modal data is a challenging problem in machine learning. Most algorithms are based on maximizing the likelihood, which corresponds to the M(oment)-projection of the data distribution to the model distribution. The…

Machine Learning · Computer Science 2020-01-24 Philipp Becker , Oleg Arenz , Gerhard Neumann

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Deep Boltzmann Machines (DBMs) are generative neural networks with these desired properties. We integrate a DBM…

Neural and Evolutionary Computing · Computer Science 2016-08-09 Malte Probst , Franz Rothlauf

Deep diffusion models have revolutionized image generation by producing high-quality outputs. However, achieving specific objectives with these models often requires costly adaptations such as fine-tuning, which can be resource-intensive…

Neural and Evolutionary Computing · Computer Science 2026-04-13 Domício Pereira Neto , João Correia , Penousal Machado

We develop a model-based empirical Bayes approach to variable selection problems in which the number of predictors is very large, possibly much larger than the number of responses (the so-called 'large p, small n' problem). We consider the…

Methodology · Statistics 2015-10-14 Haim Y. Bar , James G. Booth , Martin T. Wells

Expectation maximization (EM) algorithm is to find maximum likelihood solution for models having latent variables. A typical example is Gaussian Mixture Model (GMM) which requires Gaussian assumption, however, natural images are highly…

Machine Learning · Computer Science 2018-12-04 Wentian Zhao , Shaojie Wang , Zhihuai Xie , Jing Shi , Chenliang Xu

We present a class of sparse generalized linear models that include probit and logistic regression as special cases and offer some extra flexibility. We provide an EM algorithm for learning the parameters of these models from data. We apply…

Methodology · Statistics 2007-08-22 Susana Eyheramendy , David Madigan

The stochastic approximation EM algorithm (SAEM) is described for the estimation of item and person parameters given test data coded as dichotomous or ordinal variables. The method hinges upon the eigenanalysis of missing variables sampled…

Methodology · Statistics 2020-01-01 Eugene Geis

We study empirical Bayes (EB) predictive density estimation in linear mixed models (LMMs) with large number of units, which induce a high dimensional random effects space. Focusing on Kullback Leibler (KL) risk minimization, we develop a…

Methodology · Statistics 2026-03-31 Abir Sarkar , Gourab Mukherjee , Keisuke Yano

A large body of research has focused on theory and computation for variable selection techniques for high dimensional data. There has been substantially less work in the big tall data paradigm, where the number of variables may be large,…

Computation · Statistics 2018-01-30 Jared D. Huling , Peter Z. G. Qian

Latent variable models are powerful tools for modeling complex phenomena involving in particular partially observed data, unobserved variables or underlying complex unknown structures. Inference is often difficult due to the latent…

Statistics Theory · Mathematics 2023-06-23 Charlotte Baey , Maud Delattre , Estelle Kuhn , Jean-Benoist Leger , Sarah Lemler

In recent years, researchers in decision analysis and artificial intelligence (Al) have used Bayesian belief networks to build models of expert opinion. Using standard methods drawn from the theory of computational complexity, workers in…

Artificial Intelligence · Computer Science 2013-04-08 R. Martin Chavez , Gregory F. Cooper

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

Metropolitan scale vehicular traffic modeling is used by a variety of private and public sector urban mobility stakeholders to inform the design and operations of road networks. High-resolution stochastic traffic simulators are increasingly…

Multiagent Systems · Computer Science 2021-09-24 Neha Arora , Yi-fan Chen , Sanjay Ganapathy , Yechen Li , Ziheng Lin , Carolina Osorio , Andrew Tomkins , Iveel Tsogsuren