English
Related papers

Related papers: Monte Carlo Expectation-Maximization algorithm to …

200 papers

This paper proposes a new approach for Bayesian and maximum likelihood parameter estimation for stationary Gaussian processes observed on a large lattice with missing values. We propose an MCMC approach for Bayesian inference, and a Monte…

Computation · Statistics 2014-02-19 Jonathan R. Stroud , Michael L. Stein , Shaun Lysen

Stochastic Differential Equations (SDEs) are used as statistical models in many disciplines. However, intractable likelihood functions for SDEs make inference challenging, and we need to resort to simulation-based techniques to estimate and…

Methodology · Statistics 2014-08-12 Grant Schneider , Peter F. Craigmile , Radu Herbei

Birth-death processes (BDPs) are continuous-time Markov chains that track the number of "particles" in a system over time. While widely used in population biology, genetics and ecology, statistical inference of the instantaneous particle…

Methodology · Statistics 2011-11-22 Forrest W. Crawford , Vladimir N. Minin , Marc A. Suchard

Clustering is a widely deployed unsupervised learning tool. Model-based clustering is a flexible framework to tackle data heterogeneity when the clusters have different shapes. Likelihood-based inference for mixture distributions often…

Machine Learning · Statistics 2023-05-30 Yubo Zhuang , Xiaohui Chen , Yun Yang

The methods of statistical physics are widely used for modelling complex networks. Building on the recently proposed Equilibrium Expectation approach, we derive a simple and efficient algorithm for maximum likelihood estimation (MLE) of…

Computation · Statistics 2020-02-12 Alexander Borisenko , Maksym Byshkin , Alessandro Lomi

We present an efficient algorithm for maximum likelihood estimation (MLE) of exponential family models, with a general parametrization of the energy function that includes neural networks. We exploit the primal-dual view of the MLE with a…

Machine Learning · Computer Science 2020-04-01 Bo Dai , Zhen Liu , Hanjun Dai , Niao He , Arthur Gretton , Le Song , Dale Schuurmans

Human microbiome studies based on genetic sequencing techniques produce compositional longitudinal data of the relative abundances of microbial taxa over time, allowing to understand, through mixed-effects modeling, how microbial…

Methodology · Statistics 2025-12-23 John Barrera , Cristian Meza , Ana Arribas-Gil

We investigate penalized maximum log-likelihood estimation for exponential family distributions whose natural parameter resides in a reproducing kernel Hilbert space. Key to our approach is a novel technique, doubly dual embedding, that…

Machine Learning · Computer Science 2019-04-25 Bo Dai , Hanjun Dai , Arthur Gretton , Le Song , Dale Schuurmans , Niao He

In this paper we propose an efficient stochastic optimization algorithm to search for Bayesian experimental designs such that the expected information gain is maximized. The gradient of the expected information gain with respect to…

Computation · Statistics 2022-02-03 Takashi Goda , Tomohiko Hironaka , Wataru Kitade , Adam Foster

Handling missing values plays an important role in the analysis of survival data, especially, the ones marked by cure fraction. In this paper, we discuss the properties and implementation of stochastic approximations to the…

Methodology · Statistics 2021-07-22 Sandip Barui , Suvra Pal , Nutan Mishra , Katherine Davies

An optimal experimental set-up maximizes the value of data for statistical inferences and predictions. The efficiency of strategies for finding optimal experimental set-ups is particularly important for experiments that are time-consuming…

Numerical Analysis · Mathematics 2020-02-04 Joakim Beck , Ben Mansour Dia , Luis F. R. Espath , Raul Tempone

The Expectation--Maximization Maximum Likelihood (EMML) algorithm belongs to the Expectation--Maximization family and is widely used for image reconstruction problems under Poisson noise.In this paper, we reinterpret EMML as a mirror…

Optimization and Control · Mathematics 2026-04-20 Antonin Clerc , Ségolène Martin , Nicolas Papadakis , Gabriele Steidl

A hybrid censoring scheme is a mixture of Type-I and Type-II censoring schemes. We study the estimation of parameters of weighted exponential distribution based on Type-II hybrid censored data. By applying EM algorithm, maximum likelihood…

Statistics Theory · Mathematics 2012-03-02 Akram Kohansal , Saeid Rezakhah

We propose a new and computationally efficient algorithm for maximizing the observed log-likelihood for a multivariate normal data matrix with missing values. We show that our procedure based on iteratively regressing the missing on the…

Methodology · Statistics 2012-11-21 Nicolas Städler , Daniel J. Stekhoven , Peter Bühlmann

In this article we consider computing expectations w.r.t.~probability laws associated to a certain class of stochastic systems. In order to achieve such a task, one must not only resort to numerical approximation of the expectation, but…

Computation · Statistics 2017-10-30 Ajay Jasra , Kengo Kamatani , Kody Law , Yan Zhou

Expectation Propagation (EP)-based Multiple-Input Multiple-Output (MIMO) detector is regarded as a state-of-the-art MIMO detector because of its exceptional performance. However, we find that the EP MIMO detector cannot guarantee to achieve…

Signal Processing · Electrical Eng. & Systems 2020-10-21 Hang Chen , Guoqiang Yao , Jianhao Hu

Over the years, sequential Monte Carlo (SMC) and, equivalently, particle filter (PF) theory has gained substantial attention from researchers. However, the performance of the resampling methodology, also known as offspring selection, has…

Machine Learning · Statistics 2022-12-26 Oskar Kviman , Hazal Koptagel , Harald Melin , Jens Lagergren

This paper addresses optimization problems constrained by partial differential equations with uncertain coefficients. In particular, the robust control problem and the average control problem are considered for a tracking type cost…

Optimization and Control · Mathematics 2017-11-08 Andreas Van Barel , Stefan Vandewalle

We describe an embarrassingly parallel, anytime Monte Carlo method for likelihood-free models. The algorithm starts with the view that the stochasticity of the pseudo-samples generated by the simulator can be controlled externally by a…

Machine Learning · Computer Science 2015-12-03 Edward Meeds , Max Welling

The expectation-maximization (EM) algorithm is a well-known iterative method for computing maximum likelihood estimates from incomplete data. Despite its numerous advantages, a main drawback of the EM algorithm is its frequently observed…

Computation · Statistics 2018-08-14 Nicholas C. Henderson , Ravi Varadhan