English
Related papers

Related papers: Envelope Methods with Ignorable Missing Data

200 papers

Learning with hidden variables is a central challenge in probabilistic graphical models that has important implications for many real-life problems. The classical approach is using the Expectation Maximization (EM) algorithm. This…

Machine Learning · Computer Science 2012-12-12 Gal Elidan , Nir Friedman

A new approach for signal parametrization, which consists of a specific regression model incorporating a discrete hidden logistic process, is proposed. The model parameters are estimated by the maximum likelihood method performed by a…

Methodology · Statistics 2013-12-30 Faicel Chamroukhi , Allou Samé , Gérard Govaert , Patrice Aknin

The purpose of this note is to show how the method of maximum entropy in the mean (MEM) may be used to improve parametric estimation when the measurements are corrupted by large level of noise. The method is developed in the context on a…

Machine Learning · Computer Science 2021-08-23 Henryk Gzyl , Enrique ter Horst

Expectation maximization (EM) is a technique for estimating maximum-likelihood parameters of a latent variable model given observed data by alternating between taking expectations of sufficient statistics, and maximizing the expected log…

Methodology · Statistics 2018-07-10 Donna Henderson , Gerton Lunter

In the presence of a missing response, reweighting the complete case subsample by the inverse of nonmissing probability is both intuitive and easy to implement. When the population totals of some auxiliary variables are known and when the…

Methodology · Statistics 2014-10-16 Kwun Chuen Gary Chan , Sheung Chi Phillip Yam

The Expectation-Maximization (EM) algorithm is a fundamental tool in unsupervised machine learning. It is often used as an efficient way to solve Maximum Likelihood (ML) estimation problems, especially for models with latent variables. It…

Quantum Physics · Physics 2020-07-08 Iordanis Kerenidis , Alessandro Luongo , Anupam Prakash

Two major ideas in the analysis of missing data are (a) the EM algorithm [Dempster, Laird and Rubin, J. Roy. Statist. Soc. Ser. B 39 (1977) 1--38] for maximum likelihood (ML) estimation, and (b) the formulation of models for the joint…

Methodology · Statistics 2011-04-14 Yan Zhou , Roderick J. A. Little , John D. Kalbfleisch

Interval-censored multi-state data arise in many studies of chronic diseases, where the health status of a subject can be characterized by a finite number of disease states and the transition between any two states is only known to occur…

Methodology · Statistics 2022-09-19 Yu Gu , Donglin Zeng , Gerardo Heiss , D. Y. Lin

The expectation-maximization (EM) algorithm is an iterative method for finding maximum likelihood estimates when data are incomplete or are treated as being incomplete. The EM algorithm and its variants are commonly used for parameter…

Computation · Statistics 2013-06-26 Ryan P. Browne , Sanjeena Subedi , Paul McNicholas

The Expectation-Maximization (EM) algorithm (Dempster, Laird and Rubin, 1977) is a popular method for computing maximum likelihood estimates (MLEs) in problems with missing data. Each iteration of the al- gorithm formally consists of an…

Statistics Theory · Mathematics 2012-06-22 Ronald C. Neath

Inferring dynamics from time series is an important objective in data analysis. In particular, it is challenging to infer stochastic dynamics given incomplete data. We propose an expectation maximization (EM) algorithm that iterates between…

Data Analysis, Statistics and Probability · Physics 2021-08-25 Sangwon Lee , Vipul Periwal , Junghyo Jo

This paper proposes a new approach for Bayesian and maximum likelihood parameter estimation for stationary Gaussian processes observed on a large lattice with missing values. We propose an MCMC approach for Bayesian inference, and a Monte…

Computation · Statistics 2014-02-19 Jonathan R. Stroud , Michael L. Stein , Shaun Lysen

Quantifying the data uncertainty in learning tasks is often done by learning a prediction interval or prediction set of the label given the input. Two commonly desired properties for learned prediction sets are \emph{valid coverage} and…

Machine Learning · Computer Science 2022-05-31 Yu Bai , Song Mei , Huan Wang , Yingbo Zhou , Caiming Xiong

Estimations of physical parameters using data usually involve non-uniform experimental efficiencies. In this article, a method of maximum likelihood fit is introduced using the efficiency as a weight, while the probability distribution…

Data Analysis, Statistics and Probability · Physics 2023-08-31 Chenxu Yu , Yanxi Zhang

This paper describes a compound Poisson-based random effects structure for modeling zero-inflated data. Data with large proportion of zeros are found in many fields of applied statistics, for example in ecology when trying to model and…

Applications · Statistics 2009-07-29 Marie-Pierre Etienne , Eric Parent , Benoit Hugues , Bernier Jacques

Efficient estimation methods for simultaneous autoregressive (SAR) models with missing data in the response variable have been well-explored in the literature. A common practice is to introduce measurement error into SAR models to separate…

Methodology · Statistics 2024-10-10 Anjana Wijayawardhana , Thomas Suesse , David Gunawan

Empirical best prediction (EBP) is a well-known method for producing reliable proportion estimates when the primary data source provides only small or no sample from finite populations. There are potential challenges in implementing…

Methodology · Statistics 2025-01-22 Aditi Sen , Partha Lahiri

Entropy minimization (EM) is frequently used to increase the accuracy of classification models when they're faced with new data at test time. EM is a self-supervised learning method that optimizes classifiers to assign even higher…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Ori Press , Ravid Shwartz-Ziv , Yann LeCun , Matthias Bethge

A new approach for feature extraction from time series is proposed in this paper. This approach consists of a specific regression model incorporating a discrete hidden logistic process. The model parameters are estimated by the maximum…

Methodology · Statistics 2013-12-30 Faicel Chamroukhi , Allou Samé , Gérard Govaert , Patrice Aknin

The density ratio model (DRM) provides a flexible and useful platform for combining information from multiple sources. In this paper, we consider statistical inference under two-sample DRMs with additional parameters defined through and/or…

Statistics Theory · Mathematics 2021-03-01 Meng Yuan , Pengfei Li , Changbao Wu