English
Related papers

Related papers: Model uncertainty estimation using the expectation…

200 papers

We describe and analyze a broad class of mixture models for real-valued multivariate data in which the probability density of observations within each component of the model is represented as an arbitrary combination of basis functions.…

Methodology · Statistics 2025-02-28 M. E. J. Newman

Recent studies have shown that ensemble approaches could not only improve accuracy and but also estimate model uncertainty in deep learning. However, it requires a large number of parameters according to the increase of ensemble models for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Hong Joo Lee , Seong Tae Kim , Hakmin Lee , Nassir Navab , Yong Man Ro

Maximum likelihood estimators are proposed for the parameters and the densities in a semiparametric density ratio model in which the nonparametric baseline density is approximated by the Bernstein polynomial model. The EM algorithm is used…

Methodology · Statistics 2021-03-02 Zhong Guan

We develop an optimal experimental design framework for adapting the covariance inflation and localization in data assimilation problems. Covariance inflation and localization are ubiquitously employed to alleviate the effect of using…

Computational Engineering, Finance, and Science · Computer Science 2019-03-26 Ahmed Attia , Emil Constantinescu

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

This paper explores innovations to parameter estimation in generalized linear and nonlinear models, which may be used in item response modeling to account for guessing/pretending or slipping/dissimulation and for the effect of covariates.…

Methodology · Statistics 2025-07-03 Adéla Hladká , Patrícia Martinková , Marek Brabec

The extended Kalman filter (EKF) is a cornerstone of nonlinear state estimation, yet its performance is fundamentally limited by noise-model mismatch and linearization errors. We develop a residual-aware distributionally robust EKF that…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Minhyuk Jang , Jungjin Lee , Astghik Hakobyan , Naira Hovakimyan , Insoon Yang

Nonlinear mixed effects models have received a great deal of attention in the statistical literature in recent years because of their flexibility in handling longitudinal studies, including human immunodeficiency virus viral dynamics,…

Methodology · Statistics 2021-09-28 Fernanda L. Schumacher , Dipak K. Dey , Victor H. Lachos

Mixture models have attracted significant attention due to practical effectiveness and comprehensive theoretical foundations. A persisting challenge is model misspecification, which occurs when the model to be fitted has more mixture…

Machine Learning · Computer Science 2026-03-09 Zhankun Luo , Abolfazl Hashemi

The Expectation-Maximization (EM) algorithm has been predominantly used to approximate the maximum likelihood estimation of the location-scale Gaussian mixtures. However, when the models are over-specified, namely, the chosen number of…

Machine Learning · Statistics 2022-05-24 Tongzheng Ren , Fuheng Cui , Sujay Sanghavi , Nhat Ho

The Expectation Maximisation (EM) algorithm is widely used to optimise non-convex likelihood functions with latent variables. Many authors modified its simple design to fit more specific situations. For instance, the Expectation (E) step…

Statistics Theory · Mathematics 2022-05-03 Thomas Lartigue , Stanley Durrleman , Stéphanie Allassonnière

A novel strategy is proposed to improve the accuracy of state estimation and reconstruction from low-fidelity models and sparse data from sensors. This strategy combines ensemble Data Assimilation (DA) and Machine Learning (ML) tools,…

Fluid Dynamics · Physics 2025-01-31 Miguel M. Valero , Marcello Meldi

Heckman selection model is perhaps the most popular econometric model in the analysis of data with sample selection. The analyses of this model are based on the normality assumption for the error terms, however, in some applications, the…

Methodology · Statistics 2020-06-16 Victor H. Lachos Davila , Marcos O. Prates , Dipak K. Dey

Using a dynamical model to make predictions about a system has many sources of error. These can include errors in how the model was initialised but also errors in the dynamics of the model itself. For many applications in data assimilation,…

Numerical Analysis · Mathematics 2025-07-07 P. A. Browne

This paper deals with the problem of clustering data returned by a radar sensor network that monitors a region where multiple moving targets are present. The network is formed by nodes with limited functionalities that transmit the…

Signal Processing · Electrical Eng. & Systems 2024-05-07 Linjie Yan , Pia Addabbo , Nicomino Fiscante , Carmine Clemente , Chengpeng Hao , Gaetano Giunta , Danilo Orlando

Estimators derived from an EM algorithm are not robust since they are based on the maximization of the likelihood function. We propose a proximal-point algorithm based on the EM algorithm which aim to minimize a divergence criterion.…

Computation · Statistics 2016-07-11 Diaa Al Mohamad , Michel Broniatowski

We study empirical Bayes (EB) predictive density estimation in linear mixed models (LMMs) with large number of units, which induce a high dimensional random effects space. Focusing on Kullback Leibler (KL) risk minimization, we develop a…

Methodology · Statistics 2026-03-31 Abir Sarkar , Gourab Mukherjee , Keisuke Yano

Using stochastic gradient search and the optimal filter derivative, it is possible to perform recursive (i.e., online) maximum likelihood estimation in a non-linear state-space model. As the optimal filter and its derivative are…

Statistics Theory · Mathematics 2021-01-05 Vladislav Z. B. Tadic , Arnaud Doucet

We consider nonlinear mixed effects models including high-dimensional covariates to model individual parameters variability. The objective is to identify relevant covariates among a large set under sparsity assumption and to estimate model…

Statistics Theory · Mathematics 2025-08-06 Antoine Caillebotte , Estelle Kuhn , Sarah Lemler

The current Bayesian FFT algorithm relies on direct differentiation to obtain the posterior covariance matrix (PCM), which is time-consuming, memory-intensive, and hard to code, especially for the multi-setup operational modal analysis…

Computation · Statistics 2024-12-03 Wei Zhu , Binbin Li , Zuo Zhu