English
Related papers

Related papers: Method for Computation of the Fisher Information M…

200 papers

Mixture models of Plackett-Luce (PL) -- one of the most fundamental ranking models -- are an active research area of both theoretical and practical significance. Most previously proposed parameter estimation algorithms instantiate the EM…

Machine Learning · Computer Science 2023-02-13 Duc Nguyen , Anderson Y. Zhang

In this paper, different strands of literature are combined in order to obtain algorithms for semi-parametric estimation of discrete choice models that include the modelling of unobserved heterogeneity by using mixing distributions for the…

Methodology · Statistics 2022-12-12 Dietmar Bauer , Sebastian Büscher , Manuel Batram

The task of estimating a matrix given a sample of observed entries is known as the \emph{matrix completion problem}. Most works on matrix completion have focused on recovering an unknown real-valued low-rank matrix from a random sample of…

Statistics Theory · Mathematics 2014-08-27 Olga Klopp , Jean Lafond , Eric Moulines , Joseph Salmon

We advocate for a practical Maximum Likelihood Estimation (MLE) approach towards designing loss functions for regression and forecasting, as an alternative to the typical approach of direct empirical risk minimization on a specific target…

Machine Learning · Statistics 2021-10-12 Pranjal Awasthi , Abhimanyu Das , Rajat Sen , Ananda Theertha Suresh

Phenotypic variability in a population of cells can work as the bet-hedging of the cells under an unpredictably changing environment, the typical example of which is the bacterial persistence. To understand the strategy to control such…

Populations and Evolution · Quantitative Biology 2019-12-02 So Nakashima , Yuki Sughiyama , Tetsuya J. Kobayashi

This article deals with the adaptive and approximative computation of the Lam\'e equations. The equations of linear elasticity are considered as boundary integral equations and solved in the setting of the boundary element method (BEM).…

Numerical Analysis · Mathematics 2022-05-11 Maximilian Bauer , Mario Bebendorf

Iterative Proportional Fitting (IPF), combined with EM, is commonly used as an algorithm for likelihood maximization in undirected graphical models. In this paper, we present two iterative algorithms that generalize upon IPF. The first one…

Machine Learning · Computer Science 2013-01-07 Wim Wiegerinck , Tom Heskes

Nonlinear Mixed Effects models (NLME) models are widely used in pharmacometrics and related fields to analyze hierarchical and longitudinal data. However, as the number of parameters and random effects increases, traditional methods for…

Methodology · Statistics 2026-04-30 Mohamed Tarek , Pedro Afonso

The Laplace approximation calls for the computation of second derivatives at the likelihood maximum. When the maximum is found by the EM-algorithm, there is a convenient way to compute these derivatives. The likelihood gradient can be…

Machine Learning · Statistics 2014-01-27 Niko Brümmer

Recently, a so-called E-MS algorithm was developed for model selection in the presence of missing data. Specifically, it performs the Expectation step (E step) and Model Selection step (MS step) alternately to find the minimum point of the…

Methodology · Statistics 2021-06-22 Ping-Feng Xu , Lai-Xu Shang , Man-Lai Tang , Na Shan , Guoliang Tian

We propose a Bayesian expectation-maximization (EM) algorithm for reconstructing Markov-tree sparse signals via belief propagation. The measurements follow an underdetermined linear model where the regression-coefficient vector is the sum…

Machine Learning · Statistics 2013-08-27 Zhao Song , Aleksandar Dogandzic

Inspired from quantum Monte Carlo, by using unbiased estimators all the time and sampling discrete and continuous variables at the same time using Metropolis algorithm, we present a novel, fast, and accurate high performance Monte Carlo…

In this paper the stochastic complexity criterion is applied to estimation of the order in AR and ARMA models. The power of the criterion for short strings is illustrated by simulations. It requires an integral of the square root of Fisher…

Statistics Theory · Mathematics 2007-06-13 Ciprian Doru Giurcăneanu , Jorma Rissanen

A new approach for signal parametrization, which consists of a specific regression model incorporating a discrete hidden logistic process, is proposed. The model parameters are estimated by the maximum likelihood method performed by a…

Methodology · Statistics 2013-12-30 Faicel Chamroukhi , Allou Samé , Gérard Govaert , Patrice Aknin

We present both offline and online maximum likelihood estimation (MLE) techniques for inferring the static parameters of a multiple target tracking (MTT) model with linear Gaussian dynamics. We present the batch and online versions of the…

Applications · Statistics 2014-10-09 Sinan Yildirim , Lan Jiang , Sumeetpal S. Singh , Tom Dean

For latent class models where the class weights depend on individual covariates, we derive a simple expression for computing the score vector and a convenient hybrid between the observed and the expected information matrices which is always…

Computation · Statistics 2015-11-13 Antonio Forcina

Expectation Maximization (EM) algorithm is a parameter estimation method from incomplete observations. In this paper, an implementation of this method to the calibration of HKS spectrometer at Jefferson Lab is described. We show that the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Lulin Yuan

We present a computational motivation for restricted maximum likelihood (REML) estimation in linear mixed models using an expectation--maximization (EM) algorithm. At each iteration, maximum likelihood (ML) and REML solve the same…

Computation · Statistics 2026-02-11 Andrew T. Karl

We study a scenario where a group of agents, each with multiple heterogeneous sensors are collecting measurements of a vehicle and the measurements are transmitted over a communication channel to a centralized node for processing. The…

Systems and Control · Electrical Eng. & Systems 2021-04-21 Matthew R. Kirchner , João P. Hespanha , Denis Garagić

We consider approximate maximum likelihood parameter estimation in nonlinear state-space models. We discuss both direct optimization of the likelihood and expectation--maximization (EM). For EM, we also give closed-form expressions for the…

Methodology · Statistics 2015-11-03 Juho Kokkala , Arno Solin , Simo Särkkä