English
Related papers

Related papers: Maximum Likelihood Estimator for Hidden Markov Mod…

200 papers

Theoretical guarantees are established for a standard estimator in a semi-parametric finite mixture model, where each component density is modeled as a product of univariate densities under a conditional independence assumption. The focus…

Statistics Theory · Mathematics 2025-11-07 Marie Du Roy de Chaumaray , Michael Levine , Matthieu Marbac

Nonparametric maximum likelihood estimators (MLEs) in inverse problems often have non-normal limit distributions, like Chernoff's distribution. However, if one considers smooth functionals of the model, with corresponding functionals of the…

Statistics Theory · Mathematics 2023-10-24 Piet Groeneboom

We prove the local asymptotic mixed normality (LAMN) property for a family of probability measures defined by parametrized diffusion processes with nonsynchronous observations. We assume that observation times of processes are independent…

Statistics Theory · Mathematics 2015-09-21 Teppei Ogihara

In the last decade, there has been a growing interest to use Wishart processes for modelling, especially for financial applications. However, there are still few studies on the estimation of its parameters. Here, we study the Maximum…

Statistics Theory · Mathematics 2016-04-18 Aurélien Alfonsi , Ahmed Kebaier , Clément Rey

Consider a setting with $N$ independent individuals, each with an unknown parameter, $p_i \in [0, 1]$ drawn from some unknown distribution $P^\star$. After observing the outcomes of $t$ independent Bernoulli trials, i.e., $X_i \sim…

Statistics Theory · Mathematics 2019-02-13 Ramya Korlakai Vinayak , Weihao Kong , Gregory Valiant , Sham M. Kakade

The existence and consistency of a maximum likelihood estimator for the joint probability distribution of random parameters in discrete-time abstract parabolic systems are established by taking a nonparametric approach in the context of a…

Methodology · Statistics 2023-04-26 Lernik Asserian , Susan E. Luczak , I. G. Rosen

We propose an inferential approach for maximum likelihood estimation of the hidden Markov models for continuous responses. We extend to the case of longitudinal observations the finite mixture model of multivariate Gaussian distributions…

Methodology · Statistics 2021-07-01 Silvia Pandolfi , Francesco Bartolucci , Fulvia Pennoni

The idea of maximizing the likelihood of the observed range for a set of jointly realized counts has been employed in a variety of contexts. The applicability of the MLE introduced in [1] has been extended to the general case of a…

Statistics Theory · Mathematics 2011-11-18 Plamen Markov

In this paper non-asymptotic exact exponential estimates are derived (under minimal conditions) for the tail of deviation of the MLE distribution in the so-called natural terms: natural function, natural distance, metric entropy, Banach…

Probability · Mathematics 2009-03-25 E. Ostrovsky , E. Rogover

In this paper, we study the nonparametric maximum likelihood estimator (MLE) of a convex hazard function. We show that the MLE is consistent and converges at a local rate of $n^{2/5}$ at points $x_0$ where the true hazard function is…

Statistics Theory · Mathematics 2010-01-14 Hanna K. Jankowski , Jon A. Wellner

Asymptotic efficiency of targeted maximum likelihood estimators (TMLE) of target features of the data distribution relies on a a second order remainder being asymptotically negligible. In previous work we proposed a nonparametric MLE termed…

Statistics Theory · Mathematics 2021-07-02 Mark van der Laan , Zeyi Wang , Lars van der Laan

The Hidden Markov Model (HMM) is one of the mainstays of statistical modeling of discrete time series, with applications including speech recognition, computational biology, computer vision and econometrics. Estimating an HMM from its…

Machine Learning · Statistics 2015-12-29 Fanny Yang , Sivaraman Balakrishnan , Martin J. Wainwright

We study the maximum likelihood estimation (MLE) in the multivariate deviated model where the data are generated from the density function $(1-\lambda^{\ast})h_{0}(x)+\lambda^{\ast}f(x|\mu^{\ast}, \Sigma^{\ast})$ in which $h_{0}$ is a known…

Statistics Theory · Mathematics 2023-10-31 Dat Do , Huy Nguyen , Khai Nguyen , Nhat Ho

Maximum entropy models, motivated by applications in neuron science, are natural generalizations of the $\beta$-model to weighted graphs. Similar to the $\beta$-model, each vertex in maximum entropy models is assigned a potential parameter,…

Statistics Theory · Mathematics 2014-10-28 Ting Yan , Yunpeng Zhao , Hong Qin

A discrete statistical model is a subset of a probability simplex. Its maximum likelihood estimator (MLE) is a retraction from that simplex onto the model. We characterize all models for which this retraction is a rational function. This is…

Statistics Theory · Mathematics 2020-06-16 Eliana Duarte , Orlando Marigliano , Bernd Sturmfels

While the asymptotic normality of the maximum likelihood estimator under regularity conditions is long established, this paper derives explicit bounds for the bounded Wasserstein distance between the distribution of the maximum likelihood…

Statistics Theory · Mathematics 2016-09-29 Andreas Anastasiou , Gesine Reinert

We consider the problem of parameter estimation for a stochastic McKean-Vlasov equation, and the associated system of weakly interacting particles. We study two cases: one in which we observe multiple independent trajectories of the…

Statistics Theory · Mathematics 2022-11-28 Louis Sharrock , Nikolas Kantas , Panos Parpas , Grigorios A. Pavliotis

This paper considers the maximum likelihood estimation of factor models of high dimension, where the number of variables (N) is comparable with or even greater than the number of observations (T). An inferential theory is developed. We…

Statistics Theory · Mathematics 2012-05-31 Jushan Bai , Kunpeng Li

Estimating model parameters is a crucial step in mathematical modelling and typically involves minimizing the disagreement between model predictions and experimental data. This calibration data can change throughout a study, particularly if…

Quantitative Methods · Quantitative Biology 2023-11-03 Tyler Cassidy

This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization…

Signal Processing · Electrical Eng. & Systems 2021-10-26 Augusto Aubry , Prabhu Babu , Antonio De Maio , Rikhabchand Jyothi