English
Related papers

Related papers: Maximum Likelihood Estimator for Hidden Markov Mod…

200 papers

Let $(Y_k)_{k\in \mathbb{Z}}$ be a stationary sequence on a probability space $(\Omega,\mathcal{A},\mathbb{P})$ taking values in a standard Borel space $\mathsf{Y}$. Consider the associated maximum likelihood estimator with respect to a…

Statistics Theory · Mathematics 2013-02-19 Randal Douc , Eric Moulines

We consider the problem of identifying parameters of a particular class of Markov chains, called Bernoulli Autoregressive (BAR) processes. The structure of any BAR model is encoded by a directed graph. Incoming edges to a node in the graph…

Statistics Theory · Mathematics 2020-10-20 Xiaotian Xie , Dimitrios Katselis , Carolyn L. Beck , R. Srikant

The Latent Block Model (LBM) is a model-based method to cluster simultaneously the $d$ columns and $n$ rows of a data matrix. Parameter estimation in LBM is a difficult and multifaceted problem. Although various estimation strategies have…

Statistics Theory · Mathematics 2020-02-26 Vincent Brault , Christine Keribin , Mahendra Mariadassou

The aim of this paper is to study the asymptotic properties of the maximum likelihood estimator (MLE) of the drift coefficient for fractional stochastic heat equation driven by an additive space-time noise. We consider the traditional for…

Probability · Mathematics 2019-04-25 Igor Cialenco , Francisco Delgado-Vences , Hyun-Jung Kim

This work studies the properties of the maximum likelihood estimator (MLE) of a non-linear model with Gaussian errors and multidimensional parameter. The observations are collected in a two-stage experimental design and are dependent since…

Statistics Theory · Mathematics 2019-11-01 Nancy Flournoy , Caterina May , Chiara Tommasi

Maximum Likelihood Estimators (MLE) has many good properties. For example, the asymptotic variance of MLE solution attains equality of the asymptotic Cram{\'e}r-Rao lower bound (efficiency bound), which is the minimum possible variance for…

Machine Learning · Statistics 2019-11-05 Song Liu , Takafumi Kanamori , Wittawat Jitkrittum , Yu Chen

The problem of parameter estimation by the observations of the two-state telegraph process in the presence of white Gaussian noise is considered. The properties of estimator of the method of moments are described in the asymptotics of large…

Statistics Theory · Mathematics 2015-09-10 Rafail Khasminskii , Yury Kutoyants

This paper considers an extension of the multivariate symmetric Laplace distribution to matrix variate case. The symmetric Laplace distribution is a scale mixture of normal distribution. The maximum likelihood estimators (MLE) of the…

Statistics Theory · Mathematics 2025-09-18 Pooja Yadav , Tanuja Srivastava

In a finite mixture of location-scale distributions maximum likelihood estimator does not exist because of the unboundedness of the likelihood function when the scale parameter of some mixture component approaches zero. In order to study…

Statistics Theory · Mathematics 2007-06-13 Kentaro Tanaka , Akimichi Takemura

The extreme value index is a fundamental parameter in univariate Extreme Value Theory (EVT). It captures the tail behavior of a distribution and is central in the extrapolation beyond observed data. Among other semi-parametric methods (such…

Statistics Theory · Mathematics 2017-05-02 Clément Dombry , Ana Ferreira

Maximum likelihood estimation has been extensively used in the joint analysis of repeated measurements and survival time. However, there is a lack of theoretical justification of the asymptotic properties for the maximum likelihood…

Statistics Theory · Mathematics 2007-06-13 Donglin Zeng , Jianwen Cai

Maximum regularized likelihood estimators (MRLEs) are arguably the most established class of estimators in high-dimensional statistics. In this paper, we derive guarantees for MRLEs in Kullback-Leibler divergence, a general measure of…

Machine Learning · Statistics 2018-10-18 Rui Zhuang , Johannes Lederer

The asymptotic normality of the maximum likelihood estimator (MLE) under regularity conditions is a cornerstone of statistical theory. In this paper, we give explicit upper bounds on the distributional distance between the distribution of…

Statistics Theory · Mathematics 2018-07-23 Andreas Anastasiou

We study statistical inference for small-noise-perturbed multiscale dynamical systems. We prove consistency, asymptotic normality, and convergence of all scaled moments of an appropriately-constructed maximum likelihood estimator (MLE) for…

Probability · Mathematics 2016-06-16 Siragan Gailus , Konstantinos Spiliopoulos

In this paper we present a novel method for estimating the parameters of a parametric diffusion processes. Our approach is based on a closed-form Maximum Likelihood estimator for an approximating Continuous Time Markov Chain (CTMC) of the…

Methodology · Statistics 2021-08-31 J. L. Kirkby , Dang Nguyen , Duy Nguyen , Nhu Nguyen

It is well known that, under standard regularity conditions, the maximum likelihood estimator (MLE) satisfies a central limit theorem and converges in distribution to a Gaussian random variable as the sample size grows. This paper…

Information Theory · Computer Science 2026-05-26 Leighton P. Barnes , Alex Dytso

A major line of contemporary research on complex networks is based on the development of statistical models that specify the local motifs associated with macro-structural properties observed in actual networks. This statistical approach…

Methodology · Statistics 2018-08-02 Maksym Byshkin , Alex Stivala , Antonietta Mira , Garry Robins , Alessandro Lomi

Boltzmann machines (BMs) are a class of binary neural networks for which there have been numerous proposed methods of estimation. Recently, it has been shown that in the fully visible case of the BM, the method of maximum pseudolikelihood…

Computation · Statistics 2014-09-30 Hien D. Nguyen , Ian A. Wood

We prove the strong consistency and the asymptotic normality of the maximum likelihood estimator of the parameters of a general conditionally heteroscedastic model with $\alpha$-stable innovations. Then, we relax the assumptions and only…

Statistics Theory · Mathematics 2013-01-01 Guillaume Lepage

We study the maximum smoothed likelihood estimator (MSLE) for interval censoring, case 2, in the so-called separated case. Characterizations in terms of convex duality conditions are given and strong consistency is proved. Moreover, we show…

Statistics Theory · Mathematics 2014-10-16 Piet Groeneboom