English
Related papers

Related papers: Maximum Likelihood Estimator for Hidden Markov Mod…

200 papers

We address the problem of estimating the parameters of a time-homogeneous Markov chain given only noisy, aggregate data. This arises when a population of individuals behave independently according to a Markov chain, but individual sample…

Machine Learning · Computer Science 2016-04-15 Garrett Bernstein , Daniel Sheldon

This paper investigates the asymptotic distribution of the maximum-likelihood estimate (MLE) in multinomial logistic models in the high-dimensional regime where dimension and sample size are of the same order. While classical large-sample…

Statistics Theory · Mathematics 2023-05-30 Kai Tan , Pierre C. Bellec

Identifying important features linked to a response variable is a fundamental task in various scientific domains. This article explores statistical inference for simulated Markov random fields in high-dimensional settings. We introduce a…

Machine Learning · Statistics 2024-01-23 Haoyu Wei , Xiaoyu Lei , Yixin Han , Huiming Zhang

Anomaly estimation, or the problem of finding a subset of a dataset that differs from the rest of the dataset, is a classic problem in machine learning and data mining. In both theoretical work and in applications, the anomaly is assumed to…

Machine Learning · Computer Science 2021-06-14 Uthsav Chitra , Kimberly Ding , Jasper C. H. Lee , Benjamin J. Raphael

The method of maximum likelihood estimation (MLE) is a widely used statistical approach for estimating the values of one or more unknown parameters of a probabilistic model based on observed data. In this tutorial, I briefly review the…

Data Analysis, Statistics and Probability · Physics 2018-12-03 Anthony Vella

We consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The data are assumed to be generated by a true MLP model and the estimation of the parameters of the MLP is done by maximizing…

Statistics Theory · Mathematics 2010-12-01 Joseph Rynkiewicz

Multistate Markov models are a canonical parametric approach for data modeling of observed or latent stochastic processes supported on a finite state space. Continuous-time Markov processes describe data that are observed irregularly over…

Subsampling is a computationally effective approach to extract information from massive data sets when computing resources are limited. After a subsample is taken from the full data, most available methods use an inverse probability…

Statistics Theory · Mathematics 2022-10-11 HaiYing Wang , Jae Kwang Kim

We show that there is an intimate connection between the theory of nonparametric (smoothed) maximum likelihood estimators for certain inverse problems and integral equations. This is illustrated by estimators for interval censoring and…

Statistics Theory · Mathematics 2013-08-13 Piet Groeneboom

A famous characterization theorem due to C.F. Gauss states that the maximum likelihood estimator (MLE) of the parameter in a location family is the sample mean for all samples of all sample sizes if and only if the family is Gaussian. There…

Statistics Theory · Mathematics 2014-03-13 Mitia Duerinckx , Christophe Ley , Yvik Swan

We propose a method for obtaining maximum likelihood estimates (MLEs) of a Markov-Modulated Jump-Diffusion Model (MMJDM) when the data is a discrete time sample of the diffusion process, the jumps follow a Laplace distribution, and the…

Mathematical Finance · Quantitative Finance 2022-12-01 Laura Eslava , Fernando Baltazar-Larios , Bor Reynoso

The normality assumption on data set is very restrictive approach for modelling. The generalized form of normal distribution, named as an exponential power (EP) distribution, and its scale mixture form have been considered extensively to…

Statistics Theory · Mathematics 2017-07-20 Mehmet Niyazi Cankaya , Olcay Arslan

The behavior of maximum likelihood estimates (MLEs) and the likelihood ratio statistic in a family of problems involving pointwise nonparametric estimation of a monotone function is studied. This class of problems differs radically from the…

Statistics Theory · Mathematics 2009-09-29 Moulinath Banerjee

We study asymptotic properties of the Generalized Langevin Equation (GLE) in the presence of a wide class of external potential wells with a power-law decay memory kernel. When the memory can be expressed as a sum of exponentials, a class…

Probability · Mathematics 2021-03-10 Hung D. Nguyen

We study approximate maximum likelihood estimators (MLEs) for the parameters of the widely used Heston stock and volatility stochastic differential equations (SDEs). We compute explicit closed form estimators maximizing the discretized…

Probability · Mathematics 2015-06-19 Robert Azencott , Yutheeka Gadhyan

We can directly sample from the conditional distribution of any log-affine model. The algorithm is a Markov chain on a bounded integer lattice, and its transition probability is the ratio of the UMVUE (uniformly minimum variance unbiased…

Statistics Theory · Mathematics 2025-11-26 Shuhei Mano

We present new results for consistency of maximum likelihood estimators with a focus on multivariate mixed models. Our theory builds on the idea of using subsets of the full data to establish consistency of estimators based on the full…

Statistics Theory · Mathematics 2019-02-13 Karl Oskar Ekvall , Galin L. Jones

Models with multiple change points are used in many fields; however, the theoretical properties of maximum likelihood estimators of such models have received relatively little attention. The goal of this paper is to establish the asymptotic…

Statistics Theory · Mathematics 2011-02-28 Heping He , Thomas A. Severini

We study asymptotic behavior of maximum likelihood estimator for a time inhomogeneous diffusion process given by a SDE $dX_t=\alpha b(t)X_t dt + \sigma(t) dB_t$, $t\in[0,T)$, with a parameter $\alpha\in R$, where $T\in(0,\infty]$ and…

Statistics Theory · Mathematics 2010-05-25 Matyas Barczy , Gyula Pap

Distributed statistical inference has recently attracted immense attention. The asymptotic efficiency of the maximum likelihood estimator (MLE), the one-step MLE, and the aggregated estimating equation estimator are established for…

Methodology · Statistics 2020-08-14 Ping Zhou , Zhen Yu , Jingyi Ma , Maozai Tian , Ye Fan