English
Related papers

Related papers: Asymptotic behavior of maximum likelihood estimato…

200 papers

We analyze the problem of discrete distribution estimation under $\ell_1$ loss. We provide non-asymptotic upper and lower bounds on the maximum risk of the empirical distribution (the maximum likelihood estimator), and the minimax risk in…

Information Theory · Computer Science 2015-12-31 Yanjun Han , Jiantao Jiao , Tsachy Weissman

We study sufficient conditions for local asymptotic mixed normality. We weaken the sufficient conditions in Theorem 1 of Jeganathan (Sankhya Ser. A 1982) so that they can be applied to a wider class of statistical models including a…

Statistics Theory · Mathematics 2021-05-04 Teppei Ogihara , Yuma Uehara

Maximum likelihood estimators for time-dependent mean functions within Gaussian processes are provided in the context of continuous observations. We find the widest possible class of mean functions for which the likelihood function can be…

Statistics Theory · Mathematics 2025-07-09 Mitsuki Kobayashi , Yuto Nishiwaki , Yasutaka Shimizu , Nobutoki Takaoka

We present new and improved non-asymptotic deviation bounds for Dirichlet processes (DPs), formulated using the Kullback-Leibler (KL) divergence, which is known for its optimal characterization of the asymptotic behavior of DPs. Our method…

Probability · Mathematics 2025-03-24 Pierre Perrault

For the univariate current status and, more generally, the interval censoring model, distribution theory has been developed for the maximum likelihood estimator (MLE) and smoothed maximum likelihood estimator (SMLE) of the unknown…

Statistics Theory · Mathematics 2013-06-18 Piet Groeneboom

Anomalous dynamics in which local perturbations spread faster than diffusion are ubiquitously observed in the long-time behavior of a wide variety of systems. Here, the manner by which such systems evolve towards their asymptotic…

Statistical Mechanics · Physics 2020-04-09 Asaf Miron

Delattre et al. (2013) considered a system of stochastic differential equations (SDEs) in a random effects setup. Under the independent and identical (iid) situation, and assuming normal distribution of the random effects, they established…

Statistics Theory · Mathematics 2020-05-04 Trisha Maitra , Sourabh Bhattacharya

We consider the problem of inference for nonlinear, multivariate diffusion processes, satisfying It\^o stochastic differential equations (SDEs), using data at discrete times that may be incomplete and subject to measurement error. Our…

Computation · Statistics 2021-09-27 Andrew Golightly , Chris Sherlock

We study statistical inference for small-noise-perturbed multiscale dynamical systems. We prove consistency, asymptotic normality, and convergence of all scaled moments of an appropriately-constructed maximum likelihood estimator (MLE) for…

Probability · Mathematics 2016-06-16 Siragan Gailus , Konstantinos Spiliopoulos

In this note, we propose a new approach for the proof of the consistency and normality of the maximum likelihood estimator for nonlinear AR processes with markov-switching under the assumptions of uniform exponential forgetting of the…

Statistics Theory · Mathematics 2016-06-01 Luis-Angel Rodríguez

For a given parametric probability model, we consider the risk of the maximum likelihood estimator with respect to $\alpha$-divergence, which includes the special cases of Kullback--Leibler divergence, the Hellinger distance and $\chi^2$…

Statistics Theory · Mathematics 2018-10-12 Yo Sheena

This paper concerns the use of the expectation-maximisation (EM) algorithm for inference in partially observed diffusion processes. In this context, a well known problem is that all except a few diffusion processes lack closed-form…

Statistics Theory · Mathematics 2010-08-18 Jimmy Olsson , Jonas Ströjby

We prove asymptotic normality of the so-called maximum likelihood estimator of the extreme value index.

Probability · Mathematics 2007-05-23 Holger Drees , Ana Ferreira , Laurens de Haan

We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable based on censored data. More specifically, the event time is subject to current status censoring and the continuous mark…

Statistics Theory · Mathematics 2011-09-07 Piet Groeneboom , Geurt Jongbloed , Birgit Witte

This paper investigates the {\em nonasymptotic} properties of Bayes procedures for estimating an unknown distribution from $n$ i.i.d.\ observations. We assume that the prior is supported by a model $(\scr{S},h)$ (where $h$ denotes the…

Statistics Theory · Mathematics 2014-11-03 Lucien Birgé

In this paper, we investigate the asymptotic behaviors of the survival probability and maximal displacement of a subcritical branching killed L\'{e}vy process $X$ in $\mathbb{R}$. Let $\zeta$ denote the extinction time, $M_t$ be the maximal…

Probability · Mathematics 2025-10-21 Yan-Xia Ren , Renming Song , Yaping Zhu

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

Machine Learning · Computer Science 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

The asymptotic normality of the Maximum Likelihood Estimator (MLE) is a long established result. Explicit bounds for the distributional distance between the distribution of the MLE and the normal distribution have recently been obtained for…

Statistics Theory · Mathematics 2016-09-20 Andreas Anastasiou

Boltzmann machines (BMs) are a class of binary neural networks for which there have been numerous proposed methods of estimation. Recently, it has been shown that in the fully visible case of the BM, the method of maximum pseudolikelihood…

Computation · Statistics 2014-09-30 Hien D. Nguyen , Ian A. Wood

This work aims at making a comprehensive contribution in the general area of parametric inference for discretely observed diffusion processes. Established approaches for likelihood-based estimation invoke a time-discretisation scheme for…

Methodology · Statistics 2024-01-30 Yuga Iguchi , Alexandros Beskos , Matthew M. Graham
‹ Prev 1 8 9 10 Next ›