English
Related papers

Related papers: New closed-form estimators for discrete distributi…

200 papers

We propose a general methodology for the construction and analysis of minimax estimators for a wide class of functionals of finite dimensional parameters, and elaborate on the case of discrete distributions, where the alphabet size $S$ is…

Information Theory · Computer Science 2015-03-11 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

In this paper we consider the problem of computing the likelihood of the profile of a discrete distribution, i.e., the probability of observing the multiset of element frequencies, and computing a profile maximum likelihood (PML)…

Data Structures and Algorithms · Computer Science 2020-04-07 Nima Anari , Moses Charikar , Kirankumar Shiragur , Aaron Sidford

In $M$-estimation under standard asymptotics, the weak convergence combined with the polynomial type large deviation estimate of the associated statistical random field Yoshida (2011) provides us with not only the asymptotic distribution of…

Statistics Theory · Mathematics 2017-04-18 Hiroki Masuda , Yusuke Shimizu

Maximum Likelihood Estimators (MLE) has many good properties. For example, the asymptotic variance of MLE solution attains equality of the asymptotic Cram{\'e}r-Rao lower bound (efficiency bound), which is the minimum possible variance for…

Machine Learning · Statistics 2019-11-05 Song Liu , Takafumi Kanamori , Wittawat Jitkrittum , Yu Chen

We study the parameter estimation method for linear regression models with possibly skewed stable distributed errors. Our estimation procedure consists of two stages: first, for the regression coefficients, the Cauchy quasi-maximum…

Statistics Theory · Mathematics 2025-06-25 Eitaro Kawamo , Hiroki Masuda

Given a statistical model, we propose a novel estimation method that yields randomised estimators for the unknown distribution of an observed random variable. We establish non-asymptotic bounds for the performance of these estimators and…

Statistics Theory · Mathematics 2026-05-06 Yannick Baraud

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

Statistics Theory · Mathematics 2019-06-26 Matthew J. Holland

In this paper we propose a new method of estimation for discrete choice demand models when individual level data are available. The method employs a two-step procedure. Step 1 predicts the choice probabilities as functions of the observed…

Applications · Statistics 2020-10-19 Nick Doudchenko , Evgeni Drynkin

We derive Stein approximation bounds for functionals of uniform random variables, using chaos expansions and the Clark-Ocone representation formula combined with derivation and finite difference operators. This approach covers sums and…

Probability · Mathematics 2018-02-28 Nicolas Privault , Grzegorz Serafin

We develop a method to approximate the moments of a discrete-time stochastic polynomial system. Our method is built upon Carleman linearization with truncation. Specifically, we take a stochastic polynomial system with finitely many states…

Systems and Control · Electrical Eng. & Systems 2023-07-11 Sasinee Pruekprasert , Jérémy Dubut , Toru Takisaka , Clovis Eberhart , Ahmet Cetinkaya

Moment-closure approximations are an important tool in the analysis of the dynamics on both static and adaptive networks. Here, we provide a broad survey over different approximation schemes by applying each of them to the adaptive voter…

Adaptation and Self-Organizing Systems · Physics 2012-11-05 G. Demirel , F. Vazquez , G. A. Böhme , T. Gross

We introduce a version of Stein's method of comparison of operators specifically tailored to the problem of bounding the Wasserstein-1 distance between continuous and discrete distributions on the real line. Our approach rests on a new…

Probability · Mathematics 2023-11-03 Gilles Germain , Yvik Swan

This paper proposes minimum sliced distance estimation in structural econometric models with possibly parameter-dependent supports. In contrast to likelihood-based estimation, we show that under mild regularity conditions, the minimum…

Econometrics · Economics 2024-12-10 Yanqin Fan , Hyeonseok Park

The problem of parameter estimation by observations of inhomogeneous Poisson processes is considered. The method of moments estimator is studied and its stochastic expansion is obtained. This stochastic expansion is then used to obtain the…

Statistics Theory · Mathematics 2020-10-16 O. V. Chernoyarov , A. S. Dabye , F. N. Diop , Yu. A. Kutoyants

For the univariate current status and, more generally, the interval censoring model, distribution theory has been developed for the maximum likelihood estimator (MLE) and smoothed maximum likelihood estimator (SMLE) of the unknown…

Statistics Theory · Mathematics 2013-06-18 Piet Groeneboom

We study the problem of parameter estimation for discretely observed stochastic differential equations driven by small fractional noise. Under some conditions, we obtain strong consistency and rate of convergence of the least square…

Statistics Theory · Mathematics 2022-01-24 S. Nakajima , S. Nakamura , Y. Shimizu

In this paper, a new method based on probability generating functions is used to obtain multiple Stein operators for various random variables closely related to Poisson, binomial and negative binomial distributions. Also, Stein operators…

Probability · Mathematics 2016-05-10 N. S. Upadhye , V. Cekanavicius , P. Vellaisamy

We obtain explicit error bounds for the $d$-dimensional normal approximation on hyperrectangles for a random vector that has a Stein kernel, or admits an exchangeable pair coupling, or is a non-linear statistic of independent random…

Probability · Mathematics 2020-09-08 Xiao Fang , Yuta Koike

In this work, we revisit the estimation of the model parameters of a Weibull distribution based on iid observations, using the maximum likelihood estimation (MLE) method which does not yield closed expressions of the estimators. Among other…

Computation · Statistics 2025-01-22 Buu-Chau Truong , Peter Mphekgwana , Nabendu Pal

The present paper considers modified extension of the exponential distribution with three parameters. We study the main properties of this new distribution, with special emphasis on its median, mode and moments function and some…

Other Statistics · Statistics 2015-10-28 M. A. El-Damcese , Dina. A. Ramadan