English
Related papers

Related papers: Maximum Likelihood Estimation of Functionals of Di…

200 papers

This paper investigates the asymptotic distribution of the maximum-likelihood estimate (MLE) in multinomial logistic models in the high-dimensional regime where dimension and sample size are of the same order. While classical large-sample…

Statistics Theory · Mathematics 2023-05-30 Kai Tan , Pierre C. Bellec

We study the non-parametric estimation of the value ${\theta}(f )$ of a linear functional evaluated at an unknown density function f with support on $R_+$ based on an i.i.d. sample with multiplicative measurement errors. The proposed…

Statistics Theory · Mathematics 2021-12-01 Sergio Brenner Miguel , Fabienne Comte , Jan Johannes

We consider estimation of a functional parameter of a realistically modeled data distribution based on observing independent and identically distributed observations. We define an $m$-th order Spline Highly Adaptive Lasso Minimum Loss…

Statistics Theory · Mathematics 2021-07-05 Mark J. van der Laan , David Benkeser , Weixin Cai

We study shrinkage estimation of the mean parameters of a class of multivariate distributions for which the diagonal entries of the corresponding covariance matrix are certain quadratic functions of the mean parameter. This class of…

Statistics Theory · Mathematics 2022-07-04 Nikolas Siapoutis , Donald Richards , Bharath K. Sriperumbudur

In this work, we revisit the estimation of the model parameters of a Weibull distribution based on iid observations, using the maximum likelihood estimation (MLE) method which does not yield closed expressions of the estimators. Among other…

Computation · Statistics 2025-01-22 Buu-Chau Truong , Peter Mphekgwana , Nabendu Pal

To interpret differentially expressed genes or other discovered features, researchers conduct hypothesis tests to determine which biological categories such as those of the Gene Ontology (GO) are enriched in the sense of having differential…

Genomics · Quantitative Biology 2013-09-03 Zhenyu Yang , Zuojing Li , David R. Bickel

Concept of exponential family is generalized by simple and general exponential form. Simple and general potential are introduced. Maximum Entropy and Maximum Likelihood tasks are defined. ML task on the simple exponential form and ME task…

Statistics Theory · Mathematics 2019-08-17 Marian Grendar, , Marian Grendar

Estimating the matrix of connections probabilities is one of the key questions when studying sparse networks. In this work, we consider networks generated under the sparse graphon model and the in-homogeneous random graph model with missing…

Statistics Theory · Mathematics 2021-04-28 Solenne Gaucher , Olga Klopp

The method of maximum likelihood estimation (MLE) is a widely used statistical approach for estimating the values of one or more unknown parameters of a probabilistic model based on observed data. In this tutorial, I briefly review the…

Data Analysis, Statistics and Probability · Physics 2018-12-03 Anthony Vella

This paper continues our earlier investigations into the inversion of random functions in a general (abstract) setting. In Section 2 we investigate a concept of invertibility and the invertibility of the composition of random functions. In…

Probability · Mathematics 2007-05-23 Mike A. Steel , Laszlo A. Szekely

We consider distributed statistical optimization in one-shot setting, where there are $m$ machines each observing $n$ i.i.d. samples. Based on its observed samples, each machine sends a $B$-bit-long message to a server. The server then…

Machine Learning · Computer Science 2020-01-01 Saber Salehkaleybar , Arsalan Sharifnassab , S. Jamaloddin Golestani

Probabilistic values, including Shapley values and semivalues, provide a model-agnostic framework to attribute the behavior of a black-box model to data points or features, with a wide range of applications including explainable artificial…

Artificial Intelligence · Computer Science 2026-05-05 Ziqi Liu , Kiljae Lee , Yuan Zhang , Weijing Tang

In this paper, we consider distributed maximum likelihood estimation (MLE) with dependent quantized data under the assumption that the structure of the joint probability density function (pdf) is known, but it contains unknown deterministic…

Information Theory · Computer Science 2013-09-17 Xiaojing Shen , Pramod K. Varshney , Yunmin Zhu

In this paper, different strands of literature are combined in order to obtain algorithms for semi-parametric estimation of discrete choice models that include the modelling of unobserved heterogeneity by using mixing distributions for the…

Methodology · Statistics 2022-12-12 Dietmar Bauer , Sebastian Büscher , Manuel Batram

The parameter estimation of unnormalized models is a challenging problem. The maximum likelihood estimation (MLE) is computationally infeasible for these models since normalizing constants are not explicitly calculated. Although some…

Machine Learning · Statistics 2020-06-09 Masatoshi Uehara , Takafumi Kanamori , Takashi Takenouchi , Takeru Matsuda

This paper revisits the classical inference results for profile quasi maximum likelihood estimators (profile MLE) in the semiparametric estimation problem. We mainly focus on two prominent theorems: the Wilks phenomenon and Fisher expansion…

Statistics Theory · Mathematics 2014-06-18 Andreas Andresen , Vladimir Spokoiny

We analyze the problem of maximum likelihood estimation for Gaussian distributions that are multivariate totally positive of order two (MTP2). By exploiting connections to phylogenetics and single-linkage clustering, we give a simple proof…

Methodology · Statistics 2018-05-29 Steffen Lauritzen , Caroline Uhler , Piotr Zwiernik

The problem of estimating the Kullback-Leibler divergence $D(P\|Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the distributions can scale to infinity. The estimation is…

Information Theory · Computer Science 2018-02-22 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

Maximum likelihood estimators (MLE) and control variate estimators (CVE) have been used in conjunction with known information across sketching algorithms and applications in machine learning. We prove that under certain conditions in an…

Machine Learning · Statistics 2026-02-05 Keegan Kang , Kerong Wang , Ding Zhang , Rameshwar Pratap , Bhisham Dev Verma , Benedict H. W. Wong

We consider goodness-of-fit tests of symmetric stable distributions based on weighted integrals of the squared distance between the empirical characteristic function of the standardized data and the characteristic function of the standard…

Statistics Theory · Mathematics 2009-01-06 Muneya Matsui , Akimichi Takemura