English
Related papers

Related papers: Maximum-Likelihood Non-Decreasing Response Estimat…

200 papers

We propose and study properties of maximum likelihood estimators in the class of conditional transformation models. Based on a suitable explicit parameterisation of the unconditional or conditional transformation function, we establish a…

Methodology · Statistics 2019-10-22 Torsten Hothorn , Lisa Möst , Peter Bühlmann

We study mixture of linear regression (random coefficient) models, which capture population heterogeneity by allowing the regression coefficients to follow an unknown distribution $G^*$. In contrast to common parametric methods that fix the…

Methodology · Statistics 2025-07-01 Hansheng Jiang , Adityanand Guntuboyina

The advent of data science has spurred interest in estimating properties of distributions over large alphabets. Fundamental symmetric properties such as support size, support coverage, entropy, and proximity to uniformity, received most…

Information Theory · Computer Science 2016-11-29 Jayadev Acharya , Hirakendu Das , Alon Orlitsky , Ananda Theertha Suresh

We propose an efficient algorithm for approximate computation of the profile maximum likelihood (PML), a variant of maximum likelihood maximizing the probability of observing a sufficient statistic rather than the empirical sample. The PML…

Machine Learning · Computer Science 2017-12-21 Dmitri S. Pavlichin , Jiantao Jiao , Tsachy Weissman

In this paper, we study a popular method for inference of the Bradley-Terry model parameters, namely the MM algorithm, for maximum likelihood estimation and maximum a posteriori probability estimation. This class of models includes the…

Machine Learning · Statistics 2020-12-29 Milan Vojnovic , Seyoung Yun , Kaifang Zhou

In the Bradley-Terry model for paired comparisons, and its extensions to include order effects and ties, the maximum likelihood estimates of probabilities of certain outcomes can be 0 or 1 under certain data configurations. This poses…

Statistics Theory · Mathematics 2007-06-13 Kenneth Butler , John T. Whelan

Accelerated algorithms for maximum likelihood image reconstruction are essential for emerging applications such as 3D tomography, dynamic tomographic imaging, and other high dimensional inverse problems. In this paper, we introduce and…

Computation · Statistics 2012-01-31 Stéphane Chrétien , Alfred O. Hero

In real life, we frequently come across data sets that involve some independent explanatory variable(s) generating a set of ordinal responses. These ordinal responses may correspond to an underlying continuous latent variable, which is…

Methodology · Statistics 2024-01-08 Arijit Pyne , Subhrajyoty Roy , Abhik Ghosh , Ayanendranath Basu

Mixture models are regularly used in density estimation applications, but the problem of estimating the mixing distribution remains a challenge. Nonparametric maximum likelihood produce estimates of the mixing distribution that are…

Computation · Statistics 2019-06-28 Minwoo Chae , Ryan Martin , Stephen G. Walker

We consider the distribution of the sum and the maximum of a collection of independent exponentially distributed random variables. The focus is laid on the explicit form of the density functions (pdf) of non-i.i.d. sequences. Those are…

Probability · Mathematics 2013-07-16 Markus Bibinger

In this paper, we propose a maximum smoothed likelihood method to estimate the component density functions of mixture models, in which the mixing proportions are known and may differ among observations. The proposed estimates maximize a…

Methodology · Statistics 2014-07-14 Tao Yu , Pengfei Li , Jing Qin

In this brief note, we consider estimation of the bitwise combination $x_1 \lor \dots \lor x_n = \max_i x_i$ observing a set of noisy bits $\tilde x_i \in \{0, 1\}$ that represent the true, unobserved bits $x_i \in \{0, 1\}$ under…

Methodology · Statistics 2023-06-19 Jonathan Hehir

We present new results for consistency of maximum likelihood estimators with a focus on multivariate mixed models. Our theory builds on the idea of using subsets of the full data to establish consistency of estimators based on the full…

Statistics Theory · Mathematics 2019-02-13 Karl Oskar Ekvall , Galin L. Jones

We propose a new method for multivariate response regression and covariance estimation when elements of the response vector are of mixed types, for example some continuous and some discrete. Our method is based on a model which assumes the…

Methodology · Statistics 2022-03-04 Karl Oskar Ekvall , Aaron J. Molstad

This paper develops a unified estimation framework, the Maximum Ideal Likelihood Estimation (MILE), for general parametric models with latent variables. Unlike traditional approaches relying on the marginal likelihood of the observed data,…

Statistics Theory · Mathematics 2025-10-08 Yizhou Cai , Ting Fung Ma

We give a general proof of the strong consistency of the Maximum Likelihood Estimator for the case of independent non-identically distributed (i.n.i.d) data, assuming that the density functions of the random variables follow a particular…

Statistics Theory · Mathematics 2025-01-14 Ricardo Ferreira , Filipa Valdeira , Marta Guimarães , Cláudia Soares

The main approach to inference for multivariate extremes consists in approximating the joint upper tail of the observations by a parametric family arising in the limit for extreme events. The latter may be expressed in terms of…

Methodology · Statistics 2015-06-17 Raphaël Huser , Anthony C. Davison , Marc G. Genton

We consider maximum likelihood estimation of finite mixture of uniform distributions. We prove that maximum likelihood estimator is strongly consistent, if the scale parameters of the component uniform distributions are restricted from…

Statistics Theory · Mathematics 2007-06-13 Kentaro Tanaka , Akimichi Takemura

The traditional maximum likelihood estimator (MLE) is often of limited use in complex high-dimensional data due to the intractability of the underlying likelihood function. Maximum composite likelihood estimation (McLE) avoids full…

Methodology · Statistics 2015-02-18 Davide Ferrari , Guoqi Qian

We consider a semiparametric mixture of two univariate density functions where one of them is known while the weight and the other function are unknown. Such mixtures have a history of application to the problem of detecting differentially…

Statistics Theory · Mathematics 2017-08-01 Zhou Shen , Michael Levine , Zuofeng Shang