English
Related papers

Related papers: Nonparametric maximum likelihood methods for binar…

200 papers

Misclassification of binary responses, if ignored, may severely bias the maximum likelihood estimators (MLE) of regression parameters. For such data, a binary regression model incorporating misclassification probabilities is extensively…

Statistics Theory · Mathematics 2020-09-28 Arindam Chatterjee , Tathagata Bandyopadhyay , Sumanta Adhya

Mixture models are regularly used in density estimation applications, but the problem of estimating the mixing distribution remains a challenge. Nonparametric maximum likelihood produce estimates of the mixing distribution that are…

Computation · Statistics 2019-06-28 Minwoo Chae , Ryan Martin , Stephen G. Walker

This paper introduces a high-dimensional binary variate model that accommodates nonstationary covariates and factors, and studies their asymptotic theory. This framework encompasses scenarios where single indices are nonstationary or…

Statistics Theory · Mathematics 2025-05-29 Xinbing Kong , Bin Wu , Wuyi Ye

We study the Nonparametric Maximum Likelihood Estimator (NPMLE) for estimating Gaussian location mixture densities in $d$-dimensions from independent observations. Unlike usual likelihood-based methods for fitting mixtures, NPMLEs are based…

Statistics Theory · Mathematics 2019-07-09 Sujayam Saha , Adityanand Guntuboyina

Nonparanormal models describe the joint distribution of multivariate responses via latent Gaussian, and thus parametric, copulae while allowing flexible nonparametric marginals. Some aspects of such distributions, for example conditional…

Methodology · Statistics 2025-12-16 Torsten Hothorn

The empirical Bayes $g$-modeling approach via the nonparametric maximum likelihood estimator (NPMLE) is widely used for large-scale estimation and inference in the normal means problem, yet theoretical guarantees for uncertainty…

Statistics Theory · Mathematics 2026-03-31 Taehyun Kim , Bodhisattva Sen

Numerical nonlinear algebra is applied to maximum likelihood estimation for Gaussian models defined by linear constraints on the covariance matrix. We examine the generic case as well as special models (e.g. Toeplitz, sparse, trees) that…

Computation · Statistics 2020-10-07 Bernd Sturmfels , Sascha Timme , Piotr Zwiernik

To avoid specification of the error distribution in a regression model, we propose a general nonparametric scale mixture model for the error distribution. For fitting such mixtures, the predictive recursion method is a simple and…

Methodology · Statistics 2015-09-03 Ryan Martin , Zhen Han

We propose an efficient algorithm for approximate computation of the profile maximum likelihood (PML), a variant of maximum likelihood maximizing the probability of observing a sufficient statistic rather than the empirical sample. The PML…

Machine Learning · Computer Science 2017-12-21 Dmitri S. Pavlichin , Jiantao Jiao , Tsachy Weissman

A new initialization method for hidden parameters in a neural network is proposed. Derived from the integral representation of the neural network, a nonparametric probability distribution of hidden parameters is introduced. In this…

Machine Learning · Computer Science 2014-02-20 Sho Sonoda , Noboru Murata

Determinantal Point Process (DPPs) are statistical models for repulsive point patterns. Both sampling and inference are tractable for DPPs, a rare feature among models with negative dependence that explains their popularity in machine…

Machine Learning · Computer Science 2021-11-30 Michaël Fanuel , Rémi Bardenet

In this work we consider data-driven optimization problems where one must maximize a function given only queries at a fixed set of points. This problem setting emerges in many domains where function evaluation is a complex and expensive…

Machine Learning · Computer Science 2021-02-17 Justin Fu , Sergey Levine

The nonparametric maximum likelihood estimator (NPMLE) in monotone binary regression models is studied when the impact of the features on the labels is weak. Here, weakness is colloquially understood as "close to flatness" of the…

Statistics Theory · Mathematics 2025-06-05 Dario Kieffer , Angelika Rohde

We show that there is an intimate connection between the theory of nonparametric (smoothed) maximum likelihood estimators for certain inverse problems and integral equations. This is illustrated by estimators for interval censoring and…

Statistics Theory · Mathematics 2013-08-13 Piet Groeneboom

In this article, we revisit the problem of fitting a mixture model under the assumption that the mixture components are symmetric and log-concave. To this end, we first study the nonparametric maximum likelihood estimation (NPMLE) of a…

Methodology · Statistics 2018-02-28 Xiao Pu , Ery Arias-Castro

In this paper we apply to gravitational waves from non-spinning binary systems a recently intro- duced frequentist methodology to calculate analytically the error for a maximum likelihood estimate (MLE) of physical parameters. While…

General Relativity and Quantum Cosmology · Physics 2011-02-02 Salvatore Vitale , Michele Zanolin

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

Let $x_{i,j}$, $1 \le i \le m$, $1 \le j \le n_i$, be observations from a doubly-indexed sequence $\{X_{i,j}\}$ of independent random variables (all of them discrete, or all of them absolutely continuous). Suppose that each $X_{i,j}$ has…

Statistics Theory · Mathematics 2011-07-07 Laurence Thomas Ramsey

In the uniform deconvolution problem one is interested in estimating the distribution function $F_0$ of a nonnegative random variable, based on a sample with additive uniform noise. A peculiar and not well understood phenomenon of the…

Statistics Theory · Mathematics 2025-04-25 Piet Groeneboom , Geurt Jongbloed

We extend the constrained maximum likelihood estimation theory for parameters of a completely identified model, proposed by Aitchison and Silvey (1958), to parameters arising from a partially identified model. With a partially identified…

Statistics Theory · Mathematics 2016-08-01 Hao Luo , Alexandre Bouchard-Côté , Gabriela Cohen Freue , Paul Gustafson