English
Related papers

Related papers: Maximum likelihood estimation in the sparse Rasch …

200 papers

A central issue of many statistical learning problems is to select an appropriate model from a set of candidate models. Large models tend to inflate the variance (or overfitting), while small models tend to cause biases (or underfitting)…

Statistics Theory · Mathematics 2020-12-25 Jie Ding , Enmao Diao , Jiawei Zhou , Vahid Tarokh

Targeted maximum likelihood estimation is a general methodology combining flexible ensemble learning and semiparametric efficiency theory in a two-step procedure for estimation of causal parameters. Proposed targeted maximum likelihood…

Methodology · Statistics 2021-06-22 Helene Charlotte Wiese Rytgaard , Frank Eriksson , Mark van der Laan

This paper considers an extension of the multivariate symmetric Laplace distribution to matrix variate case. The symmetric Laplace distribution is a scale mixture of normal distribution. The maximum likelihood estimators (MLE) of the…

Statistics Theory · Mathematics 2025-09-18 Pooja Yadav , Tanuja Srivastava

This paper introduces a unified framework for the detection of a source with a sensor array in the context where the noise variance and the channel between the source and the sensors are unknown at the receiver. The Generalized Maximum…

Probability · Mathematics 2010-06-16 Pascal Bianchi , Merouane Debbah , Mylène Maïda , Jamal Najim

Bogdan et al. established a new criterion to determine the existence of a maximum likelihood estimator in discrete exponential families. It uses the notion of the set of uniqueness, which allows to apply the problem to the Ising model from…

Statistics Theory · Mathematics 2025-11-27 Tomasz Skalski , Tomasz Stroiński

The Laplace approximation (LA) has been proposed as a method for approximating the marginal likelihood of statistical models with latent variables. However, the approximate maximum likelihood estimators (MLEs) based on the LA are often…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee

We consider the problem of parameter estimation for a stochastic McKean-Vlasov equation, and the associated system of weakly interacting particles. We study two cases: one in which we observe multiple independent trajectories of the…

Statistics Theory · Mathematics 2022-11-28 Louis Sharrock , Nikolas Kantas , Panos Parpas , Grigorios A. Pavliotis

We revisit the problem of mean estimation in the Gaussian sequence model with $\ell_p$ constraints for $p \in [0, \infty]$. We demonstrate two phenomena for the behavior of the maximum likelihood estimator (MLE), which depend on the noise…

Statistics Theory · Mathematics 2025-07-02 Liviu Aolaritei , Michael I. Jordan , Reese Pathak , Annie Ulichney

Abundance estimation from capture-recapture data is of great importance in many disciplines. Analysis of capture-recapture data is often complicated by the existence of one-inflation and heterogeneity problems. Simultaneously taking these…

Methodology · Statistics 2025-07-15 Yang Liu , Pengfei Li , Yukun Liu , Riquan Zhang

Large Language Models (LLMs) have shown impressive abilities in many applications. When a concrete and precise answer is desired, it is important to have a quantitative estimation of the potential error rate. However, this can be…

Computation and Language · Computer Science 2024-12-20 Theodore Zhao , Mu Wei , J. Samuel Preston , Hoifung Poon

Frequently one has to search within a finite population for a single particular individual or item with a rare characteristic. Whether an item possesses the characteristic can only be determined by close inspection. The availability of…

Probability · Mathematics 2013-10-23 André J. Hoogstrate , Chris A. J. Klaassen

Inspired by applications to theories of coding and communication in networks of nervous tissue, we study maximum entropy distributions on weighted graphs with a given expected degree sequence. These distributions are characterized by…

Statistics Theory · Mathematics 2018-12-18 Christopher Hillar , Andre Wibisono

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtaining robust parameter estimates. We modify the standard likelihood equations by incorporating a weight that reflects the statistical…

Statistics Theory · Mathematics 2025-07-24 Claudio Agostinelli , Ayanendranath Basu , Giulia Bertagnolli , Arun Kumar Kuchibhotla

If the log likelihood is approximately quadratic with constant Hessian, then the maximum likelihood estimator (MLE) is approximately normally distributed. No other assumptions are required. We do not need independent and identically…

Statistics Theory · Mathematics 2012-07-06 Charles J. Geyer

We develop and analyze methods for computing provably optimal {\em maximum a posteriori} (MAP) configurations for a subclass of Markov random fields defined on graphs with cycles. By decomposing the original distribution into a convex…

Information Theory · Computer Science 2007-07-13 Martin J. Wainwright , Tommi S. Jaakkola , Alan S. Willsky

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

Statistics Theory · Mathematics 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

This paper considers the maximum likelihood estimation of factor models of high dimension, where the number of variables (N) is comparable with or even greater than the number of observations (T). An inferential theory is developed. We…

Statistics Theory · Mathematics 2012-05-31 Jushan Bai , Kunpeng Li

Recommendations based on behavioral data may be faced with ambiguous statistical evidence. We consider the case of association rules, relevant e.g.~for query and product recommendations. For example: Suppose that a customer belongs to…

Databases · Computer Science 2015-01-12 Rasmus Pagh , Morten Stöckel

Online planning in Markov Decision Processes (MDPs) enables agents to make sequential decisions by simulating future trajectories from the current state, making it well-suited for large-scale or dynamic environments. Sample-based methods…

Artificial Intelligence · Computer Science 2025-09-22 Tamir Shazman , Idan Lev-Yehudi , Ron Benchetit , Vadim Indelman

New experimental methods make it possible to measure the expression levels of many genes, simultaneously, in snapshots from thousands or even millions of individual cells. Current approaches to analyze these experiments involve clustering…