English
Related papers

Related papers: Fast and Efficient Implementation of the Maximum L…

200 papers

Background: Advanced methods for causal inference, such as targeted maximum likelihood estimation (TMLE), require certain conditions for statistical inference. However, in situations where there is not differentiability due to data sparsity…

The idea of maximizing the likelihood of the observed range for a set of jointly realized counts has been employed in a variety of contexts. The applicability of the MLE introduced in [1] has been extended to the general case of a…

Statistics Theory · Mathematics 2011-11-18 Plamen Markov

This paper rigorously establishes that the existence of the maximum likelihood estimate (MLE) in high-dimensional logistic regression models with Gaussian covariates undergoes a sharp `phase transition'. We introduce an explicit boundary…

Methodology · Statistics 2018-04-27 Emmanuel J. Candes , Pragya Sur

We analyze the problem of maximum likelihood estimation for Gaussian distributions that are multivariate totally positive of order two (MTP2). By exploiting connections to phylogenetics and single-linkage clustering, we give a simple proof…

Methodology · Statistics 2018-05-29 Steffen Lauritzen , Caroline Uhler , Piotr Zwiernik

Longitudinal data are essential for studying within subject change and between subject differences in change. However, missing data, especially when the observed variables are nonnormal, remain a significant challenge in longitudinal…

Methodology · Statistics 2025-04-21 Dandan Tang , Xin Tong , Jianhui Zhou

Robust matrix completion (RMC) is a widely used machine learning tool that simultaneously tackles two critical issues in low-rank data analysis: missing data entries and extreme outliers. This paper proposes a novel scalable and learnable…

Machine Learning · Computer Science 2026-05-22 HanQin Cai , Chandra Kundu , Jialin Liu , Wotao Yin

We develop Distributionally Robust Optimization (DRO) formulations for Multivariate Linear Regression (MLR) and Multiclass Logistic Regression (MLG) when both the covariates and responses/labels may be contaminated by outliers. The DRO…

Machine Learning · Statistics 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

Motivated by single-particle cryo-electron microscopy, multi-reference alignment (MRA) models the task of recovering an unknown signal from multiple noisy observations corrupted by random rotations. The standard approach,…

Signal Processing · Electrical Eng. & Systems 2026-01-09 Shay Kreymer , Amnon Balanov , Tamir Bendory

This work addresses the problem of estimating the parameters of the general half-normal distribution. Namely, the problem of determining the minimum risk equi\-va\-riant (MRE) estimators of the parameters is explored. Simulation studies are…

Methodology · Statistics 2021-10-28 A. G. Nogales , P. Pérez , P. Monfort

We investigate the application of the conventional quasi-steady state maser modelling algorithm of Menegozzi & Lamb (ML) to the high field transient regime of the one-dimensional Maxwell-Bloch (MB) equations for a velocity distribution of…

Instrumentation and Methods for Astrophysics · Physics 2021-08-04 C. M. Wyenberg , B. Lankhaar , F. Rajabi , M. A. Chama , M. Houde

We develop a maximum-likelihood based method for regression in a setting where the dependent variable is a random graph and covariates are available on a graph-level. The model generalizes the well-known $\beta$-model for random graphs by…

Methodology · Statistics 2017-05-24 Johan Wahlström , Isaac Skog , Patricio S. La Rosa , Peter Händel , Arye Nehorai

We propose a novel targeted maximum likelihood estimator (TMLE) for quantiles in semiparametric missing data models. Our proposed estimator is locally efficient, $\sqrt{n}$-consistent, asymptotically normal, and doubly robust, under…

Methodology · Statistics 2016-08-23 Iván Díaz

Variational Bayes (VB) is a popular tool for Bayesian inference in statistical modeling. Recently, some VB algorithms are proposed to handle intractable likelihoods with applications such as approximate Bayesian computation. In this paper,…

Numerical Analysis · Mathematics 2021-09-28 Zhijian He , Zhenghang Xu , Xiaoqun Wang

Mixture of Experts (MoE) are successful models for modeling heterogeneous data in many statistical learning problems including regression, clustering and classification. Generally fitted by maximum likelihood estimation via the well-known…

Machine Learning · Statistics 2018-10-30 Faicel Chamroukhi , Bao-Tuyen Huynh

We study fast algorithms for statistical regression problems under the strong contamination model, where the goal is to approximately optimize a generalized linear model (GLM) given adversarially corrupted samples. Prior works in this line…

Data Structures and Algorithms · Computer Science 2021-06-23 Arun Jambulapati , Jerry Li , Tselil Schramm , Kevin Tian

Mixed linear regression (MLR) has attracted increasing attention because of its great theoretical and practical importance in capturing nonlinear relationships by utilizing a mixture of linear regression sub-models. Although considerable…

Machine Learning · Statistics 2025-03-25 Yujing Liu , Zhixin Liu , Lei Guo

The problem of estimating the parameters of a moving target in multiple-input multiple-output (MIMO) radar is considered and a new approach for estimating the moving target parameters by making use of the phase information associated with…

Information Theory · Computer Science 2015-06-04 Aboulnasr Hassanien , Sergiy A. Vorobyov , Alex B. Gershman

A new likelihood based AR approximation is given for ARMA models. The usual algorithms for the computation of the likelihood of an ARMA model require $O(n)$ flops per function evaluation. Using our new approximation, an algorithm is…

Statistics Theory · Mathematics 2016-11-04 A. Ian McLeod , Ying Zhang

The analytic characterization of the high-dimensional behavior of optimization for Generalized Linear Models (GLMs) with Gaussian data has been a central focus in statistics and probability in recent years. While convex cases, such as the…

Machine Learning · Statistics 2026-01-13 Matteo Vilucchio , Yatin Dandi , Matéo Pirio Rossignol , Cedric Gerbelot , Florent Krzakala

Uncertainty is ubiquitous in real-world data, and the assumptions underlying classical linear regression models are often violated in practice. Inspired by the theory of sublinear expectation, we consider a linear regression model where the…

Statistics Theory · Mathematics 2026-04-28 Xifeng Li , Shuzhen Yang