English
Related papers

Related papers: Multinomial Logistic Regression: Asymptotic Normal…

200 papers

We give a thorough description of the asymptotic property of the maximum likelihood estimator (MLE) of the skewness parameter of a Skew Brownian Motion (SBM). Thanks to recent results on the Central Limit Theorem of the rate of convergence…

Statistics Theory · Mathematics 2023-02-07 Antoine Lejay , Sara Mazzonetto

Maximum-likelihood estimation (MLE) is widely used in sequence to sequence tasks for model training. It uniformly treats the generation/prediction of each target token as multi-class classification, and yields non-smooth prediction…

Computation and Language · Computer Science 2018-12-13 Chengyue Gong , Xu Tan , Di He , Tao Qin

In recent years, addressing the challenges posed by massive datasets has led researchers to explore aggregated data, particularly leveraging interval-valued data, akin to traditional symbolic data analysis. While much recent research, with…

Methodology · Statistics 2024-05-13 Ali Sadeghkhani , Abdolnasser Sadeghkhani

It is well known that, under standard regularity conditions, the maximum likelihood estimator (MLE) satisfies a central limit theorem and converges in distribution to a Gaussian random variable as the sample size grows. This paper…

Information Theory · Computer Science 2026-05-26 Leighton P. Barnes , Alex Dytso

Labeling patients in electronic health records with respect to their statuses of having a disease or condition, i.e. case or control statuses, has increasingly relied on prediction models using high-dimensional variables derived from…

Methodology · Statistics 2021-10-14 Zijian Guo , Prabrisha Rakshit , Daniel S. Herman , Jinbo Chen

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

In this paper, we study a generalization of the two-groups model in the presence of covariates --- a problem that has recently received much attention in the statistical literature due to its applicability in multiple hypotheses testing…

Methodology · Statistics 2019-02-01 Nabarun Deb , Sujayam Saha , Adityanand Guntuboyina , Bodhisattva Sen

In this paper, we propose improved estimation method for logistic regression based on subsamples taken according the optimal subsampling probabilities developed in Wang et al. 2018 Both asymptotic results and numerical results show that the…

Methodology · Statistics 2021-06-24 HaiYing Wang

Parametric high-dimensional regression analysis requires the usage of regularization terms to get interpretable models. The respective estimators can be regarded as regularized M-functionals which are naturally highly nonlinear. We study…

Statistics Theory · Mathematics 2019-09-04 Tino Werner

Modeling sparse data such as microbiome and transcriptomics (RNA-seq) data is very challenging due to the exceeded number of zeros and skewness of the distribution. Many probabilistic models have been used for modeling sparse data,…

Methodology · Statistics 2021-12-30 Hani Aldirawi , Jie Yang

In real life we often deal with independent but not identically distributed observations (i.n.i.d.o), for which the most well-known statistical model is the multiple linear regression model (MLRM) without random covariates. While the…

Statistics Theory · Mathematics 2021-02-25 Elena Castilla , Maria Jaenada , Leandro Pardo

A variety of estimators for the parameters of the Generalized Pareto distribution, the approximating distribution for excesses over a high threshold, have been proposed, always assuming the underlying data to be independent. We recently…

Applications · Statistics 2016-05-26 Lukas Martig , Jürg Hüsler

The missing data problem has been broadly studied in the last few decades and has various applications in different areas such as statistics or bioinformatics. Even though many methods have been developed to tackle this challenge, most of…

Machine Learning · Statistics 2021-06-10 Thu Nguyen , Khoi Minh Nguyen-Duy , Duy Ho Minh Nguyen , Binh T. Nguyen , Bruce Alan Wade

We study multivariate Gaussian statistical models whose maximum likelihood estimator (MLE) is a rational function of the observed data. We establish a one-to-one correspondence between such models and the solutions to a nonlinear…

Algebraic Geometry · Mathematics 2025-09-04 Carlos Améndola , Lukas Gustafsson , Kathlén Kohn , Orlando Marigliano , Anna Seigal

Logistic regression is key method for modeling the probability of a binary outcome based on a collection of covariates. However, the classical formulation of logistic regression relies on the independent sampling assumption, which is often…

Statistics Theory · Mathematics 2024-09-25 Somabha Mukherjee , Ziang Niu , Sagnik Halder , Bhaswar B. Bhattacharya , George Michailidis

Maximum likelihood estimation has been extensively used in the joint analysis of repeated measurements and survival time. However, there is a lack of theoretical justification of the asymptotic properties for the maximum likelihood…

Statistics Theory · Mathematics 2007-06-13 Donglin Zeng , Jianwen Cai

This study focuses on the estimation of the Emax dose-response model, a widely utilized framework in clinical trials, agriculture, and environmental experiments. Existing challenges in obtaining maximum likelihood estimates (MLE) for model…

Methodology · Statistics 2025-06-11 Giacomo Aletti , Nancy Flournoy , Caterina May , Chiara Tommasi

We provide a polyhedral description of the conditions for the existence of the maximum likelihood estimate (MLE) for a hierarchical log-linear model. The MLE exists if and only if the observed margins lie in the relative interior of the…

Combinatorics · Mathematics 2007-06-13 Nicholas Eriksson , Stephen E. Fienberg , Alessandro Rinaldo , Seth Sullivant

In this paper we consider testing the equality of probability vectors of two independent multinomial distributions in high dimension. The classical chi-square test may have some drawbacks in this case since many of cell counts may be zero…

Statistics Theory · Mathematics 2017-11-16 Amanda Plunkett , Junyong Park

We study nonparametric maximum likelihood estimation for two classes of multivariate distributions that imply strong forms of positive dependence; namely log-supermodular (MTP$_2$) distributions and log-$L^\#$-concave (LLC) distributions.…

Statistics Theory · Mathematics 2020-07-10 Elina Robeva , Bernd Sturmfels , Ngoc Tran , Caroline Uhler