English
Related papers

Related papers: The maximum likelihood degree of sparse polynomial…

200 papers

We revisit the problem of the existence of the maximum likelihood estimate for multi-class logistic regression. We show that one method of ensuring its existence is by assigning positive probability to every class in the sample dataset. The…

Machine Learning · Computer Science 2024-05-09 Dwight Nwaigwe , Marek Rychlik

Let $X_1, \ldots, X_n$ be independent random points drawn from an absolutely continuous probability measure with density $f$ in $\mathbb{R}^d$. Under mild conditions on $f$, we derive a Poisson limit theorem for the number of large…

Probability · Mathematics 2018-11-20 László Györfi , Norbert Henze , Harro Walk

We study the maximum likelihood (ML) degree of linear concentration models in algebraic statistics. We relate it to an intersection problem on the variety of complete quadrics. This allows us to provide an explicit, basic, albeit of high…

Algebraic Geometry · Mathematics 2020-11-19 Mateusz Michałek , Leonid Monin , Jarosław Wiśniewski

Let $P_1,\dots, P_n$ and $Q_1,\dots, Q_n$ be convex polytopes in $\mathbb{R}^n$ such that $P_i\subset Q_i$. It is well-known that the mixed volume has the monotonicity property: $V(P_1,\dots,P_n)\leq V(Q_1,\dots,Q_n)$. We give two criteria…

Metric Geometry · Mathematics 2020-12-22 Frédéric Bihan , Ivan Soprunov

Learning the parameters of graphical models using the maximum likelihood estimation is generally hard which requires an approximation. Maximum composite likelihood estimations are statistical approximations of the maximum likelihood…

Machine Learning · Computer Science 2014-06-25 Muneki Yasuda , Shun Kataoka , Yuji Waizumi , Kazuyuki Tanaka

In this paper we consider high-dimensional multiclass classification by sparse multinomial logistic regression. We propose first a feature selection procedure based on penalized maximum likelihood with a complexity penalty on the model size…

Statistics Theory · Mathematics 2020-11-20 Felix Abramovich , Vadim Grinshtein , Tomer Levy

The restricted maximum likelihood method enhances popularity of maximum likelihood methods for variance component analysis on large scale unbalanced data. As the high throughput biological data sets and the emerged science on uncertainty…

Computation · Statistics 2018-05-15 Shengxin Zhu , Andrew J Wathen

We describe a maximum entropy approach for computing volumes and counting integer points in polyhedra. To estimate the number of points from a particular set X in R^n in a polyhedron P in R^n, by solving a certain entropy maximization…

Combinatorics · Mathematics 2009-07-15 Alexander Barvinok , John Hartigan

This work studies the average complexity of solving structured polynomial systems that are characterized by a low evaluation cost, as opposed to the dense random model previously used. Firstly, we design a continuation algorithm that…

Numerical Analysis · Mathematics 2023-06-12 Peter Bürgisser , Felipe Cucker , Pierre Lairez

The codegree of a lattice polytope is the smallest integer dilate that contains a lattice point in the relative interior. The weak maximum likelihood threshold of a statistical model is the smallest number of data points for which there is…

Combinatorics · Mathematics 2025-12-03 Joseph Johnson , Seth Sullivant

We settle a conjecture by Coons and Sullivant stating that the maximum likelihood (ML) degree of a facial submodel of a toric model is at most the ML degree of the model itself. We discuss the impact on the ML degree from observing zeros in…

Algebraic Geometry · Mathematics 2025-07-04 Carlos Améndola , Janike Oldekop , Maximilian Wiesmann

Under a standard assumption in complexity theory (NP not in P/poly), we demonstrate a gap between the minimax prediction risk for sparse linear regression that can be achieved by polynomial-time algorithms, and that achieved by optimal…

Statistics Theory · Mathematics 2014-05-22 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

In this paper the maximum likelihood equations for the parameters of the Weight Lindley distribution are studied considering different types of censoring, such as, type I, type II and random censoring mechanism. A numerical simulation study…

Methodology · Statistics 2015-03-31 Pedro L. Ramos , Francisco Louzada , Vicente G. Cancho

A maximum likelihood method is used to deal with the combined estimation of multi-measurements of a branching ratio, where each result can be presented as an upper limit. The joint likelihood function is constructed using observed spectra…

Data Analysis, Statistics and Probability · Physics 2015-08-04 Xiao-Xia Liu , Xiao-Rui Lyu , Yong-Sheng Zhu

Mixtures of factor analyzers are becoming more and more popular in the area of model based clustering of high-dimensional data. According to the likelihood approach in data modeling, it is well known that the unconstrained log-likelihood…

Methodology · Statistics 2013-01-09 Francesca Greselin , Salvatore Ingrassia

We consider toric maximum likelihood estimation over the field of Puiseux series and study critical points of the likelihood function using tropical methods. This problem translates to finding the intersection points of a tropical affine…

Algebraic Geometry · Mathematics 2025-08-08 Emma Boniface , Karel Devriendt , Serkan Hoşten

The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Geethu Joseph

We consider here the identification of change-points on large-scale data streams. The objective is to find the most efficient way of combining information across data stream so that detection is possible under the smallest detectable change…

Statistics Theory · Mathematics 2022-03-29 Shouri Hu , Jingyan Huang , Hao Chen , Hock Peng Chan

Maximum likelihood estimation (MLE) is a fundamental computational problem in statistics. In this paper, MLE for statistical models with discrete data is studied from an algebraic statistics viewpoint. A reformulation of the MLE problem in…

Statistics Theory · Mathematics 2014-05-27 Jose Israel Rodriguez

The maximum likelihood threshold (MLT) of a graph $G$ is the minimum number of samples to almost surely guarantee existence of the maximum likelihood estimate in the corresponding Gaussian graphical model. We give a new characterization of…