English
Related papers

Related papers: The Multiple Roots Phenomenon in Maximum Likelihoo…

200 papers

The maximum likelihood approach is adapted to the problem of estimation of drift and diffusion functions of stochastic processes from measured time series. We reconcile a previously devised iterative procedure [Kleinhans et al., Physics…

Data Analysis, Statistics and Probability · Physics 2009-11-13 D. Kleinhans , R. Friedrich

We investigate the use of the Multiple Optimised Parameter Estimation and Data compression algorithm (MOPED) for data compression and faster evaluation of likelihood functions. Since MOPED only guarantees maintaining the Fisher matrix of…

Instrumentation and Methods for Astrophysics · Physics 2011-05-17 Philip Graff , Mike Hobson , Anthony Lasenby

Linear mixed-effects models are widely used in analyzing clustered or repeated measures data. We propose a quasi-likelihood approach for estimation and inference of the unknown parameters in linear mixed-effects models with high-dimensional…

Methodology · Statistics 2021-03-10 Sai Li , Tony T. Cai , Hongzhe Li

We consider linear regression problems with a varying number of random projections, where we provably exhibit a double descent curve for a fixed prediction problem, with a high-dimensional analysis based on random matrix theory. We first…

Machine Learning · Computer Science 2023-03-15 Francis Bach

In this paper, we consider the problem of lifted inference in the context of Prism-like probabilistic logic programming languages. Traditional inference in such languages involves the construction of an explanation graph for the query and…

Artificial Intelligence · Computer Science 2016-08-23 Arun Nampally , C. R. Ramakrishnan

In finite mixtures of location-scale distributions, if there is no constraint or penalty on the parameters, then the maximum likelihood estimator does not exist because the likelihood is unbounded. To avoid this problem, we consider a…

Statistics Theory · Mathematics 2011-03-04 Kentaro Tanaka

The primal problem of multinomial likelihood maximization restricted to a convex closed subset of the probability simplex is studied. Contrary to widely held belief, a solution of this problem may assign a positive mass to an outcome with…

Statistics Theory · Mathematics 2017-06-21 Marian Grendár , Vladimír Špitalský

The marginal likelihood of a model is a key quantity for assessing the evidence provided by the data in support of a model. The marginal likelihood is the normalizing constant for the posterior density, obtained by integrating the product…

Populations and Evolution · Quantitative Biology 2018-11-30 Mathieu Fourment , Andrew F. Magee , Chris Whidden , Arman Bilge , Frederick A. Matsen , Vladimir N. Minin

While generalized linear mixed models are a fundamental tool in applied statistics, many specifications, such as those involving categorical factors with many levels or interaction terms, can be computationally challenging to estimate due…

Methodology · Statistics 2024-12-03 Max Goplerud , Omiros Papaspiliopoulos , Giacomo Zanella

Maximum parsimony is one of the most frequently-discussed tree reconstruction methods in phylogenetic estimation. However, in recent years it has become more and more apparent that phylogenetic trees are often not sufficient to describe…

Populations and Evolution · Quantitative Biology 2016-10-25 Christopher Bryant , Mareike Fischer , Simone Linz , Charles Semple

Multi-view learning is frequently used in data science. The pairwise correlation maximization is a classical approach for exploring the consensus of multiple views. Since the pairwise correlation is inherent for two views, the extensions to…

Machine Learning · Computer Science 2022-01-31 Jiawang Nie , Li Wang , Zequn Zheng

In recent years, many methods have been developed for detecting causal relationships in observational data. Some of them have the potential to tackle large data sets. However, these methods fail to discover a combined cause, i.e. a…

Artificial Intelligence · Computer Science 2015-10-16 Saisai Ma , Jiuyong Li , Lin Liu , Thuc Duy Le

For general data, the number of complex solutions to the likelihood equations is constant and this number is called the (maximum likelihood) ML-degree of the model. In this article, we describe the special locus of data for which the…

Algebraic Geometry · Mathematics 2015-10-01 Emil Horobet , Jose Israel Rodriguez

We study the problem of maximum likelihood (ML) estimation for statistical models defined by reflexive polytopes. Our focus is on the maximum likelihood degree of these models as an algebraic measure of complexity of the corresponding…

Statistics Theory · Mathematics 2024-07-24 Carlos Améndola , Janike Oldekop

Multiparametric statistical model providing stable reconstruction of parameters by observations is considered. The only general method of this kind is the root model based on the representation of the probability density as a squared…

Quantum Physics · Physics 2007-05-23 Yu. I. Bogdanov

We study the problem of computing the tightest upper and lower bounds on the probability that the sum of $n$ dependent Bernoulli random variables exceeds an integer $k$. Under knowledge of all pairs of bivariate distributions denoted by a…

Optimization and Control · Mathematics 2019-10-16 Divya Padmanabhan , Karthik Natarajan

A new parameterization and algorithm are proposed for seeking the primary relative maximum of the likelihood function in the three-parameter lognormal distribution. The parameterization yields the dimension reduction of the three-parameter…

Statistics Theory · Mathematics 2013-11-18 Yoshio Komori , Hideo Hirose

Maximum bipartite matching is a fundamental algorithmic problem which can be solved in polynomial time. We consider a natural variant in which there is a separation constraint: the vertices on one side lie on a path or a grid, and two…

Data Structures and Algorithms · Computer Science 2023-03-20 Pasin Manurangsi , Erel Segal-Halevi , Warut Suksompong

Over the past few years, insights from computer science, statistical physics, and information theory have revealed phase transitions in a wide array of high-dimensional statistical problems at two distinct thresholds: One is the…

Statistics Theory · Mathematics 2018-08-14 Yihong Wu , Jiaming Xu

We propose a multivariate probability distribution that models a linear correlation between binary and continuous variables. The proposed distribution is a natural extension of the previously developed multivariate binary distribution. As…

Methodology · Statistics 2023-02-14 Takashi Arai