English
Related papers

Related papers: Quasi-independence models with rational maximum li…

200 papers

We investigate a generic problem of learning pairwise exponential family graphical models with pairwise sufficient statistics defined by a global mapping function, e.g., Mercer kernels. This subclass of pairwise graphical models allow us to…

Machine Learning · Statistics 2013-11-25 Xiao-Tong Yuan , Ping Li , Tong Zhang

Probabilistic independence can dramatically simplify the task of eliciting, representing, and computing with probabilities in large domains. A key technique in achieving these benefits is the idea of graphical modeling. We survey existing…

Artificial Intelligence · Computer Science 2013-02-21 Fahiem Bacchus , Adam J. Grove

We consider the problem of estimating the distribution function, the density and the hazard rate of the (unobservable) event time in the current status model. A well studied and natural nonparametric estimator for the distribution function…

Statistics Theory · Mathematics 2010-01-13 Piet Groeneboom , Geurt Jongbloed , Birgit I. Witte

The extreme value index is a fundamental parameter in univariate Extreme Value Theory (EVT). It captures the tail behavior of a distribution and is central in the extrapolation beyond observed data. Among other semi-parametric methods (such…

Statistics Theory · Mathematics 2017-05-02 Clément Dombry , Ana Ferreira

This paper introduces a simple efficient learning algorithms for general sequential decision making. The algorithm combines Optimism for exploration with Maximum Likelihood Estimation for model estimation, which is thus named OMLE. We prove…

Machine Learning · Computer Science 2022-11-24 Qinghua Liu , Praneeth Netrapalli , Csaba Szepesvári , Chi Jin

This paper addresses the challenge of modeling multi-way contingency tables for matched set data with ordinal categories. Although the complete symmetry and marginal homogeneity models are well established, they may not always provide a…

Methodology · Statistics 2025-01-28 Hisaya Okahara , Kouji Tahata

This paper establishes the almost sure convergence and asymptotic normality of levels and differenced quasi maximum-likelihood (QML) estimators of dynamic panel data models. The QML estimators are robust with respect to initial conditions,…

Statistics Theory · Mathematics 2017-02-03 Robert F. Phillips

There is increasing interest in using LLMs as decision-making "agents." Doing so includes many degrees of freedom: which model should be used; how should it be prompted; should it be asked to introspect, conduct chain-of-thought reasoning,…

Computation and Language · Computer Science 2024-05-29 Narun Raman , Taylor Lundy , Samuel Amouyal , Yoav Levine , Kevin Leyton-Brown , Moshe Tennenholtz

In fitting a mixture of linear regression models, normal assumption is traditionally used to model the error and then regression parameters are estimated by the maximum likelihood estimators (MLE). This procedure is not valid if the normal…

Methodology · Statistics 2018-11-06 Yanyuan Ma , Shaoli Wang , Lin Xu , Weixin Yao

Given a statistical model, the maximum likelihood degree is the number of complex solutions to the likelihood equations for generic data. We consider discrete algebraic statistical models and study the solutions to the likelihood equations…

Algebraic Geometry · Mathematics 2014-05-06 Elizabeth Gross , Jose Israel Rodriguez

We study multivariate Gaussian models that are described by linear conditions on the concentration matrix. We compute the maximum likelihood (ML) degrees of these models. That is, we count the critical points of the likelihood function over…

Algebraic Geometry · Mathematics 2021-02-23 Carlos Améndola , Lukas Gustafsson , Kathlén Kohn , Orlando Marigliano , Anna Seigal

For the univariate current status and, more generally, the interval censoring model, distribution theory has been developed for the maximum likelihood estimator (MLE) and smoothed maximum likelihood estimator (SMLE) of the unknown…

Statistics Theory · Mathematics 2013-06-18 Piet Groeneboom

We discuss two parameterizations of models for marginal independencies for discrete distributions which are representable by bi-directed graph models, under the global Markov property. Such models are useful data analytic tools especially…

Machine Learning · Statistics 2008-01-10 Monia Lupparelli , Giovanni M. Marchetti , Wicher P. Bergsma

Do large language models (LLMs) construct and manipulate internal world models, or do they rely solely on statistical associations represented as output layer token probabilities? We adapt cognitive science methodologies from human mental…

Artificial Intelligence · Computer Science 2025-07-22 Cole Robertson , Philip Wolff

We study the question of whether, for a given class of finite graphs, one can define, for each graph of the class, a linear ordering in monadic second-order logic, possibly with the help of monadic parameters. We consider two variants of…

Logic in Computer Science · Computer Science 2015-07-01 Achim Blumensath , Bruno Courcelle

Misclassification of binary responses, if ignored, may severely bias the maximum likelihood estimators (MLE) of regression parameters. For such data, a binary regression model incorporating misclassification probabilities is extensively…

Statistics Theory · Mathematics 2020-09-28 Arindam Chatterjee , Tathagata Bandyopadhyay , Sumanta Adhya

The analysis of datasets taking the form of simple, undirected graphs continues to gain in importance across a variety of disciplines. Two choices of null model, the logistic-linear model and the implicit log-linear model, have come into…

Statistics Theory · Mathematics 2012-02-13 Patrick O. Perry , Patrick J. Wolfe

In this paper we revisit the likelihood geometry of Gaussian graphical models. We give a detailed proof that the ML-degree behaves monotonically on induced subgraphs. Furthermore, we complete a missing argument that the ML-degree of the…

Statistics Theory · Mathematics 2024-10-10 Carlos Améndola , Rodica Andreea Dinu , Mateusz Michałek , Martin Vodička

Consider a setting with $N$ independent individuals, each with an unknown parameter, $p_i \in [0, 1]$ drawn from some unknown distribution $P^\star$. After observing the outcomes of $t$ independent Bernoulli trials, i.e., $X_i \sim…

Statistics Theory · Mathematics 2019-02-13 Ramya Korlakai Vinayak , Weihao Kong , Gregory Valiant , Sham M. Kakade

This study develops a framework for testing hypotheses on structural parameters in incomplete models. Such models make set-valued predictions and hence do not generally yield a unique likelihood function. The model structure, however,…

Econometrics · Economics 2019-12-03 Hiroaki Kaido , Yi Zhang