English
Related papers

Related papers: A Large-Deviation Analysis of the Maximum-Likeliho…

200 papers

This paper considers the problem of estimating a power-law degree distribution of an undirected network using sampled data. Although power-law degree distributions are ubiquitous in nature, the widely used parametric methods for estimating…

Social and Information Networks · Computer Science 2021-03-09 Buddhika Nettasinghe , Vikram Krishnamurthy

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

In this paper, we address the classical problem of maximum-likelihood (ML) detection of data in the presence of random phase noise. We consider a system, where the random phase noise affecting the received signal is first compensated by a…

Information Theory · Computer Science 2016-11-15 Rajet Krishnan , M. Reza Khanzadi , Thomas Eriksson , Tommy Svensson

How do phylogenetic reconstruction algorithms go astray when they return incorrect trees? This simple question has not been answered in detail, even for maximum parsimony (MP), the simplest phylogenetic criterion. Understanding MP has…

Populations and Evolution · Quantitative Biology 2025-09-15 William Howard-Snyder , Will Dumm , Mary Barker , Ognian Milanov , Claris Winston , David H. Rich , Marc A Suchard , Frederick A Matsen

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

We consider the problem of decentralized detection in a network consisting of a large number of nodes arranged as a tree of bounded height, under the assumption of conditionally independent, identically distributed observations. We…

Information Theory · Computer Science 2008-03-18 Wee Peng Tay , John Tsitsiklis , Moe Win

Out-of-distribution (OOD) detection is essential for ensuring the reliability of deep learning models operating in open-world scenarios. Current OOD detectors mainly rely on statistical models to identify unusual patterns in the latent…

Machine Learning · Computer Science 2025-06-06 Konstantin Kirchheim , Frank Ortmeier

Recently increasing attention has been addressed to the fluctuations observed in percolation defined in single and multiplex networks. These fluctuations are extremely important to characterize the robustness of real finite networks but…

Disordered Systems and Neural Networks · Physics 2019-08-21 Ginestra Bianconi

We employ a parameter-free distribution estimation framework where estimators are random distributions and utilize the Kullback-Leibler (KL) divergence as a loss function. Wu and Vos [J. Statist. Plann. Inference 142 (2012) 1525-1536] show…

Statistics Theory · Mathematics 2015-09-21 Paul Vos , Qiang Wu

We study three fundamental statistical-learning problems: distribution estimation, property estimation, and property testing. We establish the profile maximum likelihood (PML) estimator as the first unified sample-optimal approach to a wide…

Machine Learning · Statistics 2019-07-12 Yi Hao , Alon Orlitsky

Hidden tree Markov models allow learning distributions for tree structured data while being interpretable as nondeterministic automata. We provide a concise summary of the main approaches in literature, focusing in particular on the…

Machine Learning · Statistics 2018-06-01 Davide Bacciu , Daniele Castellana

We propose a mutual information-based sufficient representation learning (MSRL) approach, which uses the variational formulation of the mutual information and leverages the approximation power of deep neural networks. MSRL learns a…

Machine Learning · Statistics 2022-07-25 Siming Zheng , Yuanyuan Lin , Jian Huang

We consider the problem of learning the interaction strength between the nodes of a network based on dependent binary observations residing on these nodes, generated from a Markov Random Field (MRF). Since these observations can possibly be…

Methodology · Statistics 2025-12-02 Tianyu Liu , Somabha Mukherjee , Abhik Ghosh

We consider hidden Markov models indexed by a binary tree where the hidden state space is a general metric space. We study the maximum likelihood estimator (MLE) of the model parameters based only on the observed variables. In both…

Probability · Mathematics 2025-08-20 Julien Weibel

An important question in statistical network analysis is how to estimate models of discrete and dependent network data with intractable likelihood functions, without sacrificing computational scalability and statistical guarantees. We…

Statistics Theory · Mathematics 2026-03-06 Jonathan R. Stewart , Michael Schweinberger

We study the noise sensitivity of the minimum spanning tree (MST) of the $n$-vertex complete graph when edges are assigned independent random weights. It is known that when the graph distance is rescaled by $n^{1/3}$ and vertices are given…

Probability · Mathematics 2024-11-20 Omer Israeli , Yuval Peled

Tree-based protocols are ubiquitous in distributed systems. They are flexible, they perform generally well, and, in static conditions, their analysis is mostly simple. Under churn, however, node joins and failures can have complex global…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-04-27 Supriya Krishnamurthy , John Ardelius , Erik Aurell , Mads Dam , Rolf Stadler , Fetahi Wuhib

We study first passage percolation on the configuration model (CM) having power-law degrees with exponent $\tau\in [1,2)$. To this end we equip the edges with exponential weights. We derive the distributional limit of the minimal weight of…

Probability · Mathematics 2009-05-28 Shankar Bhamidi , Remco van der Hofstad , Gerard Hooghiemstra

Maximum Likelihood Estimation (MLE) and Likelihood Ratio Test (LRT) are widely used methods for estimating the transition probability matrix in Markov chains and identifying significant relationships between transitions, such as equality.…

Methodology · Statistics 2024-06-04 Yining Zhou , Ming Gao , Yiting Chen , Xiaoping Shi

Interpretability of AI models allows for user safety checks to build trust in these models. In particular, decision trees (DTs) provide a global view on the learned model and clearly outlines the role of the features that are critical to…

Machine Learning · Computer Science 2023-04-13 Hector Kohler , Riad Akrour , Philippe Preux