English
Related papers

Related papers: Lower Bounds for Two-Sample Structural Change Dete…

200 papers

In this paper, we derive the limit of experiments for one parameter Ising models on dense regular graphs. In particular, we show that the limiting experiment is Gaussian in the low temperature regime, non Gaussian in the critical regime,…

Statistics Theory · Mathematics 2023-05-11 Yuanzhe Xu , Sumit Mukherjee

Markov random fields area popular model for high-dimensional probability distributions. Over the years, many mathematical, statistical and algorithmic problems on them have been studied. Until recently, the only known algorithms for…

Machine Learning · Computer Science 2017-06-01 Linus Hamilton , Frederic Koehler , Ankur Moitra

The problem of estimating an unknown discrete distribution from its samples is a fundamental tenet of statistical learning. Over the past decade, it attracted significant research effort and has been solved for a variety of divergence…

Machine Learning · Computer Science 2018-10-30 Yi Hao , Alon Orlitsky , Venkatadheeraj Pichapati

Large networked systems are constantly exposed to local damages and failures that can alter their functionality. The knowledge of the structure of these systems is however often derived through sampling strategies whose effectiveness at…

Physics and Society · Physics 2015-06-18 Fabio Ciulla , Nicola Perra , Andrea Baronchelli , Alessandro Vespignani

Gaussian Graphical Models (GGMs) or Gauss Markov random fields are widely used in many applications, and the trade-off between the modeling capacity and the efficiency of learning and inference has been an important research problem. In…

Machine Learning · Computer Science 2013-11-12 Ying Liu , Alan S. Willsky

In this paper, we study the detection boundary for minimax hypothesis testing in the context of high-dimensional, sparse binary regression models. Motivated by genetic sequencing association studies for rare variant effects, we investigate…

Statistics Theory · Mathematics 2015-03-06 Rajarshi Mukherjee , Natesh S. Pillai , Xihong Lin

The detection of hidden two-dimensional Gauss-Markov random fields using sensor networks is considered. Under a conditional autoregressive model, the error exponent for the Neyman-Pearson detector satisfying a fixed level constraint is…

Information Theory · Computer Science 2016-11-15 Youngchul Sung , H. Vincent Poor , Heejung Yu

Model change detection is studied, in which there are two sets of samples that are independently and identically distributed (i.i.d.) according to a pre-change probabilistic model with parameter $\theta$, and a post-change model with…

Machine Learning · Statistics 2018-11-21 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

We consider the problem of learning the underlying graph of a sparse Ising model with $p$ nodes from $n$ i.i.d. samples. The most recent and best performing approaches combine an empirical loss (the logistic regression loss or the…

Machine Learning · Statistics 2021-09-17 Antoine Dedieu , Miguel Lázaro-Gredilla , Dileep George

Graphical model selection in Markov random fields is a fundamental problem in statistics and machine learning. Two particularly prominent models, the Ising model and Gaussian model, have largely developed in parallel using different (though…

Machine Learning · Statistics 2020-02-26 Anamay Chaturvedi , Jonathan Scarlett

The problem of online change point detection is to detect abrupt changes in properties of time series, ideally as soon as possible after those changes occur. Existing work on online change point detection either assumes i.i.d data, focuses…

Machine Learning · Computer Science 2023-12-01 Lei Xin , George Chiu , Shreyas Sundaram

We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms for learning a…

Machine Learning · Computer Science 2023-07-11 Davin Choo , Yuval Dagan , Constantinos Daskalakis , Anthimos Vardis Kandiros

We consider the problem of reconstructing the graph underlying an Ising model from i.i.d. samples. Over the last fifteen years this problem has been of significant interest in the statistics, machine learning, and statistical physics…

Machine Learning · Computer Science 2014-12-02 Guy Bresler

Many modern statistical applications involve a two-level sampling scheme that first samples subjects from a population and then samples observations on each subject. These schemes often are designed to learn both the population-level…

Methodology · Statistics 2024-04-02 Akira Horiguchi , Li Ma , Botond T. Szabó

Inspired by graph-based methodologies, we introduce a novel graph-spanning algorithm designed to identify changes in both offline and online data across low to high dimensions. This versatile approach is applicable to Euclidean and…

Machine Learning · Statistics 2026-01-09 Yang-Wen Sun , Katerina Papagiannouli , Vladimir Spokoiny

We fully characterize the nonasymptotic minimax separation rate for sparse signal detection in the Gaussian sequence model with $p$ equicorrelated observations, generalizing a result of Collier, Comminges, and Tsybakov. As a consequence of…

Statistics Theory · Mathematics 2021-10-26 Subhodh Kotekal , Chao Gao

In this paper, we consider the problem of estimating the underlying graph associated with an Ising model given a number of independent and identically distributed samples. We adopt an \emph{approximate recovery} criterion that allows for a…

Information Theory · Computer Science 2016-07-11 Jonathan Scarlett , Volkan Cevher

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

We address the sequential change-point detection problem for the Gaussian model where baseline distribution is Gaussian with variance \sigma^2 and mean \mu such that \sigma^2=a\mu, where a>0 is a known constant; the change is in \mu from…

Statistics Theory · Mathematics 2012-03-06 Aleksey S. Polunchenko , Alexander G. Tartakovsky , Nitis Mukhopadhyay

We study the detection of a change in the covariance matrix of $n$ independent sub-Gaussian random variables of dimension $p$. Our first contribution is to show that $\log\log(8n)$ is the exact minimax testing rate for a change in variance…

Statistics Theory · Mathematics 2025-02-11 Per August Jarval Moen