English
Related papers

Related papers: Generalized Direct Change Estimation in Ising Mode…

200 papers

The change detection problem is to determine if the Markov network structures of two Markov random fields differ from one another given two sets of samples drawn from the respective underlying distributions. We study the trade-off between…

Information Theory · Computer Science 2017-10-31 Aditya Gangrade , Bobak Nazer , Venkatesh Saligrama

We consider the problem of high-dimensional Ising (graphical) model selection. We propose a simple algorithm for structure estimation based on the thresholding of the empirical conditional variation distances. We introduce a novel criterion…

Machine Learning · Statistics 2012-08-21 Animashree Anandkumar , Vincent Y. F. Tan , Furong Huang , Alan S. Willsky

We present novel information-theoretic limits on detecting sparse changes in Ising models, a problem that arises in many applications where network changes can occur due to some external stimuli. We show that the sample complexity for…

Information Theory · Computer Science 2020-11-10 Aditya Gangrade , Bobak Nazer , Venkatesh Saligrama

There have been two separate lines of work on estimating Ising models: (1) estimating them from multiple independent samples under minimal assumptions about the model's interaction matrix; and (2) estimating them from one sample in…

Statistics Theory · Mathematics 2020-12-11 Yuval Dagan , Constantinos Daskalakis , Nishanth Dikkala , Anthimos Vardis Kandiros

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

For consistency (even oracle properties) of estimation and model prediction, almost all existing methods of variable/feature selection critically depend on sparsity of models. However, for ``large $p$ and small $n$" models sparsity…

Methodology · Statistics 2010-08-10 Lu Lin , Lixing Zhu , Yujie Gai

We propose a new method for detecting changes in Markov network structure between two sets of samples. Instead of naively fitting two Markov network models separately to the two data sets and figuring out their difference, we…

Machine Learning · Statistics 2014-01-03 Song Liu , John A. Quinn , Michael U. Gutmann , Taiji Suzuki , Masashi Sugiyama

We study the problem of learning sparse structure changes between two Markov networks $P$ and $Q$. Rather than fitting two Markov networks separately to two sets of data and figuring out their differences, a recent work proposed to learn…

Machine Learning · Statistics 2016-04-11 Song Liu , Taiji Suzuki , Raissa Relator , Jun Sese , Masashi Sugiyama , Kenji Fukumizu

Information about intrinsic dimension is crucial to perform dimensionality reduction, compress information, design efficient algorithms, and do statistical adaptation. In this paper we propose an estimator for the intrinsic dimension of a…

Machine Learning · Statistics 2017-11-09 Paulo Serra , Michel Mandjes

We consider the problem of learning the structure of ferromagnetic Ising models Markov on sparse Erdos-Renyi random graph. We propose simple local algorithms and analyze their performance in the regime of correlation decay. We prove that an…

Statistics Theory · Mathematics 2015-03-17 Animashree Anandkumar , Vincent Tan , Alan Willsky

The time-evolving precision matrix of a piecewise-constant Gaussian graphical model encodes the dynamic conditional dependency structure of a multivariate time-series. Traditionally, graphical models are estimated under the assumption that…

Methodology · Statistics 2017-11-01 Alexander J. Gibberd , James D. B. Nelson

We consider the problem of learning the underlying graph of a sparse Ising model with $p$ nodes from $n$ i.i.d. samples. The most recent and best performing approaches combine an empirical loss (the logistic regression loss or the…

Machine Learning · Statistics 2021-09-17 Antoine Dedieu , Miguel Lázaro-Gredilla , Dileep George

High-dimensional statistical inference deals with models in which the the number of parameters p is comparable to or larger than the sample size n. Since it is usually impossible to obtain consistent procedures unless $p/n\rightarrow0$, a…

Statistics Theory · Mathematics 2013-03-13 Sahand N. Negahban , Pradeep Ravikumar , Martin J. Wainwright , Bin Yu

We consider the Ising model between 2 and 4 dimensions perturbed by quenched disorder in the strength of the interaction between nearby spins. In the interval 2<d<4 this disorder is a relevant perturbation that drives the system to a new…

High Energy Physics - Theory · Physics 2019-10-08 Zohar Komargodski , David Simmons-Duffin

In the high-dimensional sparse modeling literature, it has been crucially assumed that the sparsity structure of the model is homogeneous over the entire population. That is, the identities of important regressors are invariant across the…

Methodology · Statistics 2014-11-20 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

We study the problem of learning the structure and parameters of the Ising model, a fundamental model of high-dimensional data, when observing the evolution of an associated Markov chain. A recent line of work has studied the natural…

Machine Learning · Computer Science 2025-07-22 Jason Gaitonde , Ankur Moitra , Elchanan Mossel

Learning Gibbs distributions using only sufficient statistics has long been recognized as a computationally hard problem. On the other hand, computationally efficient algorithms for learning Gibbs distributions rely on access to full sample…

Machine Learning · Computer Science 2026-02-16 Abhijith Jayakumar , Shreya Shukla , Marc Vuffray , Andrey Y. Lokhov , Sidhant Misra

Analysis of non-asymptotic estimation error and structured statistical recovery based on norm regularized regression, such as Lasso, needs to consider four aspects: the norm, the loss function, the design matrix, and the noise model. This…

Machine Learning · Statistics 2015-12-01 Arindam Banerjee , Sheng Chen , Farideh Fazayeli , Vidyashankar Sivakumar

The estimation of an f-divergence between two probability distributions based on samples is a fundamental problem in statistics and machine learning. Most works study this problem under very weak assumptions, in which case it is provably…

Machine Learning · Statistics 2019-10-25 Paul K. Rubenstein , Olivier Bousquet , Josip Djolonga , Carlos Riquelme , Ilya Tolstikhin

The Ising model was originally developed to model magnetisation of solids in statistical physics. As a network of binary variables with the probability of becoming 'active' depending only on direct neighbours, the Ising model appears…

Statistics Theory · Mathematics 2018-07-31 Lourens Waldorp , Maarten Marsman , Gunter Maris
‹ Prev 1 2 3 10 Next ›