English
Related papers

Related papers: A global approach for learning sparse Ising models

200 papers

We investigate a generalized framework to estimate a latent low-rank plus sparse tensor, where the low-rank tensor often captures the multi-way principal components and the sparse tensor accounts for potential model mis-specifications or…

Methodology · Statistics 2022-04-15 Jian-Feng Cai , Jingyang Li , Dong Xia

In many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional…

Information Theory · Computer Science 2015-06-18 Jun Fang , Jing Li , Yanning Shen , Hongbin Li , Shaoqian Li

This paper considers sparsity in linear regression under the restriction that the regression weights sum to one. We propose an approach that combines $\ell_0$- and $\ell_1$-regularization. We compute its solution by adapting a recent…

Methodology · Statistics 2019-07-11 Nick Koning , Paul Bekker

Exponential random graph models (ERGMs) are very flexible for modeling network formation but pose difficult estimation challenges due to their intractable normalizing constant. Existing methods, such as MCMC-MLE, rely on sequential…

Social and Information Networks · Computer Science 2025-02-05 Angelo Mele

We consider a distributed learning setup where a sparse signal is estimated over a network. Our main interest is to save communication resource for information exchange over the network and reduce processing time. Each node of the network…

Machine Learning · Statistics 2018-04-03 Ahmed Zaki , Saikat Chatterjee , Partha P. Mitra , Lars K. Rasmussen

We consider the problem of reconstructing the graph underlying an Ising model from i.i.d. samples. Over the last fifteen years this problem has been of significant interest in the statistics, machine learning, and statistical physics…

Machine Learning · Computer Science 2014-12-02 Guy Bresler

We consider the problem of learning the structure of ferromagnetic Ising models Markov on sparse Erdos-Renyi random graph. We propose simple local algorithms and analyze their performance in the regime of correlation decay. We prove that an…

Statistics Theory · Mathematics 2015-03-17 Animashree Anandkumar , Vincent Tan , Alan Willsky

We apply the network Lasso to solve binary classification and clustering problems for network-structured data. To this end, we generalize ordinary logistic regression to non-Euclidean data with an intrinsic network structure. The resulting…

Machine Learning · Computer Science 2018-08-15 Henrik Ambos , Nguyen Tran , Alexander Jung

We study the performance of sparse regression methods and propose new techniques to distill the governing equations of dynamical systems from data. We first look at the generic methodology of learning interpretable equation forms from data,…

Machine Learning · Computer Science 2019-03-25 Chinmay S. Kulkarni

Sparse graphical modelling has attained widespread attention across various academic fields. We propose two new graphical model approaches, Gslope and Tslope, which provide sparse estimates of the precision matrix by penalizing its sorted…

We propose a novel statistical model for sparse networks with overlapping community structure. The model is based on representing the graph as an exchangeable point process, and naturally generalizes existing probabilistic models with…

Methodology · Statistics 2025-02-06 Adrien Todeschini , Xenia Miscouridou , François Caron

Identifying the Markov properties or conditional independencies of a collection of random variables is a fundamental task in statistics for modeling and inference. Existing approaches often learn the structure of a probabilistic graphical…

Machine Learning · Computer Science 2025-05-23 Sarah Liaw , Rebecca Morrison , Youssef Marzouk , Ricardo Baptista

Recent years have seen a lot of progress in algorithms for learning parameters of spreading dynamics from both full and partial data. Some of the remaining challenges include model selection under the scenarios of unknown network structure,…

Social and Information Networks · Computer Science 2024-01-02 Mateusz Wilinski , Andrey Y. Lokhov

This article aims to provide a comprehensive overview of sparse optimization, with a focus on both sparse signal recovery and sparse regularization techniques. We will begin by exploring the foundations of sparse optimization, delving into…

History and Overview · Mathematics 2026-01-13 Jun Lu

Causal structure learning, also known as causal discovery, aims to estimate causal relationships between variables as a form of a causal directed acyclic graph (DAG) from observational data. One of the major frameworks is the order-based…

Machine Learning · Statistics 2026-02-18 Kentaro Kanamori , Hirofumi Suzuki , Takuya Takagi

Statistical inference using pairwise comparison data is an effective approach to analyzing large-scale sparse networks. In this paper, we propose a general framework to model the mutual interactions in a network, which enjoys ample…

Machine Learning · Statistics 2022-03-11 Ruijian Han , Yiming Xu , Kani Chen

In statistics, generalized linear models (GLMs) are widely used for modeling data and can expressively capture potential nonlinear dependence of the model's outcomes on its covariates. Within the broad family of GLMs, those with binary…

Statistics Theory · Mathematics 2025-09-04 Namiko Matsumoto , Arya Mazumdar

We consider the problem of learning a high-dimensional graphical model in which certain hub nodes are highly-connected to many other nodes. Many authors have studied the use of an l1 penalty in order to learn a sparse graph in…

Machine Learning · Statistics 2014-08-12 Kean Ming Tan , Palma London , Karthik Mohan , Su-In Lee , Maryam Fazel , Daniela Witten

We propose a new yet natural algorithm for learning the graph structure of general discrete graphical models (a.k.a. Markov random fields) from samples. Our algorithm finds the neighborhood of a node by sequentially adding nodes that…

Machine Learning · Statistics 2012-02-09 Praneeth Netrapalli , Siddhartha Banerjee , Sujay Sanghavi , Sanjay Shakkottai

We propose a learning-based approach for estimating the spectrum of a multisinusoidal signal from a finite number of samples. A neural-network is trained to approximate the spectra of such signals on simulated data. The proposed methodology…

Machine Learning · Computer Science 2019-06-03 Gautier Izacard , Brett Bernstein , Carlos Fernandez-Granda