English
Related papers

Related papers: DNNLasso: Scalable Graph Learning for Matrix-Varia…

200 papers

We consider the problem of learning a structured multi-task regression, where the output consists of multiple responses that are related by a graph and the correlated response variables are dependent on the common inputs in a sparse but…

Machine Learning · Statistics 2010-05-21 Xi Chen , Seyoung Kim , Qihang Lin , Jaime G. Carbonell , Eric P. Xing

We consider tests of significance in the setting of the graphical lasso for inverse covariance matrix estimation. We propose a simple test statistic based on a subsequence of the knots in the graphical lasso path. We show that this…

Statistics Theory · Mathematics 2013-07-24 Max Grazier G'Sell , Jonathan Taylor , Robert Tibshirani

Sampling from unnormalised discrete distributions is a fundamental problem across various domains. While Markov chain Monte Carlo offers a principled approach, it often suffers from slow mixing and poor convergence. In this paper, we…

Machine Learning · Computer Science 2025-10-23 Zijing Ou , Ruixiang Zhang , Yingzhen Li

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

Machine Learning · Computer Science 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

Deep Recurrent Neural Network architectures, though remarkably capable at modeling sequences, lack an intuitive high-level spatio-temporal structure. That is while many problems in computer vision inherently have an underlying high-level…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Ashesh Jain , Amir R. Zamir , Silvio Savarese , Ashutosh Saxena

In neuroscience, researchers seek to uncover the connectivity of neurons from large-scale neural recordings or imaging; often people employ graphical model selection and estimation techniques for this purpose. But, existing technologies can…

Machine Learning · Statistics 2021-04-14 Minjie Wang , Genevera I. Allen

Learning an explainable classifier often results in low accuracy model or ends up with a huge rule set, while learning a deep model is usually more capable of handling noisy data at scale, but with the cost of hard to explain the result and…

Artificial Intelligence · Computer Science 2022-11-11 Yuanlong Li , Gaopan Huang , Min Zhou , Chuan Fu , Honglin Qiao , Yan He

We provide a computational framework for approximating a class of structured matrices; here, the term structure is very general, and may refer to a regular sparsity pattern (e.g., block-banded), or be more highly structured (e.g., symmetric…

Numerical Analysis · Mathematics 2021-05-05 Misha E. Kilmer , Arvind K. Saibaba

Graph model is emerging as a very effective tool for learning the complex structures and relationships hidden in data. Generally, the critical purpose of graph-oriented learning algorithms is to construct an informative graph for image…

Computer Vision and Pattern Recognition · Computer Science 2016-12-21 Qingshan Liu , Yubao Sun , Cantian Wang , Tongliang Liu , Dacheng Tao

Identifying causal relations among multi-variate time series is one of the most important elements towards understanding the complex mechanisms underlying the dynamic system. It provides critical tools for forecasting, simulations and…

Machine Learning · Computer Science 2023-02-22 Yang Sun , Yifan Xie

Many modern data analytics applications on graphs operate on domains where graph topology is not known a priori, and hence its determination becomes part of the problem definition, rather than serving as prior knowledge which aids the…

Information Theory · Computer Science 2020-01-03 Ljubisa Stankovic , Danilo Mandic , Milos Dakovic , Milos Brajovic , Bruno Scalzo , Shengxi Li , Anthony G. Constantinides

Depending on the node ordering, an adjacency matrix can highlight distinct characteristics of a graph. Deriving a "proper" node ordering is thus a critical step in visualizing a graph as an adjacency matrix. Users often try multiple matrix…

Human-Computer Interaction · Computer Science 2022-03-09 Oh-Hyun Kwon , Chiun-How Kao , Chun-houh Chen , Kwan-Liu Ma

This paper develops column partition based distributed schemes for a class of large-scale convex sparse optimization problems, e.g., basis pursuit (BP), LASSO, basis pursuit denosing (BPDN), and their extensions, e.g., fused LASSO. We are…

Optimization and Control · Mathematics 2020-03-18 Jinglai Shen , Jianghai Hu , Eswar Kumar Hathibelagal Kammara

The paper proposes a new covariance estimator for large covariance matrices when the variables have a natural ordering. Using the Cholesky decomposition of the inverse, we impose a banded structure on the Cholesky factor, and select the…

Applications · Statistics 2008-12-18 Elizaveta Levina , Adam Rothman , Ji Zhu

We propose a shrinkage procedure for simultaneous variable selection and estimation in generalized linear models (GLMs) with an explicit predictive motivation. The procedure estimates the coefficients by minimizing the Kullback-Leibler…

Methodology · Statistics 2010-09-14 Minh-Ngoc Tran , David Nott , Chenlei Leng

The application of the lasso is espoused in high-dimensional settings where only a small number of the regression coefficients are believed to be nonzero. Moreover, statistical properties of high-dimensional lasso estimators are often…

Methodology · Statistics 2015-01-07 Bala Rajaratnam , Steven Roberts , Doug Sparks , Onkar Dalal

The quality of graph-structured data is fundamental to the success of modern graph analysis techniques such as Graph Neural Networks (GNNs). However, real-world graph data is often suboptimal, suffering from issues such as noise and…

Machine Learning · Computer Science 2026-05-19 Shen Han , Zhiyao Zhou , Jiawei Chen , Sheng Zhou , Canghong Jin , Hai Lin , Da Zhong Li , Bingde Hu , Can Wang

This work introduces a highly scalable spectral graph densification framework for learning resistor networks with linear measurements, such as node voltages and currents. We prove that given $O(\log N)$ pairs of voltage and current…

Machine Learning · Computer Science 2021-04-19 Zhuo Feng

Recent advances in representation learning on graphs, mainly leveraging graph convolutional networks, have brought a substantial improvement on many graph-based benchmark tasks. While novel approaches to learning node embeddings are highly…

Machine Learning · Statistics 2018-11-06 Cătălina Cangea , Petar Veličković , Nikola Jovanović , Thomas Kipf , Pietro Liò

This paper studies the problem of Kronecker-structured sparse vector recovery from an underdetermined linear system with a Kronecker-structured dictionary. Such a problem arises in many real-world applications such as the sparse channel…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Yanbin He , Geethu Joseph