English
Related papers

Related papers: Sparse Graphical Modelling via the Sorted L$_1$-No…

200 papers

Probabilistic Graphical Models (PGMs) are generative models of complex systems. They rely on conditional independence assumptions between variables to learn sparse representations which can be visualized in a form of a graph. Such models…

Machine Learning · Computer Science 2022-10-13 Harsh Shrivastava , Urszula Chajewska , Robin Abraham , Xinshi Chen

We address the issue of recovering the structure of large sparse directed acyclic graphs from noisy observations of the system. We propose a novel procedure based on a specific formulation of the l1-norm regularized maximum likelihood,…

Statistics Theory · Mathematics 2017-10-09 Magali Champion , Victor Picheny , Matthieu Vignes

Motivated by the need to study the molecular mechanism underlying Type 1 Diabetes (T1D) with the gene expression data collected from both the patients and healthy controls at multiple time points, we propose an innovative method for jointly…

Methodology · Statistics 2018-12-10 Bochao Jia , Faming Liang , the TEDDY Study Group

High-dimensional graphical models are often estimated using regularization that is aimed at reducing the number of edges in a network. In this work, we show how even simpler networks can be produced by aggregating the nodes of the graphical…

Methodology · Statistics 2021-02-01 Ines Wilms , Jacob Bien

In linear regression, SLOPE is a new convex analysis method that generalizes the Lasso via the sorted L1 penalty: larger fitted coefficients are penalized more heavily. This magnitude-dependent regularization requires an input of penalty…

Machine Learning · Statistics 2021-12-14 Yiliang Zhang , Zhiqi Bu

Graphical network inference is used in many fields such as genomics or ecology to infer the conditional independence structure between variables, from measurements of gene expression or species abundances for instance. In many practical…

Methodology · Statistics 2018-03-22 Geneviève Robin , Christophe Ambroise , Stéphane Robin

Predicting links in sparse, continuously evolving networks is a central challenge in network science. Conventional heuristic methods and deep learning models, including Graph Neural Networks (GNNs), are typically designed for static graphs…

Social and Information Networks · Computer Science 2026-02-17 Nafiseh Sadat Sajadi , Behnam Bahrak , Mahdi Jafari Siavoshani

In Gaussian graphical models, the zero entries in the precision matrix determine the dependence structure, so estimating that sparse precision matrix and, thereby, learning this underlying structure, is an important and challenging problem.…

Statistics Theory · Mathematics 2019-12-10 Chang Liu , Ryan Martin

Gaussian Graphical Models provide a convenient framework for representing dependencies between variables. Recently, this tool has received a high interest for the discovery of biological networks. The literature focuses on the case where a…

Methodology · Statistics 2010-05-13 Julien Chiquet , Yves Grandvalet , Christophe Ambroise

Sorted L-One Penalized Estimation (SLOPE) is a relatively new convex optimization procedure which allows for adaptive selection of regressors under sparse high dimensional designs. Here we extend the idea of SLOPE to deal with the situation…

Methodology · Statistics 2016-10-18 Damian Brzyski , Alexej Gossmann , Weijie Su , Malgorzata Bogdan

Graph Neural Networks (GNNs) excel in various graph learning tasks but face computational challenges when applied to large-scale graphs. A promising solution is to remove non-essential edges to reduce the computational overheads in GNN.…

Machine Learning · Computer Science 2024-02-05 Guibin Zhang , Yanwei Yue , Kun Wang , Junfeng Fang , Yongduo Sui , Kai Wang , Yuxuan Liang , Dawei Cheng , Shirui Pan , Tianlong Chen

Gaussian graphical models (GGMs) are widely used for statistical modeling, because of ease of inference and the ubiquitous use of the normal distribution in practical approximations. However, they are also known for their limited modeling…

Machine Learning · Statistics 2016-11-22 Qinliang Su , Xuejun Liao , Chunyuan Li , Zhe Gan , Lawrence Carin

In this paper, we consider the mixture of sparse linear regressions model. Let ${\beta}^{(1)},\ldots,{\beta}^{(L)}\in\mathbb{C}^n$ be $ L $ unknown sparse parameter vectors with a total of $ K $ non-zero coefficients. Noisy linear…

Information Theory · Computer Science 2018-08-03 Dong Yin , Ramtin Pedarsani , Yudong Chen , Kannan Ramchandran

Finite Gaussian mixture models are widely used for model-based clustering of continuous data. Nevertheless, since the number of model parameters scales quadratically with the number of variables, these models can be easily…

Methodology · Statistics 2018-09-25 Michael Fop , Thomas Brendan Murphy , Luca Scrucca

Sparse coding (SC) is an unsupervised learning scheme that has received an increasing amount of interests in recent years. However, conventional SC vectorizes the input images, which destructs the intrinsic spatial structures of the images.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Fei Jiang , Xiao-Yang Liu , Hongtao Lu , Ruimin Shen

Graphical Gaussian models have proven to be useful tools for exploring network structures based on multivariate data. Applications to studies of gene expression have generated substantial interest in these models, and resulting recent…

Machine Learning · Computer Science 2014-08-12 Michael A. Finegold , Mathias Drton

We introduce a novel method for sparse regression and variable selection, which is inspired by modern ideas in multiple testing. Imagine we have observations from the linear model y = X beta + z, then we suggest estimating the regression…

Methodology · Statistics 2013-10-30 Malgorzata Bogdan , Ewout van den Berg , Weijie Su , Emmanuel Candes

Graphical models are frequently used to explore networks, such as genetic networks, among a set of variables. This is usually carried out via exploring the sparsity of the precision matrix of the variables under consideration. Penalized…

Applications · Statistics 2009-08-17 Jianqing Fan , Yang Feng , Yichao Wu

We develop a penalized likelihood estimation framework to estimate the structure of Gaussian Bayesian networks from observational data. In contrast to recent methods which accelerate the learning problem by restricting the search space, our…

Methodology · Statistics 2015-12-24 Bryon Aragam , Qing Zhou

Gaussian graphical models provide a powerful framework for studying conditional dependencies in multivariate data, with widespread applications spanning biomedical, environmental sciences, and other data-rich scientific domains. While the…

Methodology · Statistics 2026-01-13 The Tien Mai , Sayantan Banerjee