English
Related papers

Related papers: Inconsistency of cross-validation for structure le…

200 papers

Graphical models are widely used in scienti fic and engineering research to represent conditional independence structures between random variables. In many controlled experiments, environmental changes or external stimuli can often alter…

Machine Learning · Computer Science 2012-03-19 Bai Zhang , Yue Wang

Graphical Lasso (GL) is a popular method for learning the structure of an undirected graphical model, which is based on an $l_1$ regularization technique. The objective of this paper is to compare the computationally-heavy GL technique with…

Machine Learning · Statistics 2019-07-02 Salar Fattahi , Somayeh Sojoudi

Graph representation learning is fundamental for analyzing graph-structured data. Exploring invariant graph representations remains a challenge for most existing graph representation learning methods. In this paper, we propose a cross-view…

Machine Learning · Computer Science 2025-04-15 Jie Chen , Hua Mao , Wai Lok Woo , Chuanbin Liu , Xi Peng

Graph Convolutional Network (GCN) is an emerging technique for information retrieval (IR) applications. While GCN assumes the homophily property of a graph, real-world graphs are never perfect: the local structure of a node may contain…

Machine Learning · Computer Science 2021-06-08 Fuli Feng , Weiran Huang , Xiangnan He , Xin Xin , Qifan Wang , Tat-Seng Chua

The graphical lasso \citep{FHT2007a} is an algorithm for learning the structure in an undirected Gaussian graphical model, using $\ell_1$ regularization to control the number of zeros in the precision matrix ${\B\Theta}={\B\Sigma}^{-1}$…

Machine Learning · Statistics 2012-08-09 Rahul Mazumder , Trevor Hastie

We derive high-dimensional Gaussian comparison results for the standard $V$-fold cross-validated risk estimates. Our results combine a recent stability-based argument for the low-dimensional central limit theorem of cross-validation with…

Statistics Theory · Mathematics 2023-11-15 Nicholas Kissel , Jing Lei

In this paper, we derive non-asymptotic error bounds for the Lasso estimator when the penalty parameter for the estimator is chosen using $K$-fold cross-validation. Our bounds imply that the cross-validated Lasso estimator has nearly…

Statistics Theory · Mathematics 2020-02-07 Denis Chetverikov , Zhipeng Liao , Victor Chernozhukov

We conduct a non asymptotic study of the Cross Validation (CV) estimate of the generalization risk for learning algorithms dedicated to extreme regions of the covariates space. In this Extreme Value Analysis context, the risk function…

Statistics Theory · Mathematics 2024-09-12 Anass Aghbalou , Patrice Bertail , François Portier , Anne Sabourin

Estimation of structure, such as in variable selection, graphical modelling or cluster analysis is notoriously difficult, especially for high-dimensional data. We introduce stability selection. It is based on subsampling in combination with…

Methodology · Statistics 2009-05-16 Nicolai Meinshausen , Peter Buehlmann

We discuss the Gaussian graphical model (GGM; an undirected network of partial correlation coefficients) and detail its utility as an exploratory data analysis tool. The GGM shows which variables predict one-another, allows for sparse…

Methodology · Statistics 2018-02-09 Sacha Epskamp , Lourens J. Waldorp , René Mõttus , Denny Borsboom

Gaussian graphical model selection is usually studied under independent sampling, but in many applications observations arise from dependent dynamics. We study structure learning when the data consist of a single trajectory of Gaussian…

Machine Learning · Computer Science 2026-05-13 Vignesh Tirukkonda , Anirudh Rayas , Gautam Dasarathy

Sparse inverse covariance estimation (i.e., edge de-tection) is an important research problem in recent years, wherethe goal is to discover the direct connections between a set ofnodes in a networked system based upon the observed…

Machine Learning · Computer Science 2021-01-15 Hang Yin , Xinyue Liu , Xiangnan Kong

This work addresses the problem of graph learning from data following a Gaussian Graphical Model (GGM) with a time-varying mean. Graphical Lasso (GL), the standard method for estimating sparse precision matrices, assumes that the observed…

Machine Learning · Computer Science 2025-03-26 Samuel Rey , Ernesto Curbelo , Luca Martino , Fernando Llorente , Antonio G. Marques

Gaussian covariance graph model is a popular model in revealing underlying dependency structures among random variables. A Bayesian approach to the estimation of covariance structures uses priors that force zeros on some off-diagonal…

Methodology · Statistics 2021-12-07 Bongjung Sung , Jaeyong Lee

Many varieties of cross validation would be statistically appealing for the estimation of smoothing and other penalized regression hyperparameters, were it not for the high cost of evaluating such criteria. Here it is shown how to…

Methodology · Statistics 2025-11-06 Simon N. Wood

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

Graphical models can represent a multivariate distribution in a convenient and accessible form as a graph. Causal models can be viewed as a special class of graphical models that not only represent the distribution of the observed system…

Methodology · Statistics 2017-06-29 Christina Heinze-Deml , Marloes H. Maathuis , Nicolai Meinshausen

We present an algorithm to identify sparse dependence structure in continuous and non-Gaussian probability distributions, given a corresponding set of data. The conditional independence structure of an arbitrary distribution can be…

Machine Learning · Computer Science 2017-11-07 Rebecca E. Morrison , Ricardo Baptista , Youssef Marzouk

We consider the problem of learning a conditional Gaussian graphical model in the presence of latent variables. Building on recent advances in this field, we suggest a method that decomposes the parameters of a conditional Markov random…

Methodology · Statistics 2017-03-07 Benjamin Frot , Luke Jostins , Gil McVean

Graphical modeling explores dependences among a collection of variables by inferring a graph that encodes pairwise conditional independences. For jointly Gaussian variables, this translates into detecting the support of the precision…

Methodology · Statistics 2018-02-16 Shota Katayama , Hironori Fujisawa , Mathias Drton