English
Related papers

Related papers: Inconsistency of cross-validation for structure le…

200 papers

Gaussian concentration graph models and covariance graph models are two classes of graphical models that are useful for uncovering latent dependence structures among multivariate variables. In the Bayesian literature, graphs are often…

Statistics Theory · Mathematics 2015-05-08 Hao Wang

Two key tasks in high-dimensional regularized regression are tuning the regularization strength for accurate predictions and estimating the out-of-sample risk. It is known that the standard approach -- $k$-fold cross-validation -- is…

Statistics Theory · Mathematics 2025-10-24 Kevin Luo , Yufan Li , Pragya Sur

The internal representations learned by deep networks are often sensitive to architecture-specific choices, raising questions about the stability, alignment, and transferability of learned structure across models. In this paper, we…

Machine Learning · Computer Science 2025-08-06 Saleh Nikooroo , Thomas Engel

Graph structure learning aims to learn connectivity in a graph from data. It is particularly important for many computer vision related tasks since no explicit graph structure is available for images for most cases. A natural way to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Yaohua Wang , FangYi Zhang , Ming Lin , Senzhang Wang , Xiuyu Sun , Rong Jin

In this paper we investigate the computational complexity of learning the graph structure underlying a discrete undirected graphical model from i.i.d. samples. We first observe that the notoriously difficult problem of learning parities…

Machine Learning · Statistics 2014-12-04 Guy Bresler , David Gamarnik , Devavrat Shah

We develop tools to do valid post-selective inference for a family of model selection procedures, including choosing a model via cross-validated Lasso. The tools apply universally when the following random vectors are jointly asymptotically…

Methodology · Statistics 2018-02-13 Jelena Markovic , Lucy Xia , Jonathan Taylor

We study the problem of causal structure learning from a combination of observational and interventional data generated by a linear non-Gaussian structural equation model that might contain cycles. Recent results show that using mere…

Machine Learning · Statistics 2025-12-05 Ehsan Sharifian , Saber Salehkaleybar , Negar Kiyavash

Uncertainty quantification is essential in safety-critical settings--from autonomous driving to aviation, finance, and health--where decisions must rely on conservative bounds rather than point estimates. Predictor-level intervals (e.g.,…

Machine Learning · Computer Science 2026-05-18 Ruirui Liu , Xuejie Hou , Yiping Jiang , Hui Ren

Graph contrastive learning (GCL), learning the node representation by contrasting two augmented graphs in a self-supervised way, has attracted considerable attention. GCL is usually believed to learn the invariant representation. However,…

Machine Learning · Computer Science 2024-03-08 Yanhu Mo , Xiao Wang , Shaohua Fan , Chuan Shi

Probabilistic regression models typically use the Maximum Likelihood Estimation or Cross-Validation to fit parameters. These methods can give an advantage to the solutions that fit observations on average, but they do not pay attention to…

Applications · Statistics 2022-05-24 Naoufal Acharki , Antoine Bertoncello , Josselin Garnier

Deep learning models are vulnerable to adversarial perturbations, raising important concerns for safety-critical deployment. Empirical defenses can achieve strong robustness in practice, but lack formal guarantees, motivating the need for…

Machine Learning · Computer Science 2026-05-26 Konstantinos Emmanouilidis , Tianjiao Ding , Nghia Nguyen , Nicolas Loizou , René Vidal

This article presents a neural network approach for estimating the covariance function of spatial Gaussian random fields defined in a portion of the Euclidean plane. Our proposal builds upon recent contributions, expanding from the purely…

Methodology · Statistics 2024-08-21 Alejandro Villazón , Alfredo Alegría , Xavier Emery

Decoding, ie prediction from brain images or signals, calls for empirical evaluation of its predictive power. Such evaluation is achieved via cross-validation, a method also used to tune decoders' hyper-parameters. This paper is a review on…

Graphical models are widely used in diverse application domains to model the conditional dependencies amongst a collection of random variables. In this paper, we consider settings where the graph structure is covariate-dependent, and…

Machine Learning · Statistics 2025-04-24 Jiahe Lin , Yikai Zhang , George Michailidis

Gaussian process (GP) models are widely used to analyze spatially referenced data and to predict values at locations without observations. In contrast to many algorithmic procedures, GP models are based on a statistical framework, which…

Computation · Statistics 2020-01-01 Florian Gerber , Douglas W. Nychka

Gaussian Graphical Models (GGMs) have wide-ranging applications in machine learning and the natural and social sciences. In most of the settings in which they are applied, the number of observed samples is much smaller than the dimension…

Machine Learning · Computer Science 2020-03-10 Jonathan Kelner , Frederic Koehler , Raghu Meka , Ankur Moitra

Standard likelihood penalties to learn Gaussian graphical models are based on regularising the off-diagonal entries of the precision matrix. Such methods, and their Bayesian counterparts, are not invariant to scalar multiplication of the…

Methodology · Statistics 2023-11-16 Jack Storror Carter , David Rossell , Jim Q. Smith

Gaussian graphical models are widely used to represent correlations among entities but remain vulnerable to data corruption. In this work, we introduce a modified trimmed-inner-product algorithm to robustly estimate the covariance in an…

Machine Learning · Computer Science 2023-09-19 Tong Yao , Shreyas Sundaram

The existence of latent variables in practical problems is common, for example when some variables are difficult or expensive to measure, or simply unknown. When latent variables are unaccounted for, structure learning for Gaussian…

Methodology · Statistics 2025-02-06 Ignacio Echave-Sustaeta Rodríguez , Frank Röttger

We consider the problem of learning a sparse undirected graph underlying a given set of multivariate data. We focus on graph Laplacian-related constraints on the sparse precision matrix that encodes conditional dependence between the random…

Machine Learning · Statistics 2021-11-17 Jitendra K. Tugnait
‹ Prev 1 8 9 10 Next ›