English
Related papers

Related papers: Inconsistency of cross-validation for structure le…

200 papers

We consider the problem of estimating the parameters of the covariance function of a Gaussian process by cross-validation. We suggest using new cross-validation criteria derived from the literature of scoring rules. We also provide an…

Computation · Statistics 2020-08-07 Sébastien Petit , Julien Bect , Sébastien da Veiga , Paul Feliot , Emmanuel Vazquez

The structure of a Bayesian network includes a great deal of information about the probability distribution of the data, which is uniquely identified given some general distributional assumptions. Therefore it's important to study its…

Methodology · Statistics 2011-12-07 Marco Scutari

We establish bounds on the KL divergence between two multivariate Gaussian distributions in terms of the Hamming distance between the edge sets of the corresponding graphical models. We show that the KL divergence is bounded below by a…

Information Theory · Computer Science 2015-04-06 Varun Jog , Po-Ling Loh

Recent advances in graph convolutional networks have significantly improved the performance of chemical predictions, raising a new research question: "how do we explain the predictions of graph convolutional networks?" A possible approach…

Machine Learning · Computer Science 2018-07-06 Hirotaka Akita , Kosuke Nakago , Tomoki Komatsu , Yohei Sugawara , Shin-ichi Maeda , Yukino Baba , Hisashi Kashima

In this paper, we consider the Graphical Lasso (GL), a popular optimization problem for learning the sparse representations of high-dimensional datasets, which is well-known to be computationally expensive for large-scale problems.…

Machine Learning · Statistics 2017-11-28 Salar Fattahi , Richard Y. Zhang , Somayeh Sojoudi

Evaluating the predictive performance of a statistical model is commonly done using cross-validation. Among the various methods, leave-one-out cross-validation (LOOCV) is frequently used. Originally designed for exchangeable observations,…

Computation · Statistics 2025-07-04 Zhedong Liu , Janet Van Niekerk , Haavard Rue

We consider the problem of learning a causal graph in the presence of measurement error. This setting is for example common in genomics, where gene expression is corrupted through the measurement process. We develop a provably consistent…

Methodology · Statistics 2019-06-04 Basil Saeed , Anastasiya Belyaeva , Yuhao Wang , Caroline Uhler

The main approach to defining equivalence among acyclic directed causal graphical models is based on the conditional independence relationships in the distributions that the causal models can generate, in terms of the Markov equivalence.…

Machine Learning · Computer Science 2020-07-03 AmirEmad Ghassami , Alan Yang , Negar Kiyavash , Kun Zhang

Designs conditions for marine structures are typically informed by threshold-based extreme value analyses of oceanographic variables, in which excesses of a high threshold are modelled by a generalized Pareto (GP) distribution. Too low a…

Methodology · Statistics 2016-06-02 Paul Northrop , Nicolas Attalides , Philip Jonathan

This paper studies the problem of estimating a covariance matrix from correlated sub-Gaussian samples. We consider using the correlated sample covariance matrix estimator to approximate the true covariance matrix. We establish…

Information Theory · Computer Science 2019-10-17 Xu Zhang , Wei Cui , Yulong Liu

Undirected graphical models are powerful tools for uncovering complex relationships among high-dimensional variables. This paper aims to fully recover the structure of an undirected graphical model when the data naturally take matrix form,…

Methodology · Statistics 2025-08-08 Minsub Shin , Johan Lim , Seongoh Park

We present clustering methods for multivariate data exploiting the underlying geometry of the graphical structure between variables. As opposed to standard approaches that assume known graph structures, we first estimate the edge structure…

Methodology · Statistics 2015-09-28 Sayantan Banerjee , Rehan Akbani , Veerabhadran Baladandayuthapani

We consider the problem of learning the structure of a pairwise graphical model over continuous and discrete variables. We present a new pairwise model for graphical models with both continuous and discrete variables that is amenable to…

Machine Learning · Statistics 2013-07-05 Jason D. Lee , Trevor J. Hastie

Graph learning problems are typically approached by focusing on learning the topology of a single graph when signals from all nodes are available. However, many contemporary setups involve multiple related networks and, moreover, it is…

Signal Processing · Electrical Eng. & Systems 2022-12-06 Samuel Rey , Madeline Navarro , Andrei Buciulea , Santiago Segarra , Antonio G. Marques

This manuscript considers the problem of learning a random Gaussian network function using a fully connected network with frozen intermediate layers and trainable readout layer. This problem can be seen as a natural generalization of the…

Machine Learning · Statistics 2023-02-02 Dominik Schröder , Hugo Cui , Daniil Dmitriev , Bruno Loureiro

We introduce a generic estimator for the false discovery rate of any model selection procedure, in common statistical modeling settings including the Gaussian linear model, Gaussian graphical model, and model-X setting. We prove that our…

Methodology · Statistics 2026-02-25 Yixiang Luo , William Fithian , Lihua Lei

Graphical network inference is used in many fields such as genomics or ecology to infer the conditional independence structure between variables, from measurements of gene expression or species abundances for instance. In many practical…

Methodology · Statistics 2018-03-22 Geneviève Robin , Christophe Ambroise , Stéphane Robin

Probabilistic graphical models combine the graph theory and probability theory to give a multivariate statistical modeling. They provide a unified description of uncertainty using probability and complexity using the graphical model.…

Machine Learning · Statistics 2011-11-30 Yang Zhou

The Gaussian graphical model is routinely employed to model the joint distribution of multiple random variables. The graph it induces is not only useful for describing the relationship between random variables but also critical for…

Methodology · Statistics 2022-12-15 Thien-Minh Le , Ping-Shou Zhong , Chenlei Leng

This paper proposes using a sparse-structured multivariate Gaussian to provide a closed-form approximator for the output of probabilistic ensemble models used for dense image prediction tasks. This is achieved through a convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Ivor J. A. Simpson , Sara Vicente , Neill D. F. Campbell