English
Related papers

Related papers: Model Selection With Graphical Neighbour Informati…

200 papers

The pattern of zero entries in the inverse covariance matrix of a multivariate normal distribution corresponds to conditional independence restrictions between variables. Covariance selection aims at estimating those structural zeros from…

Statistics Theory · Mathematics 2016-08-16 Nicolai Meinshausen , Peter Bühlmann

We propose estimating Gaussian graphical models (GGMs) that are fair with respect to sensitive nodal attributes. Many real-world models exhibit unfair discriminatory behavior due to biases in data. Such discrimination is known to be…

Machine Learning · Statistics 2024-06-17 Madeline Navarro , Samuel Rey , Andrei Buciulea , Antonio G. Marques , Santiago Segarra

Undirected graphical models are powerful tools for uncovering complex relationships among high-dimensional variables. This paper aims to fully recover the structure of an undirected graphical model when the data naturally take matrix form,…

Methodology · Statistics 2025-08-08 Minsub Shin , Johan Lim , Seongoh Park

Gaussian graphical model selection is usually studied under independent sampling, but in many applications observations arise from dependent dynamics. We study structure learning when the data consist of a single trajectory of Gaussian…

Machine Learning · Computer Science 2026-05-13 Vignesh Tirukkonda , Anirudh Rayas , Gautam Dasarathy

For many scientific questions, understanding the underlying mechanism is the goal. To help investigators better understand the underlying mechanism, variable selection is a crucial step that permits the identification of the most associated…

Methodology · Statistics 2025-10-06 Shuangshuang Xu , Marco A. R. Ferreira , Allison N. Tegge

In Gaussian graphical models, the likelihood equations must typically be solved iteratively. We investigate two algorithms: A version of iterative proportional scaling which avoids inversion of large matrices, and an algorithm based on…

Computation · Statistics 2023-12-12 Søren Højsgaard , Steffen Lauritzen

A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator…

Methodology · Statistics 2021-07-07 Dominik Rothenhäusler

We present a stepwise approach to estimate high dimensional Gaussian graphical models. We exploit the relation between the partial correlation coefficients and the distribution of the prediction errors, and parametrize the model in terms of…

Methodology · Statistics 2018-08-21 Ginette Lafit , Francisco J. Nogales , Marcelo Ruiz , Ruben H. Zamar

Estimation of structure, such as in variable selection, graphical modelling or cluster analysis is notoriously difficult, especially for high-dimensional data. We introduce stability selection. It is based on subsampling in combination with…

Methodology · Statistics 2009-05-16 Nicolai Meinshausen , Peter Buehlmann

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

Methodology · Statistics 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra

This paper studies graphical model selection, i.e., the problem of estimating a graph of statistical relationships among a collection of random variables. Conventional graphical model selection algorithms are passive, i.e., they require all…

Machine Learning · Statistics 2014-04-15 Divyanshu Vats , Robert D. Nowak , Richard G. Baraniuk

We characterize the sample size required for accurate graphical model selection from non-stationary samples. The observed data is modeled as a vector-valued zero-mean Gaussian random process whose samples are uncorrelated but have different…

Machine Learning · Computer Science 2019-06-28 Nguyen Q. Tran , Oleksii Abramenko , Alexander Jung

In this paper, we propose a novel variable selection approach in the framework of high-dimensional linear models where the columns of the design matrix are highly correlated. It consists in rewriting the initial high-dimensional linear…

Statistics Theory · Mathematics 2021-06-11 Wencan Zhu , Eric Adjakossa , Céline Lévy-Leduc , Nils Ternès

This paper examines the issue of fairness in the estimation of graphical models (GMs), particularly Gaussian, Covariance, and Ising models. These models play a vital role in understanding complex relationships in high-dimensional data.…

Machine Learning · Computer Science 2024-11-11 Zhuoping Zhou , Davoud Ataee Tarzanagh , Bojian Hou , Qi Long , Li Shen

Graph neural networks (GNNs) are prominent for their effectiveness in processing graph data for semi-supervised node classification tasks. Most works of GNNs assume that the observed structure accurately represents the underlying node…

Machine Learning · Computer Science 2024-11-08 Shuangjie Li , Jiangqing Song , Baoming Zhang , Gaoli Ruan , Junyuan Xie , Chongjun Wang

Unsupervised feature selection is an important method to reduce dimensions of high dimensional data without labels, which is benefit to avoid ``curse of dimensionality'' and improve the performance of subsequent machine learning tasks, like…

Machine Learning · Computer Science 2020-12-29 Yanyong Huang , Zongxin Shen , Fuxu Cai , Tianrui Li , Fengmao Lv

This paper introduces Kernel-based Information Criterion (KIC) for model selection in regression analysis. The novel kernel-based complexity measure in KIC efficiently computes the interdependency between parameters of the model using a…

Machine Learning · Statistics 2014-12-16 Somayeh Danafar , Kenji Fukumizu , Faustino Gomez

This paper presents the R package gRapHD for efficient selection of high-dimensional undirected graphical models. The package provides tools for selecting trees, forests and decomposable models minimizing information criteria such as AIC or…

Machine Learning · Statistics 2019-09-24 Gabriel C. G. de Abreu , Rodrigo Labouriau , David Edwards

The Schwarz or Bayesian information criterion (BIC) is one of the most widely used tools for model comparison in social science research. The BIC however is not suitable for evaluating models with order constraints on the parameters of…

Methodology · Statistics 2019-05-01 Joris Mulder , Adrian E. Raftery

Information theoretic criteria (ITC) have been widely adopted in engineering and statistics for selecting, among an ordered set of candidate models, the one that better fits the observed sample data. The selected model minimizes a penalized…

Machine Learning · Statistics 2019-10-10 Andrea Mariani , Andrea Giorgetti , Marco Chiani