English
Related papers

Related papers: Learning Invariant Graph Representations Through R…

200 papers

The partial information decomposition (PID) aims to quantify the amount of redundant information that a set of sources provides about a target. Here, we show that this goal can be formulated as a type of information bottleneck (IB) problem,…

Information Theory · Computer Science 2024-06-28 Artemy Kolchinsky

Out-of-distribution (OoD) generalization occurs when representation learning encounters a distribution shift. This occurs frequently in practice when training and testing data come from different environments. Covariate shift is a type of…

Machine Learning · Computer Science 2026-04-22 Simon Zhang , Ryan P. DeMilt , Kun Jin , Cathy H. Xia

Out-of-distribution (OOD) graph generalization are critical for many real-world applications. Existing methods neglect to discard spurious or noisy features of inputs, which are irrelevant to the label. Besides, they mainly conduct…

Machine Learning · Computer Science 2023-06-29 Ling Yang , Jiayi Zheng , Heyuan Wang , Zhongyi Liu , Zhilin Huang , Shenda Hong , Wentao Zhang , Bin Cui

Recent advances in neuroscientific experimental techniques have enabled us to simultaneously record the activity of thousands of neurons across multiple brain regions. This has led to a growing need for computational tools capable of…

Spatiotemporal prediction over graphs (STPG) is challenging, because real-world data suffers from the Out-of-Distribution (OOD) generalization problem, where test data follow different distributions from training ones. To address this…

Machine Learning · Computer Science 2025-01-03 Zhaobin Mo , Haotian Xiang , Xuan Di

Describing statistical dependencies is foundational to empirical scientific research. For uncovering intricate and possibly non-linear dependencies between a single target variable and several source variables within a system, a principled…

Information Theory · Computer Science 2024-03-28 David A. Ehrlich , Kyle Schick-Poland , Abdullah Makkeh , Felix Lanfermann , Patricia Wollstadt , Michael Wibral

This paper considers the out-of-distribution (OOD) generalization problem under the setting that both style distribution shift and spurious features exist and domain labels are missing. This setting frequently arises in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ruimeng Li , Yuanhao Pu , Zhaoyi Li , Hong Xie , Defu Lian

The partial information decomposition (PID) framework is concerned with decomposing the information that a set of random variables has with respect to a target variable into three types of components: redundant, synergistic, and unique.…

Information Theory · Computer Science 2025-02-28 André F. C. Gomes , Mário A. T. Figueiredo

Out-of-distribution (OOD) generalization has emerged as a significant challenge in graph recommender systems. Traditional graph neural network algorithms often fail because they learn spurious environmental correlations instead of stable…

Information Retrieval · Computer Science 2025-11-25 Jiahao Liang , Haoran Yang , Xiangyu Zhao , Zhiwen Yu , Mianjie Li , Chuan Shi , Kaixiang Yang

In this paper, we define a new measure of the redundancy of information from a fault tolerance perspective. The partial information decomposition (PID) emerged last decade as a framework for decomposing the multi-source mutual information…

Information Theory · Computer Science 2024-04-03 Jesse Milzman

Graph Neural Networks (GNNs) have achieved impressive performance in graph-related tasks. However, they suffer from poor generalization on out-of-distribution (OOD) data, as they tend to learn spurious correlations. Such correlations…

Machine Learning · Statistics 2026-03-26 Bowen Lu , Liangqiang Yang , Teng Li

Distributional discrepancy between training and test data can lead models to make inaccurate predictions when encountering out-of-distribution (OOD) samples in real-world applications. Although existing graph OOD detection methods leverage…

Machine Learning · Computer Science 2025-10-17 Yue Hou , He Zhu , Ruomei Liu , Yingke Su , Junran Wu , Ke Xu

Graph Transformers (GTs) have demonstrated great effectiveness across various graph analytical tasks. However, the existing GTs focus on training and testing graph data originated from the same distribution, but fail to generalize under…

Machine Learning · Computer Science 2026-03-16 Tianyin Liao , Ziwei Zhang , Yufei Sun , Chunyu Hu , Jianxin Li

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has considerable real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning…

Machine Learning · Computer Science 2024-07-23 Xuexin Chen , Ruichu Cai , Kaitao Zheng , Zhifan Jiang , Zhengting Huang , Zhifeng Hao , Zijian Li

Graph Neural Networks (GNNs) often encounter significant performance degradation under distribution shifts between training and test data, hindering their applicability in real-world scenarios. Recent studies have proposed various methods…

Machine Learning · Computer Science 2025-09-09 Tianjun Yao , Haoxuan Li , Yongqiang Chen , Tongliang Liu , Le Song , Eric Xing , Zhiqiang Shen

The integration and transfer of information from multiple sources to multiple targets is a core motive of neural systems. The emerging field of partial information decomposition (PID) provides a novel information-theoretic lens into these…

Information Theory · Computer Science 2021-10-28 Ari Pakman , Amin Nejatbakhsh , Dar Gilboa , Abdullah Makkeh , Luca Mazzucato , Michael Wibral , Elad Schneidman

Partial Information Decomposition (PID) seeks to disentangle how information about a target variable is distributed across multiple sources, separating redundant, unique, and synergistic contributions. Despite extensive theoretical…

Information Theory · Computer Science 2025-12-19 Philip Hendrik Matthias , Abdullah Makkeh , Michael Wibral , Aaron J. Gutknecht

Out-of-distribution (OOD) learning deals with scenarios in which training and test data follow different distributions. Although general OOD problems have been intensively studied in machine learning, graph OOD is only an emerging area of…

Machine Learning · Computer Science 2022-09-28 Shurui Gui , Xiner Li , Limei Wang , Shuiwang Ji

Obtaining meaningful quantitative descriptions of the statistical dependence within multivariate systems is a difficult open problem. Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI)…

Information Theory · Computer Science 2017-02-21 Robin A. A. Ince

Recently, there has been a surge of interest in developing graph neural networks that utilize the invariance principle on graphs to generalize the out-of-distribution (OOD) data. Due to the limited knowledge about OOD data, existing…

Machine Learning · Computer Science 2024-07-17 Tianjun Yao , Yongqiang Chen , Zhenhao Chen , Kai Hu , Zhiqiang Shen , Kun Zhang