English
Related papers

Related papers: Improving Graph Out-of-distribution Generalization…

200 papers

We introduce a novel class of labeled directed acyclic graph (LDAG) models for finite sets of discrete variables. LDAGs generalize earlier proposals for allowing local structures in the conditional probability distribution of a node, such…

Machine Learning · Statistics 2014-11-12 Johan Pensar , Henrik Nyman , Timo Koski , Jukka Corander

We study the problem of lifelong graph learning in an open-world scenario, where a model needs to deal with new tasks and potentially unknown classes. We utilize Out-of-Distribution (OOD) detection methods to recognize new classes and adapt…

Machine Learning · Computer Science 2023-10-20 Marcel Hoffmann , Lukas Galke , Ansgar Scherp

To build safe and reliable graph machine learning systems, unsupervised graph-level anomaly detection (GLAD) and unsupervised graph-level out-of-distribution (OOD) detection (GLOD) have received significant attention in recent years. Though…

Machine Learning · Computer Science 2025-04-07 Yili Wang , Yixin Liu , Xu Shen , Chenyu Li , Kaize Ding , Rui Miao , Ying Wang , Shirui Pan , Xin Wang

Despite graph neural networks' (GNNs) great success in modelling graph-structured data, out-of-distribution (OOD) test instances still pose a great challenge for current GNNs. One of the most effective techniques to detect OOD nodes is to…

Machine Learning · Computer Science 2025-04-11 Danny Wang , Ruihong Qiu , Guangdong Bai , Zi Huang

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Out-of-distribution (OOD) detection is essential to handle the distribution shifts between training and test scenarios. For a new in-distribution (ID) dataset, existing methods require retraining to capture the dataset-specific feature…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Meng Xing , Zhiyong Feng , Yong Su , Changjae Oh

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

Machine Learning · Computer Science 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

We present an algorithm to identify sparse dependence structure in continuous and non-Gaussian probability distributions, given a corresponding set of data. The conditional independence structure of an arbitrary distribution can be…

Machine Learning · Computer Science 2017-11-07 Rebecca E. Morrison , Ricardo Baptista , Youssef Marzouk

This paper introduces a universal approach to seamlessly combine out-of-distribution (OOD) detection scores. These scores encompass a wide range of techniques that leverage the self-confidence of deep learning models and the anomalous…

Machine Learning · Statistics 2024-06-25 Eduardo Dadalto , Florence Alberge , Pierre Duhamel , Pablo Piantanida

Most deep-learning-based image classification methods assume that all samples are generated under an independent and identically distributed (IID) setting. However, out-of-distribution (OOD) generalization is more common in practice, which…

Machine Learning · Computer Science 2022-02-24 Xin Guo , Zhengxu Yu , Chao Xiang , Zhongming Jin , Jianqiang Huang , Deng Cai , Xiaofei He , Xian-Sheng Hua

We focus on the extension of bivariate causal learning methods into multivariate problem settings in a systematic manner via a novel framework. It is purposive to augment the scale to which bivariate causal discovery approaches can be…

Methodology · Statistics 2023-05-29 Hongyi Chen , Maurits Kaptein

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

The open-world test dataset is often mixed with out-of-distribution (OOD) samples, where the deployed models will struggle to make accurate predictions. Traditional detection methods need to trade off OOD detection and in-distribution (ID)…

Machine Learning · Computer Science 2024-04-25 Xu Shen , Yili Wang , Kaixiong Zhou , Shirui Pan , Xin Wang

Graph Out-of-Distribution (OOD) classification often suffers from sharp performance drops, particularly under category imbalance and structural noise. This work tackles two pressing challenges in this context: (1) the underperformance of…

Machine Learning · Computer Science 2025-06-25 Yang Zhou , Xiaoning Ren

Due to spurious correlations, machine learning systems often fail to generalize to environments whose distributions differ from the ones used at training time. Prior work addressing this, either explicitly or implicitly, attempted to find a…

Machine Learning · Computer Science 2022-10-19 Chaochao Lu , Yuhuai Wu , Jośe Miguel Hernández-Lobato , Bernhard Schölkopf

Rationale is defined as a subset of input features that best explains or supports the prediction by machine learning models. Rationale identification has improved the generalizability and interpretability of neural networks on vision and…

Machine Learning · Computer Science 2022-09-27 Gang Liu , Tong Zhao , Jiaxin Xu , Tengfei Luo , Meng Jiang

Most approaches to out-of-distribution (OOD) generalization learn domain-invariant representations by discarding contextual bias. In this paper, we raise a critical question: Should bias be eliminated? If not, is there a general way to…

Machine Learning · Computer Science 2026-02-06 Yan Li , Yunlong Deng , Zijian Li , Anpeng Wu , Zeyu Tang , Kun Zhang , Guangyi Chen

Diagnosing and cleaning data is a crucial step for building robust machine learning systems. However, identifying problems within large-scale datasets with real-world distributions is challenging due to the presence of complex issues such…

Machine Learning · Computer Science 2023-10-31 Jang-Hyun Kim , Sangdoo Yun , Hyun Oh Song

Learning on graphs, where instance nodes are inter-connected, has become one of the central problems for deep learning, as relational structures are pervasive and induce data inter-dependence which hinders trivial adaptation of existing…

Machine Learning · Computer Science 2023-03-10 Qitian Wu , Yiting Chen , Chenxiao Yang , Junchi Yan

Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of machine learning models. While effective for small models,…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Yong Lin , Renjie Pi , Weizhong Zhang , Renzhe Xu , Peng Cui , Tong Zhang