English
Related papers

Related papers: Mind the Label Shift of Augmentation-based Graph O…

200 papers

Text-attributed graphs (TAGs) associate nodes with textual attributes and graph structure, enabling GNNs to jointly model semantic and structural information. While effective on in-distribution (ID) data, GNNs often encounter…

Machine Learning · Computer Science 2026-02-13 Yinlin Zhu , Di Wu , Xu Wang , Guocong Quan , Miao Hu

The integrity of training data, even when annotated by experts, is far from guaranteed, especially for non-IID datasets comprising both in- and out-of-distribution samples. In an ideal scenario, the majority of samples would be…

Machine Learning · Computer Science 2023-11-07 Zhilin Zhao , Longbing Cao , Chang-Dong Wang

Dynamic graph neural networks (DyGNNs) have demonstrated powerful predictive abilities by exploiting graph structural and temporal dynamics. However, the existing DyGNNs fail to handle distribution shifts, which naturally exist in dynamic…

Machine Learning · Computer Science 2024-03-11 Zeyang Zhang , Xin Wang , Ziwei Zhang , Haoyang Li , Wenwu Zhu

Graph Domain Adaptation (GDA) transfers knowledge from labeled source graphs to unlabeled target graphs, addressing the challenge of label scarcity. However, existing GDA methods typically assume that both source and target graphs exhibit…

Social and Information Networks · Computer Science 2026-02-10 Ruiyi Fang , Shuo Wang , Ruizhi Pu , Qiuhao Zeng , Hao Zheng , Ziyan Wang , Jiale Cai , Zhimin Mei , Song Tang , Charles Ling , Boyu Wang

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

Machine Learning · Computer Science 2023-12-05 Sergey Kolesnikov

Graph neural networks (GNNs) are proven effective in extracting complex node and structural information from graph data. While current GNNs perform well in node classification tasks within in-distribution (ID) settings, real-world scenarios…

Machine Learning · Computer Science 2025-05-08 Tao Yin , Chen Zhao , Xiaoyan Liu , Minglai Shao

Despite graph neural networks' (GNNs) great success in modelling graph-structured data, out-of-distribution (OOD) test instances still pose a great challenge for current GNNs. One of the most effective techniques to detect OOD nodes is to…

Machine Learning · Computer Science 2025-04-11 Danny Wang , Ruihong Qiu , Guangdong Bai , Zi Huang

Graph Neural Networks (GNNs) have recently become the predominant tools for studying graph data. Despite state-of-the-art performance on graph classification tasks, GNNs are overwhelmingly trained in a single domain under supervision, thus…

Machine Learning · Computer Science 2025-02-18 Tao Wen , Elynn Chen , Yuzhou Chen , Qi Lei

As graph representation learning often suffers from label scarcity problems in real-world applications, researchers have proposed graph domain adaptation (GDA) as an effective knowledge-transfer paradigm across graphs. In particular, to…

Machine Learning · Computer Science 2024-12-31 Boshen Shi , Yongqing Wang , Fangda Guo , Bingbing Xu , Huawei Shen , Xueqi Cheng

Graph neural networks (GNNs) have demonstrated remarkable success in numerous graph analytical tasks. Yet, their effectiveness is often compromised in real-world scenarios due to distribution shifts, limiting their capacity for knowledge…

Machine Learning · Computer Science 2024-07-30 Renhong Huang , Jiarong Xu , Xin Jiang , Ruichuan An , Yang Yang

Covariate distribution shift occurs when certain structural features present in the test set are absent from the training set. It is a common type of out-of-distribution (OOD) problem, frequently encountered in real-world graph data with…

Machine Learning · Computer Science 2026-04-22 Fanlong Zeng , Wensheng Gan

Graph Neural Networks (GNNs) have garnered considerable interest due to their exceptional performance in a wide range of graph machine learning tasks. Nevertheless, the majority of GNN-based approaches have been examined using…

Machine Learning · Computer Science 2023-09-27 Jingyang Yuan , Xiao Luo , Yifang Qin , Zhengyang Mao , Wei Ju , Ming Zhang

Out-of-distribution (OOD) detection is critical for ensuring the safety and reliability of machine learning systems, particularly in dynamic and open-world environments. In the vision and text domains, zero-shot OOD detection - which…

Machine Learning · Computer Science 2025-05-20 Haoyan Xu , Zhengtao Yao , Xuzhi Zhang , Ziyi Wang , Langzhou He , Yushun Dong , Philip S. Yu , Mengyuan Li , Yue Zhao

We address the key challenge of size-induced distribution shifts in graph neural networks (GNNs) and their impact on the generalization of GNNs to larger graphs. Existing literature operates under diverse assumptions about distribution…

Machine Learning · Computer Science 2025-08-04 Gaotang Li , Danai Koutra , Yujun Yan

Machine learning (ML) systems in natural language processing (NLP) face significant challenges in generalizing to out-of-distribution (OOD) data, where the test distribution differs from the training data distribution. This poses important…

Computation and Language · Computer Science 2023-05-24 Linyi Yang , Yaoxiao Song , Xuan Ren , Chenyang Lyu , Yidong Wang , Lingqiao Liu , Jindong Wang , Jennifer Foster , Yue Zhang

The development and evaluation of graph neural networks (GNNs) generally follow the independent and identically distributed (i.i.d.) assumption. Yet this assumption is often untenable in practice due to the uncontrollable data generation…

Machine Learning · Computer Science 2025-03-06 Yiming Xu , Bin Shi , Zhen Peng , Huixiang Liu , Bo Dong , Chen Chen

Most Graph Neural Networks (GNNs) predict the labels of unseen graphs by learning the correlation between the input graphs and labels. However, by presenting a graph classification investigation on the training graphs with severe bias,…

Machine Learning · Computer Science 2022-09-29 Shaohua Fan , Xiao Wang , Yanhu Mo , Chuan Shi , Jian Tang

Detecting data points deviating from the training distribution is pivotal for ensuring reliable machine learning. Extensive research has been dedicated to the challenge, spanning classical anomaly detection techniques to contemporary…

Machine Learning · Computer Science 2024-05-30 Xuefeng Du , Yiyou Sun , Yixuan Li

Graph Neural Networks (GNNs) are state-of-the-art models for performing prediction tasks on graphs. While existing GNNs have shown great performance on various tasks related to graphs, little attention has been paid to the scenario where…

Machine Learning · Computer Science 2023-08-15 Yu Song , Donglin Wang

Out-Of-Distribution generalization (OOD) is all about learning invariance against environmental changes. If the context in every class is evenly distributed, OOD would be trivial because the context can be easily removed due to an…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Jiaxin Qi , Kaihua Tang , Qianru Sun , Xian-Sheng Hua , Hanwang Zhang