English
Related papers

Related papers: Mind the Label Shift of Augmentation-based Graph O…

200 papers

Existing methods for graph out-of-distribution (OOD) detection typically depend on training graph neural network (GNN) classifiers using a substantial amount of labeled in-distribution (ID) data. However, acquiring high-quality labeled…

Machine Learning · Computer Science 2025-03-31 Haoyan Xu , Zhengtao Yao , Yushun Dong , Ziyi Wang , Ryan A. Rossi , Mengyuan Li , Yue Zhao

As a crucial step toward real-world learning scenarios with changing environments, dataset shift theory and invariant representation learning algorithm have been extensively studied to relax the identical distribution assumption in…

Machine Learning · Computer Science 2024-06-25 You-Wei Luo , Chuan-Xian Ren

The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

Graph-level representation learning is important in a wide range of applications. Existing graph-level models are generally built on i.i.d. assumption for both training and testing graphs. However, in an open world, models can encounter…

Machine Learning · Computer Science 2024-07-19 Zhihao Ding , Jieming Shi , Shiqi Shen , Xuequn Shang , Jiannong Cao , Zhipeng Wang , Zhi Gong

Deep learning on graphs has shown remarkable success across numerous applications, including social networks, bio-physics, traffic networks, and recommendation systems. Regardless of their successes, current methods frequently depend on the…

Machine Learning · Computer Science 2025-09-25 Itay Niv , Neta Rabin

Learning on graphs, where instance nodes are inter-connected, has become one of the central problems for deep learning, as relational structures are pervasive and induce data inter-dependence which hinders trivial adaptation of existing…

Machine Learning · Computer Science 2023-03-10 Qitian Wu , Yiting Chen , Chenxiao Yang , Junchi Yan

Cross-graph node classification, utilizing the abundant labeled nodes from one graph to help classify unlabeled nodes in another graph, can be viewed as a domain generalization problem of graph neural networks (GNNs) due to the structure…

Machine Learning · Computer Science 2025-02-26 Guanzi Chen , Jiying Zhang , Yang Li

We tackle the challenge of predicting models' Out-of-Distribution (OOD) performance using in-distribution (ID) measurements without requiring OOD data. Existing evaluations with "Effective Robustness", which use ID accuracy as an indicator…

Machine Learning · Computer Science 2024-07-24 Jia Shi , Gautam Gare , Jinjin Tian , Siqi Chai , Zhiqiu Lin , Arun Vasudevan , Di Feng , Francesco Ferroni , Shu Kong

Out-of-distribution (OOD) learning deals with scenarios in which training and test data follow different distributions. Although general OOD problems have been intensively studied in machine learning, graph OOD is only an emerging area of…

Machine Learning · Computer Science 2022-09-28 Shurui Gui , Xiner Li , Limei Wang , Shuiwang Ji

There is increasing evidence suggesting neural networks' sensitivity to distribution shifts, so that research on out-of-distribution (OOD) generalization comes into the spotlight. Nonetheless, current endeavors mostly focus on Euclidean…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Hengrui Zhang , Junchi Yan , David Wipf

Learning on molecule graphs has become an increasingly important topic in AI for science, which takes full advantage of AI to facilitate scientific discovery. Existing solutions on modeling molecules utilize Graph Neural Networks (GNNs) to…

Machine Learning · Computer Science 2025-05-13 Limin Li , Kuo Yang , Wenjie Du , Pengkun Wang , Zhengyang Zhou , Yang Wang

Gaze estimation methods encounter significant performance deterioration when being evaluated across different domains, because of the domain gap between the testing and training data. Existing methods try to solve this issue by reducing the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Guanzhong Zeng , Jingjing Wang , Zefu Xu , Pengwei Yin , Wenqi Ren , Di Xie , Jiang Zhu

Graph anomaly detection (GAD) is a vital task since even a few anomalies can pose huge threats to benign users. Recent semi-supervised GAD methods, which can effectively leverage the available labels as prior knowledge, have achieved…

Machine Learning · Computer Science 2023-06-21 Shuang Zhou , Xiao Huang , Ninghao Liu , Huachi Zhou , Fu-Lai Chung , Long-Kai Huang

Graph anomaly detection (GAD) is a vital task since even a few anomalies can pose huge threats to benign users. Recent semi-supervised GAD methods, which can effectively leverage the available labels as prior knowledge, have achieved…

Machine Learning · Computer Science 2023-07-25 Shuang Zhou , Xiao Huang , Ninghao Liu , Fu-Lai Chung , Long-Kai Huang

Recent work has extended the invariance principle for out-of-distribution (OOD) generalization from Euclidean to graph data, where challenges arise due to complex structures and diverse distribution shifts in node attributes and topology.…

Machine Learning · Computer Science 2025-12-01 Ali Ghasemi , Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

The standard supervised learning paradigm works effectively when training data shares the same distribution as the upcoming testing samples. However, this stationary assumption is often violated in real-world applications, especially when…

Machine Learning · Computer Science 2023-01-18 Yong Bai , Yu-Jie Zhang , Peng Zhao , Masashi Sugiyama , Zhi-Hua Zhou

Invariant learning demonstrates substantial potential for enhancing the generalization of graph neural networks (GNNs) with out-of-distribution (OOD) data. It aims to recognize stable features in graph data for classification, based on the…

Machine Learning · Computer Science 2025-01-23 Yongduo Sui , Jie Sun , Shuyao Wang , Zemin Liu , Qing Cui , Longfei Li , Xiang Wang

Recently, contrastiveness-based augmentation surges a new climax in the computer vision domain, where some operations, including rotation, crop, and flip, combined with dedicated algorithms, dramatically increase the model generalization…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Han Yue , Chunhui Zhang , Chuxu Zhang , Hongfu Liu

Out-of-distribution generalization can be categorized into two types: common perturbations arising from natural variations in the real world and adversarial perturbations that are intentionally crafted to deceive neural networks. While deep…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Fatemeh Amerehi , Patrick Healy

Learning from noisy labels is an important and long-standing problem in machine learning for real applications. One of the main research lines focuses on learning a label corrector to purify potential noisy labels. However, these methods…

Machine Learning · Computer Science 2023-12-05 Jian Chen , Ruiyi Zhang , Tong Yu , Rohan Sharma , Zhiqiang Xu , Tong Sun , Changyou Chen