English
Related papers

Related papers: Pruning Spurious Subgraphs for Graph Out-of-Distri…

200 papers

Due to the significant computational challenge of training large-scale graph neural networks (GNNs), various sparse learning techniques have been exploited to reduce memory and storage costs. Examples include \textit{graph sparsification}…

Machine Learning · Computer Science 2023-02-07 Shuai Zhang , Meng Wang , Pin-Yu Chen , Sijia Liu , Songtao Lu , Miao Liu

Graph Neural Network (GNN) research has produced strategies to modify a graph's edges using gradients from a trained GNN, with the goal of network design. However, the factors which govern gradient-based editing are understudied, obscuring…

Machine Learning · Computer Science 2023-10-27 Donald Loveland , Rajmonda Caceres

Out-of-distribution (OOD) generalization has emerged as a critical challenge in graph learning, as real-world graph data often exhibit diverse and shifting environments that traditional models fail to generalize across. A promising solution…

Machine Learning · Computer Science 2025-08-05 Xu Shen , Yixin Liu , Yili Wang , Rui Miao , Yiwei Dai , Shirui Pan , Yi Chang , Xin Wang

Methods which utilize the outputs or feature representations of predictive models have emerged as promising approaches for out-of-distribution (OOD) detection of image inputs. However, these methods struggle to detect OOD inputs that share…

Machine Learning · Computer Science 2023-02-09 Lily H. Zhang , Rajesh Ranganath

Graph Neural Networks have achieved impressive results across diverse network modeling tasks, but accurately estimating uncertainty on graphs remains difficult, especially under distributional shifts. Unlike traditional uncertainty…

Machine Learning · Computer Science 2025-10-15 Fred Xu , Thomas Markovich

In the context of modern machine learning, models deployed in real-world scenarios often encounter diverse data shifts like covariate and semantic shifts, leading to challenges in both out-of-distribution (OOD) generalization and detection.…

Machine Learning · Computer Science 2024-09-30 Han Wang , Yixuan Li

Lightweight model design has become an important direction in the application of deep learning technology, pruning is an effective mean to achieve a large reduction in model parameters and FLOPs. The existing neural network pruning methods…

Machine Learning · Computer Science 2021-11-19 Zhuangzhi Chen , Jingyang Xiang , Yao Lu , Qi Xuan , Xiaoniu Yang

Recent advances in robust semi-supervised learning (SSL) typically filter out-of-distribution (OOD) information at the sample level. We argue that an overlooked problem of robust SSL is its corrupted information on semantic level,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Yu Wang , Pengchong Qiao , Chang Liu , Guoli Song , Xiawu Zheng , Jie Chen

Graph Neural Networks (GNNs) are important across different domains, such as social network analysis and recommendation systems, due to their ability to model complex relational data. This paper introduces subgraph queries as a new task for…

Machine Learning · Computer Science 2024-08-09 Erfaneh Mahmoudzadeh , Parmis Naddaf , Kiarash Zahirnia , Oliver Schulte

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate…

Machine Learning · Computer Science 2025-03-31 Kexin Zhang , Shuhan Liu , Song Wang , Weili Shi , Chen Chen , Pan Li , Sheng Li , Jundong Li , Kaize Ding

This paper focuses on out-of-distribution generalization on graphs where performance drops due to the unseen distribution shift. Previous graph domain generalization works always resort to learning an invariant predictor among different…

Machine Learning · Computer Science 2022-06-22 Junchi Yu , Jian Liang , Ran He

Deep learning architectures with a huge number of parameters are often compressed using pruning techniques to ensure computational efficiency of inference during deployment. Despite multitude of empirical advances, there is a lack of…

Machine Learning · Computer Science 2021-06-14 Rupam Acharyya , Ankani Chattoraj , Boyu Zhang , Shouman Das , Daniel Stefankovic

In this work, we propose a graph-adaptive pruning (GAP) method for efficient inference of convolutional neural networks (CNNs). In this method, the network is viewed as a computational graph, in which the vertices denote the computation…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Mengdi Wang , Qing Zhang , Jun Yang , Xiaoyuan Cui , Wei Lin

To build safe and reliable graph machine learning systems, unsupervised graph-level anomaly detection (GLAD) and unsupervised graph-level out-of-distribution (OOD) detection (GLOD) have received significant attention in recent years. Though…

Machine Learning · Computer Science 2025-04-07 Yili Wang , Yixin Liu , Xu Shen , Chenyu Li , Kaize Ding , Rui Miao , Ying Wang , Shirui Pan , Xin Wang

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

Machine Learning · Computer Science 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra

Graph Neural Networks (GNNs) have demonstrated superior performance across various graph learning tasks but face significant computational challenges when applied to large-scale graphs. One effective approach to mitigate these challenges is…

Machine Learning · Computer Science 2024-10-04 Guibin Zhang , Xiangguo Sun , Yanwei Yue , Chonghe Jiang , Kun Wang , Tianlong Chen , Shirui Pan

There is increasing evidence suggesting neural networks' sensitivity to distribution shifts, so that research on out-of-distribution (OOD) generalization comes into the spotlight. Nonetheless, current endeavors mostly focus on Euclidean…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Hengrui Zhang , Junchi Yan , David Wipf

In this work, we investigate the problem of out-of-distribution (OOD) generalization for unsupervised learning methods on graph data. This scenario is particularly challenging because graph neural networks (GNNs) have been shown to be…

Machine Learning · Computer Science 2023-08-03 Yun Zhu , Haizhou Shi , Zhenshuo Zhang , Siliang Tang

Neural networks (NNs), despite their success and wide adoption, still struggle to extrapolate out-of-distribution (OOD), i.e., to inputs that are not well-represented by their training dataset. Addressing the OOD generalization gap is…

Machine Learning · Computer Science 2025-04-01 Robert R. Nerem , Samantha Chen , Sanjoy Dasgupta , Yusu Wang