English
Related papers

Related papers: Investigating Out-of-Distribution Generalization o…

200 papers

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

Due to the performance degradation of graph neural networks (GNNs) under distribution shifts, the work on out-of-distribution (OOD) generalization on graphs has received widespread attention. A novel perspective involves distinguishing…

Machine Learning · Computer Science 2024-06-04 Haoran Yang , Xiaobing Pei , Kai Yuan

Most existing deep learning models are trained based on the closed-world assumption, where the test data is assumed to be drawn i.i.d. from the same distribution as the training data, known as in-distribution (ID). However, when models are…

Machine Learning · Computer Science 2022-11-09 Yixin Liu , Kaize Ding , Huan Liu , Shirui Pan

Traditional machine learning methods heavily rely on the independent and identically distribution assumption, which imposes limitations when the test distribution deviates from the training distribution. To address this crucial issue,…

Machine Learning · Computer Science 2024-03-26 Qin Tian , Wenjun Wang , Chen Zhao , Minglai Shao , Wang Zhang , Dong Li

Deep neural networks (DNNs) deployed in real-world applications can encounter out-of-distribution (OOD) data and adversarial examples. These represent distinct forms of distributional shifts that can significantly impact DNNs' reliability…

Machine Learning · Computer Science 2024-04-09 Naveen Karunanayake , Ravin Gunawardena , Suranga Seneviratne , Sanjay Chawla

Graph neural networks (GNNs) have been demonstrated to perform well in graph representation learning, but always lacking in generalization capability when tackling out-of-distribution (OOD) data. Graph invariant learning methods, backed by…

Machine Learning · Computer Science 2023-12-19 Tianrui Jia , Haoyang Li , Cheng Yang , Tao Tao , Chuan Shi

This paper studies a novel problem of out-of-distribution graph models merging, which aims to construct a generalized model from multiple graph models pre-trained on different domains with distribution discrepancy. This problem is…

Machine Learning · Computer Science 2026-03-18 Yidi Wang , Ziyue Qiao , Jiawei Gu , Xubin Zheng , Pengyang Wang , Xiaobing Pei , Xiao Luo

The problem of out-of-distribution detection for graph classification is far from being solved. The existing models tend to be overconfident about OOD examples or completely ignore the detection task. In this work, we consider this problem…

Machine Learning · Computer Science 2022-06-23 Gleb Bazhenov , Sergei Ivanov , Maxim Panov , Alexey Zaytsev , Evgeny Burnaev

Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A…

Machine Learning · Computer Science 2024-04-17 Pietro Recalcati , Fabio Garcea , Luca Piano , Fabrizio Lamberti , Lia Morra

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

Machine Learning · Computer Science 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

The out-of-distribution (OOD) problem generally arises when neural networks encounter data that significantly deviates from the training data distribution, i.e., in-distribution (InD). In this paper, we study the OOD problem from a neuron…

Machine Learning · Computer Science 2024-03-12 Yibing Liu , Chris Xing Tian , Haoliang Li , Lei Ma , Shiqi Wang

In this work, we investigate the problem of out-of-distribution (OOD) generalization for unsupervised learning methods on graph data. This scenario is particularly challenging because graph neural networks (GNNs) have been shown to be…

Machine Learning · Computer Science 2023-08-03 Yun Zhu , Haizhou Shi , Zhenshuo Zhang , Siliang Tang

Out-of-distribution (OOD) detection poses a significant challenge for Graph Neural Networks (GNNs), particularly in open-world scenarios with varying distribution shifts. Most existing OOD detection methods on graphs primarily focus on…

Machine Learning · Computer Science 2024-10-24 Zhixia He , Chen Zhao , Minglai Shao , Yujie Lin , Dong Li , Qin Tian

Object recognition and viewpoint estimation lie at the heart of visual understanding. Recent works suggest that convolutional neural networks (CNNs) fail to generalize to out-of-distribution (OOD) category-viewpoint combinations, ie.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Spandan Madan , Timothy Henry , Jamell Dozier , Helen Ho , Nishchal Bhandari , Tomotake Sasaki , Frédo Durand , Hanspeter Pfister , Xavier Boix

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

Machine Learning · Computer Science 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Haiyang Lin , Mingyu Yan , Xiaochun Ye , Dongrui Fan , Shirui Pan , Wenguang Chen , Yuan Xie

Graphs Neural Networks (GNNs) demonstrate high-performance on the link prediction (LP) task. However, these models often rely on all dataset samples being drawn from the same distribution. In addition, graph generative models (GGMs) show a…

Machine Learning · Computer Science 2025-07-17 Jay Revolinsky , Harry Shomer , Jiliang Tang

Graph Out-of-Distribution (OOD) detection aims to identify whether a test graph deviates from the distribution of graphs observed during training, which is critical for ensuring the reliability of Graph Neural Networks (GNNs) when deployed…

Machine Learning · Computer Science 2026-02-20 Luzhi Wang , Xuanshuo Fu , He Zhang , Chuang Liu , Xiaobao Wang , Hongbo Liu

Fault detection in power distribution grids is critical for ensuring system reliability and preventing costly outages. Moreover, fault detection methodologies should remain robust to evolving grid topologies caused by factors such as…

Machine Learning · Computer Science 2025-10-07 Burak Karabulut , Carlo Manna , Chris Develder