中文
相关论文

相关论文: Out-of-Distribution Generalization in Graph Founda…

200 篇论文

Machine learning has achieved tremendous success in a variety of domains in recent years. However, a lot of these success stories have been in places where the training and the testing distributions are extremely similar to each other. In…

机器学习 · 统计学 2021-03-05 Martin Arjovsky

Out-of-distribution (O.O.D.) generalization remains to be a key challenge for real-world machine learning systems. We describe a method for O.O.D. generalization that, through training, encourages models to only preserve features in the…

机器学习 · 计算机科学 2022-08-09 Arjun Ashok , Chaitanya Devaguptapu , Vineeth Balasubramanian

There are many computer vision applications including object segmentation, classification, object detection, and reconstruction for which machine learning (ML) shows state-of-the-art performance. Nowadays, we can build ML tools for such…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Hamza Riaz , Alan F. Smeaton

Detecting out-of-distribution (OOD) samples is crucial for ensuring the safety of machine learning systems and has shaped the field of OOD detection. Meanwhile, several other problems are closely related to OOD detection, including anomaly…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Atsuyuki Miyai , Jingkang Yang , Jingyang Zhang , Yifei Ming , Yueqian Lin , Qing Yu , Go Irie , Shafiq Joty , Yixuan Li , Hai Li , Ziwei Liu , Toshihiko Yamasaki , Kiyoharu Aizawa

Out-of-distribution (OOD) detection poses a significant challenge for Graph Neural Networks (GNNs), particularly in open-world scenarios with varying distribution shifts. Most existing OOD detection methods on graphs primarily focus on…

机器学习 · 计算机科学 2024-10-24 Zhixia He , Chen Zhao , Minglai Shao , Yujie Lin , Dong Li , Qin Tian

We study the Out-of-Distribution (OOD) generalization in machine learning and propose a general framework that establishes information-theoretic generalization bounds. Our framework interpolates freely between Integral Probability Metric…

信息论 · 计算机科学 2024-12-16 Wenliang Liu , Guanding Yu , Lele Wang , Renjie Liao

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

Deep network models perform excellently on In-Distribution (ID) data, but can significantly fail on Out-Of-Distribution (OOD) data. While developing methods focus on improving OOD generalization, few attention has been paid to evaluating…

机器学习 · 计算机科学 2021-11-22 Rui Hu , Jitao Sang , Jinqiang Wang , Rui Hu , Chaoquan Jiang

Learning on molecule graphs has become an increasingly important topic in AI for science, which takes full advantage of AI to facilitate scientific discovery. Existing solutions on modeling molecules utilize Graph Neural Networks (GNNs) to…

机器学习 · 计算机科学 2025-05-13 Limin Li , Kuo Yang , Wenjie Du , Pengkun Wang , Zhengyang Zhou , Yang Wang

Learning on graphs, where instance nodes are inter-connected, has become one of the central problems for deep learning, as relational structures are pervasive and induce data inter-dependence which hinders trivial adaptation of existing…

机器学习 · 计算机科学 2023-03-10 Qitian Wu , Yiting Chen , Chenxiao Yang , Junchi Yan

Graph neural networks (GNNs) are proven effective in extracting complex node and structural information from graph data. While current GNNs perform well in node classification tasks within in-distribution (ID) settings, real-world scenarios…

机器学习 · 计算机科学 2025-05-08 Tao Yin , Chen Zhao , Xiaoyan Liu , Minglai Shao

Recently, data heterogeneity among the training datasets on the local clients (a.k.a., Non-IID data) has attracted intense interest in Federated Learning (FL), and many personalized federated learning methods have been proposed to handle…

机器学习 · 计算机科学 2022-11-22 Xueyang Tang , Song Guo , Jie Zhang

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations from structured data. Despite their growing popularity and success across various applications, GNNs encounter several challenges that limit their…

机器学习 · 计算机科学 2026-02-03 Yassine Abbahaddou

Graph-level representation learning is important in a wide range of applications. Existing graph-level models are generally built on i.i.d. assumption for both training and testing graphs. However, in an open world, models can encounter…

机器学习 · 计算机科学 2024-07-19 Zhihao Ding , Jieming Shi , Shiqi Shen , Xuequn Shang , Jiannong Cao , Zhipeng Wang , Zhi Gong

Graph neural networks (GNNs) have emerged as a powerful model to capture critical graph patterns. Instead of treating them as black boxes in an end-to-end fashion, attempts are arising to explain the model behavior. Existing works mainly…

机器学习 · 计算机科学 2024-02-22 Yi Nian , Yurui Chang , Wei Jin , Lu Lin

The existing methods learn geographic network representations through deep graph neural networks (GNNs) based on the i.i.d. assumption. However, the spatial heterogeneity and temporal dynamics of geographic data make the out-of-distribution…

机器学习 · 计算机科学 2025-03-26 Yuhan Wang , Silu He , Qinyao Luo , Hongyuan Yuan , Ling Zhao , Jiawei Zhu , Haifeng Li

Few-shot Out-of-Distribution (OOD) detection has emerged as a critical research direction in machine learning for practical deployment. Most existing Few-shot OOD detection methods suffer from insufficient generalization capability for the…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Pinxuan Li , Bing Cao , Changqing Zhang , Qinghua Hu

Dynamic multi-relational graphs are an expressive relational representation for data enclosing entities and relations of different types, and where relationships are allowed to vary in time. Addressing predictive tasks over such data…

机器学习 · 计算机科学 2024-03-19 Asma Sattar , Georgios Deligiorgis , Marco Trincavelli , Davide Bacciu

Most existing deep learning models are trained based on the closed-world assumption, where the test data is assumed to be drawn i.i.d. from the same distribution as the training data, known as in-distribution (ID). However, when models are…

机器学习 · 计算机科学 2022-11-09 Yixin Liu , Kaize Ding , Huan Liu , Shirui Pan