中文
相关论文

相关论文: Out-of-Distribution Generalization in Graph Founda…

200 篇论文

Out-of-distribution (OOD) generalization is challenging because distribution shifts come in many forms. Numerous algorithms exist to address specific settings, but choosing the right training algorithm for the right dataset without trial…

机器学习 · 计算机科学 2025-06-03 Liangze Jiang , Damien Teney

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

机器学习 · 计算机科学 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

Foundation Models (FMs) serve as a general class for the development of artificial intelligence systems, offering broad potential for generalization across a spectrum of downstream tasks. Despite extensive research into self-supervised…

机器学习 · 计算机科学 2024-06-17 Yuhao Xu , Xinqi Liu , Keyu Duan , Yi Fang , Yu-Neng Chuang , Daochen Zha , Qiaoyu Tan

Out-of-distribution (OOD) generalization is an important issue for Graph Neural Networks (GNNs). Recent works employ different graph editions to generate augmented environments and learn an invariant GNN for generalization. However, the…

机器学习 · 计算机科学 2023-03-28 Junchi Yu , Jian Liang , Ran He

Generalization bounds are a critical tool to assess the training data requirements of Quantum Machine Learning (QML). Recent work has established guarantees for in-distribution generalization of quantum neural networks (QNNs), where…

Graph self-supervised learning (SSL) is now a go-to method for pre-training graph foundation models (GFMs). There is a wide variety of knowledge patterns embedded in the graph data, such as node properties and clusters, which are crucial to…

机器学习 · 计算机科学 2025-05-15 Ziwen Zhao , Yixin Su , Yuhua Li , Yixiong Zou , Ruixuan Li , Rui Zhang

Despite recent success in using the invariance principle for out-of-distribution (OOD) generalization on Euclidean data (e.g., images), studies on graph data are still limited. Different from images, the complex nature of graphs poses…

机器学习 · 计算机科学 2022-10-12 Yongqiang Chen , Yonggang Zhang , Yatao Bian , Han Yang , Kaili Ma , Binghui Xie , Tongliang Liu , Bo Han , James Cheng

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

机器学习 · 计算机科学 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia

In the field of computer vision, fine-tuning pre-trained models has become a prevalent strategy for out-of-distribution (OOD) generalization tasks. Different from most prior work that has focused on advancing learning algorithms, we…

机器学习 · 计算机科学 2025-04-29 Hiroki Naganuma , Ryuichiro Hataya , Kotaro Yoshida , Ioannis Mitliagkas

Graph foundation models (GFMs), pretrained on massive graph data, have transformed graph machine learning by supporting general-purpose reasoning across diverse graph tasks and domains. Existing GFMs pretrained with fixed-hop subgraph…

机器学习 · 计算机科学 2026-05-12 Haokun Liu , Zezhong Ding , Xike Xie

There has been a massive increase in research interest towards applying data driven methods to problems in mechanics. While traditional machine learning (ML) methods have enabled many breakthroughs, they rely on the assumption that the…

机器学习 · 统计学 2022-09-16 Lingxiao Yuan , Harold S. Park , Emma Lejeune

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

机器学习 · 计算机科学 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods…

机器学习 · 计算机科学 2024-11-21 Qin Tian , Chen Zhao , Minglai Shao , Wenjun Wang , Yujie Lin , Dong Li

Graph Neural Network-based methods face privacy leakage risks due to the introduction of topological structures about the targets, which allows attackers to bypass the target's prior knowledge of the sensitive attributes and realize…

机器学习 · 计算机科学 2025-05-27 Jinyan Wang , Liu Yang , Yuecen Wei , Jiaxuan Si , Chenhao Guo , Qingyun Sun , Xianxian Li , Xingcheng Fu

Out-of-distribution (OOD) generalisation is considered a hallmark of human and animal intelligence. To achieve OOD through composition, a system must discover the environment-invariant properties of experienced input-output mappings and…

机器学习 · 计算机科学 2025-05-19 George Dimitriadis , Spyridon Samothrakis

Graph Neural Networks (GNNs) have emerged as a powerful tool to capture intricate network patterns, achieving success across different domains. However, existing GNNs require careful domain-specific architecture designs and training from…

机器学习 · 计算机科学 2025-05-30 Jingzhe Liu , Haitao Mao , Zhikai Chen , Bingheng Li , Wenqi Fan , Mingxuan Ju , Tong Zhao , Neil Shah , Jiliang Tang

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

机器学习 · 计算机科学 2021-12-03 Peyman Morteza , Yixuan Li

Detecting out-of-distribution (OOD) samples plays a key role in open-world and safety-critical applications such as autonomous systems and healthcare. Recently, self-supervised representation learning techniques (via contrastive learning…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Sina Mohseni , Arash Vahdat , Jay Yadawa

Graph foundation models (GFMs) have recently attracted interest due to the promise of graph neural network (GNN) architectures that generalize zero-shot across graphs of arbitrary scales, feature dimensions, and domains. While existing work…

机器学习 · 计算机科学 2026-03-25 Benjamin Gutteridge , Michael Bronstein , Xiaowen Dong

Domain generalization aims to solve the challenge of Out-of-Distribution (OOD) generalization by leveraging common knowledge learned from multiple training domains to generalize to unseen test domains. To accurately evaluate the OOD…

机器学习 · 计算机科学 2024-03-26 Han Yu , Xingxuan Zhang , Renzhe Xu , Jiashuo Liu , Yue He , Peng Cui