English
Related papers

Related papers: Out-of-Distribution Graph Models Merging

200 papers

Recent research underscores the pivotal role of the Out-of-Distribution (OOD) feature representation field scale in determining the efficacy of models in OOD detection. Consequently, the adoption of model ensembles has emerged as a…

Machine Learning · Computer Science 2024-08-19 Chenhui Xu , Fuxun Yu , Zirui Xu , Nathan Inkawhich , Xiang Chen

Graph Neural Networks (GNNs) often encounter significant performance degradation under distribution shifts between training and test data, hindering their applicability in real-world scenarios. Recent studies have proposed various methods…

Machine Learning · Computer Science 2025-09-09 Tianjun Yao , Haoxuan Li , Yongqiang Chen , Tongliang Liu , Le Song , Eric Xing , Zhiqiang Shen

Deep learning provides a powerful tool for machine perception when the observations resemble the training data. However, real-world robotic systems must react intelligently to their observations even in unexpected circumstances. This…

Machine Learning · Computer Science 2018-12-31 Rowan McAllister , Gregory Kahn , Jeff Clune , Sergey Levine

A regularized version of Mixture Models is proposed to learn a principal graph from a distribution of $D$-dimensional data points. In the particular case of manifold learning for ridge detection, we assume that the underlying manifold can…

Machine Learning · Computer Science 2023-07-13 Tony Bonnaire , Aurélien Decelle , Nabila Aghanim

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

Machine Learning · Computer Science 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Standard machine learning is unable to accommodate inputs which do not belong to the training distribution. The resulting models often give rise to confident incorrect predictions which may lead to devastating consequences. This problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Matej Grcić , Petra Bevandić , Zoran Kalafatić , Siniša Šegvić

The aim of this work is to develop a fully-distributed algorithmic framework for training graph convolutional networks (GCNs). The proposed method is able to exploit the meaningful relational structure of the input data, which are collected…

Machine Learning · Computer Science 2022-12-21 Simone Scardapane , Indro Spinelli , Paolo Di Lorenzo

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are…

Machine Learning · Computer Science 2021-11-09 Debmalya Mandal , Sourav Medya , Brian Uzzi , Charu Aggarwal

Detecting out-of-distribution (OOD) graphs is crucial for ensuring the safety and reliability of Graph Neural Networks. In unsupervised graph-level OOD detection, models are typically trained using only in-distribution (ID) data, resulting…

Machine Learning · Computer Science 2026-03-03 Li Sun , Lanxu Yang , Jiayu Tian , Bowen Fang , Xiaoyan Yu , Junda Ye , Peng Tang , Hao Peng , Philip S. Yu

The open-world test dataset is often mixed with out-of-distribution (OOD) samples, where the deployed models will struggle to make accurate predictions. Traditional detection methods need to trade off OOD detection and in-distribution (ID)…

Machine Learning · Computer Science 2024-04-25 Xu Shen , Yili Wang , Kaixiong Zhou , Shirui Pan , Xin Wang

Machine learning (ML) systems in natural language processing (NLP) face significant challenges in generalizing to out-of-distribution (OOD) data, where the test distribution differs from the training data distribution. This poses important…

Computation and Language · Computer Science 2023-05-24 Linyi Yang , Yaoxiao Song , Xuan Ren , Chenyang Lyu , Yidong Wang , Lingqiao Liu , Jindong Wang , Jennifer Foster , Yue Zhang

We introduce JointNet, a novel neural network architecture for modeling the joint distribution of images and an additional dense modality (e.g., depth maps). JointNet is extended from a pre-trained text-to-image diffusion model, where a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Jingyang Zhang , Shiwei Li , Yuanxun Lu , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan , Yao Yao

Likelihood from a generative model is a natural statistic for detecting out-of-distribution (OoD) samples. However, generative models have been shown to assign higher likelihood to OoD samples compared to ones from the training…

Machine Learning · Computer Science 2019-10-22 Jiaming Song , Yang Song , Stefano Ermon

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

Machine Learning · Computer Science 2022-02-21 Abderrahmen Amich , Birhanu Eshete

Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph…

Machine Learning · Computer Science 2024-03-08 Man Wu , Xin Zheng , Qin Zhang , Xiao Shen , Xiong Luo , Xingquan Zhu , Shirui Pan

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

Machine Learning · Computer Science 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

Graph Neural Networks (GNNs) and differential equations (DEs) are two rapidly advancing areas of research that have shown remarkable synergy in recent years. GNNs have emerged as powerful tools for learning on graph-structured data, while…

Machine Learning · Computer Science 2025-06-30 Zewen Liu , Xiaoda Wang , Bohan Wang , Zijie Huang , Carl Yang , Wei Jin

Model merging integrates multiple task-specific models into a single consolidated one. Recent research has made progress in improving merging performance for in-distribution or multi-task scenarios, but domain generalization in model…

Machine Learning · Computer Science 2026-03-10 Levy Chaves , Chao Zhou , Rebekka Burkholz , Eduardo Valle , Sandra Avila

Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods…

Machine Learning · Computer Science 2024-11-21 Qin Tian , Chen Zhao , Minglai Shao , Wenjun Wang , Yujie Lin , Dong Li

Graph data are inherently complex and heterogeneous, leading to a high natural diversity of distributional shifts. However, it remains unclear how to build machine learning architectures that generalize to the complex distributional shifts…

Machine Learning · Computer Science 2024-10-29 Shirley Wu , Kaidi Cao , Bruno Ribeiro , James Zou , Jure Leskovec