English
Related papers

Related papers: Evolving Graph Learning for Out-of-Distribution Ge…

200 papers

Graph neural networks (GNNs) learn representations from network data with naturally distributed architectures, rendering them well-suited candidates for decentralized learning. Oftentimes, this decentralized graph support changes with time…

Machine Learning · Computer Science 2020-10-27 Zhan Gao , Fernando Gama , Alejandro Ribeiro

Deep learning has achieved tremendous success with independent and identically distributed (i.i.d.) data. However, the performance of neural networks often degenerates drastically when encountering out-of-distribution (OoD) data, i.e., when…

Machine Learning · Computer Science 2022-04-01 Nanyang Ye , Kaican Li , Haoyue Bai , Runpeng Yu , Lanqing Hong , Fengwei Zhou , Zhenguo Li , Jun Zhu

During the forward pass of Deep Neural Networks (DNNs), inputs gradually transformed from low-level features to high-level conceptual labels. While features at different layers could summarize the important factors of the inputs at varying…

Machine Learning · Computer Science 2022-03-02 Haoliang Wang , Chen Zhao , Xujiang Zhao , Feng Chen

Effective interaction modeling and behavior prediction of dynamic agents play a significant role in interactive motion planning for autonomous robots. Although existing methods have improved prediction accuracy, few research efforts have…

Robotics · Computer Science 2024-01-09 Victoria M. Dax , Jiachen Li , Enna Sachdeva , Nakul Agarwal , Mykel J. Kochenderfer

Machine learning-based simulators offer the potential to model the dynamics of complex systems more efficiently than classical approaches, while retaining differentiability, a key property for materials design. Graph neural network…

Chemical Physics · Physics 2026-05-12 S. A. Shteingolts , Salman N. Salman , Dan Mendels

Machine learning models often fail to generalize well under distributional shifts. Understanding and overcoming these failures have led to a research field of Out-of-Distribution (OOD) generalization. Despite being extensively studied for…

We present an innovative framework for traffic dynamics analysis using High-Order Evolving Graphs, designed to improve spatio-temporal representations in autonomous driving contexts. Our approach constructs temporal bidirectional bipartite…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Aditya Humnabadkar , Arindam Sikdar , Benjamin Cave , Huaizhong Zhang , Paul Bakaki , Ardhendu Behera

Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. Current GNN architectures assume ideal scenarios and ignore link…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Zhan Gao , Elvin Isufi , Alejandro Ribeiro

While deep learning demonstrates its strong ability to handle independent and identically distributed (IID) data, it often suffers from out-of-distribution (OoD) generalization, where the test data come from another distribution (w.r.t. the…

Machine Learning · Computer Science 2020-12-18 Haoyue Bai , Rui Sun , Lanqing Hong , Fengwei Zhou , Nanyang Ye , Han-Jia Ye , S. -H. Gary Chan , Zhenguo Li

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

Machine Learning · Computer Science 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principles underpinning this phenomenon remain elusive. This paper…

Machine Learning · Statistics 2025-05-29 Jiawei Ge , Amanda Wang , Shange Tang , Chi Jin

Accurate modelling and quantification of predictive uncertainty is crucial in deep learning since it allows a model to make safer decisions when the data is ambiguous and facilitates the users' understanding of the model's confidence in its…

Machine Learning · Statistics 2025-08-26 Soumyasundar Pal , Liheng Ma , Amine Natik , Yingxue Zhang , Mark Coates

Graph models provide efficient tools to capture the underlying structure of data defined over networks. Many real-world network topologies are subject to change over time. Learning to model the dynamic interactions between entities in such…

Machine Learning · Computer Science 2025-01-03 Amirhossein Javaheri , Jiaxi Ying , Daniel P. Palomar , Farokh Marvasti

Graph Neural Networks (GNNs) often encounter significant performance degradation under distribution shifts between training and test data, hindering their applicability in real-world scenarios. Recent studies have proposed various methods…

Machine Learning · Computer Science 2025-09-09 Tianjun Yao , Haoxuan Li , Yongqiang Chen , Tongliang Liu , Le Song , Eric Xing , Zhiqiang Shen

We study the problem of learning graph dynamics of deformable objects that generalizes to unknown physical properties. Our key insight is to leverage a latent representation of elastic physical properties of cloth-like deformable objects…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Alberta Longhini , Marco Moletta , Alfredo Reichlin , Michael C. Welle , David Held , Zackory Erickson , Danica Kragic

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

Machine Learning · Computer Science 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

Graph Domain Adaptation (GDA) aims to bridge distribution shifts between domains by transferring knowledge from well-labeled source graphs to given unlabeled target graphs. One promising recent approach addresses graph transfer by…

Machine Learning · Computer Science 2026-02-12 Wei Chen , Xingyu Guo , Shuang Li , Yan Zhong , Zhao Zhang , Fuzhen Zhuang , Hongrui Liu , Libang Zhang , Guo Ye , Huimei He

Encouraging progress has been made towards Visual Question Answering (VQA) in recent years, but it is still challenging to enable VQA models to adaptively generalize to out-of-distribution (OOD) samples. Intuitively, recompositions of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Jingjing Jiang , Ziyi Liu , Yifan Liu , Zhixiong Nan , Nanning Zheng

Accurate routing network status estimation is a key component in Software Defined Networking. However, existing deep-learning-based methods for modeling network routing are not able to extrapolate towards unseen feature distributions. Nor…

Networking and Internet Architecture · Computer Science 2024-04-29 Yifei Jin , Marios Daoutis , Sarunas Girdzijauskas , Aristides Gionis

Domain generalization aims to improve the generalization capability of machine learning systems to out-of-distribution (OOD) data. Existing domain generalization techniques embark upon stationary and discrete environments to tackle the…

Machine Learning · Computer Science 2022-06-17 Tiexin Qin , Shiqi Wang , Haoliang Li