English
Related papers

Related papers: Enabling Structure-Only Initialization and Out-of-…

200 papers

Out-Of-Distribution (OOD) generalization has gained increasing attentions for machine learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation under distribution shifts. Existing graph OOD methods tend to…

Machine Learning · Computer Science 2025-05-12 Henan Sun , Xunkai Li , Lei Zhu , Junyi Han , Guang Zeng , Ronghua Li , Guoren Wang

There has been a massive increase in research interest towards applying data driven methods to problems in mechanics. While traditional machine learning (ML) methods have enabled many breakthroughs, they rely on the assumption that the…

Machine Learning · Statistics 2022-09-16 Lingxiao Yuan , Harold S. Park , Emma Lejeune

We propose a method for improving the prediction accuracy of learned robot dynamics models on out-of-distribution (OOD) states. We achieve this by leveraging two key sources of structure often present in robot dynamics: 1) sparsity, i.e.,…

Robotics · Computer Science 2024-03-21 Yating Lin , Glen Chou , Dmitry Berenson

A critical vulnerability of supervised deep learning in high-dimensional tabular domains is "generalization collapse": models form precise decision boundaries around known training distributions but fail catastrophically when encountering…

Machine Learning · Computer Science 2026-03-10 Rajeeb Thapa Chhetri , Saurab Thapa , Avinash Kumar , Zhixiong Chen

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principles underpinning this phenomenon remain elusive. This paper…

Machine Learning · Statistics 2025-05-29 Jiawei Ge , Amanda Wang , Shange Tang , Chi Jin

The simulation of microcirculatory blood flow in realistic vascular architectures poses significant challenges due to the multiscale nature of the problem and the topological complexity of capillary networks. In this work, we propose a…

Numerical Analysis · Mathematics 2025-12-12 Paolo Botta , Piermario Vitullo , Thomas Ventimiglia , Andreas Linninger , Paolo Zunino

We leverage physics-embedded differentiable graph network simulators (GNS) to accelerate particulate and fluid simulations to solve forward and inverse problems. GNS represents the domain as a graph with particles as nodes and learned…

Geophysics · Physics 2023-09-26 Krishna Kumar , Yongjin Choi

Generalization bounds are a critical tool to assess the training data requirements of Quantum Machine Learning (QML). Recent work has established guarantees for in-distribution generalization of quantum neural networks (QNNs), where…

Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the…

This study aims to predict the spatio-temporal evolution of physical quantities observed in multi-layered display panels subjected to the drop impact of a ball. To model these complex interactions, graph neural networks have emerged as…

Computational Physics · Physics 2024-11-05 Jiyong Kim , Jangseop Park , Nayong Kim , Younyeol Yu , Kiseok Chang , Chang-Seung Woo , Sunwoong Yang , Namwoo Kang

Due to the performance degradation of graph neural networks (GNNs) under distribution shifts, the work on out-of-distribution (OOD) generalization on graphs has received widespread attention. A novel perspective involves distinguishing…

Machine Learning · Computer Science 2024-06-04 Haoran Yang , Xiaobing Pei , Kai Yuan

Molecular dynamics (MD) simulation is essential for various scientific domains but computationally expensive. Learning-based force fields have made significant progress in accelerating ab-initio MD simulation but are not fast enough for…

Machine Learning · Computer Science 2023-08-29 Xiang Fu , Tian Xie , Nathan J. Rebello , Bradley D. Olsen , Tommi Jaakkola

Neural forecasting of spatiotemporal time series drives both research and industrial innovation in several relevant application domains. Graph neural networks (GNNs) are often the core component of the forecasting architecture. However, in…

Machine Learning · Computer Science 2023-02-21 Andrea Cini , Ivan Marisca , Filippo Maria Bianchi , Cesare Alippi

Deep neural networks (DNNs) deployed in real-world applications can encounter out-of-distribution (OOD) data and adversarial examples. These represent distinct forms of distributional shifts that can significantly impact DNNs' reliability…

Machine Learning · Computer Science 2024-04-09 Naveen Karunanayake , Ravin Gunawardena , Suranga Seneviratne , Sanjay Chawla

There are many computer vision applications including object segmentation, classification, object detection, and reconstruction for which machine learning (ML) shows state-of-the-art performance. Nowadays, we can build ML tools for such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Hamza Riaz , Alan F. Smeaton

Graph neural architecture search (GraphNAS) has demonstrated advantages in mitigating performance degradation of graph neural networks (GNNs) due to distribution shifts. Recent approaches introduce weight sharing across tailored…

Machine Learning · Computer Science 2025-03-07 Qiyi Wang , Yinning Shao , Yunlong Ma , Min Liu

Classification tasks present challenges due to class imbalances and evolving data distributions. Addressing these issues requires a robust method to handle imbalances while effectively detecting out-of-distribution (OOD) samples not…

Machine Learning · Computer Science 2024-09-05 Priyanka Chudasama , Anil Surisetty , Aakarsh Malhotra , Alok Singh

Graph Neural Networks (GNNs) are widely used for node classification tasks but often fail to generalize when training and test nodes come from different distributions, limiting their practicality. To overcome this, recent approaches adopt…

Machine Learning · Computer Science 2024-06-04 Weihuang Zheng , Jiashuo Liu , Jiaxing Li , Jiayun Wu , Peng Cui , Youyong Kong

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

Machine Learning · Computer Science 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Machine learning-assisted retrosynthesis prediction models have been gaining widespread adoption, though their performances oftentimes degrade significantly when deployed in real-world applications embracing out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-12-19 Yemin Yu , Luotian Yuan , Ying Wei , Hanyu Gao , Xinhai Ye , Zhihua Wang , Fei Wu