English
Related papers

Related papers: Problem Space Transformations for Out-of-Distribut…

200 papers

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

It is crucial that users are empowered to take advantage of the functionality of a robot and use their understanding of that functionality to perform novel and creative tasks. Given a robot trained with Reinforcement Learning (RL), a user…

Robotics · Computer Science 2024-06-21 Isaac Sheidlower , Emma Bethel , Douglas Lilly , Reuben M. Aronson , Elaine Schaertl Short

Recent work in sim2real has successfully enabled robots to act in physical environments by training in simulation with a diverse ''population'' of environments (i.e. domain randomization). In this work, we focus on enabling generalization…

Machine Learning · Computer Science 2022-12-07 Jerry Zhi-Yang He , Aditi Raghunathan , Daniel S. Brown , Zackory Erickson , Anca D. Dragan

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

Machine Learning · Statistics 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu

Deep neural networks often face generalization problems to handle out-of-distribution (OOD) data, and there remains a notable theoretical gap between the contributing factors and their respective impacts. Literature evidence from…

Machine Learning · Computer Science 2024-04-24 Songming Zhang , Yuxiao Luo , Qizhou Wang , Haoang Chi , Xiaofeng Chen , Bo Han , Jinyan Li

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

Machine Learning · Computer Science 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

Data-driven molecular discovery leverages artificial intelligence/machine learning (AI/ML) and generative modeling to filter and design novel molecules. Discovering novel molecules requires accurate out-of-distribution (OOD) predictions,…

As breakthroughs in deep learning transform key industries, models are increasingly required to extrapolate on datapoints found outside the range of the training set, a challenge we coin as out-of-support (OoS) generalisation. However,…

Machine Learning · Computer Science 2026-03-06 Roussel Desmond Nzoyem

A fundamental challenge for machine learning models is generalizing to out-of-distribution (OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize the OOD generalization problem as constrained…

Machine Learning · Computer Science 2022-10-20 Hanlin Zhang , Yi-Fan Zhang , Weiyang Liu , Adrian Weller , Bernhard Schölkopf , Eric P. Xing

With the rise of stochastic generative models in robot policy learning, end-to-end visuomotor policies are increasingly successful at solving complex tasks by learning from human demonstrations. Nevertheless, since real-world evaluation…

Robotics · Computer Science 2024-10-24 Joseph A. Vincent , Haruki Nishimura , Masha Itkina , Paarth Shah , Mac Schwager , Thomas Kollar

Recently, there has been gradually more attention paid to Out-of-Distribution (OOD) performance prediction, whose goal is to predict the performance of trained models on unlabeled OOD test datasets, so that we could better leverage and…

Machine Learning · Computer Science 2025-11-03 Han Yu , Kehan Li , Dongbai Li , Yue He , Xingxuan Zhang , Peng Cui

Deep Neural Networks are actively being used in the design of autonomous Cyber-Physical Systems (CPSs). The advantage of these models is their ability to handle high-dimensional state-space and learn compact surrogate representations of the…

Machine Learning · Computer Science 2021-08-27 Shreyas Ramakrishna , Zahra Rahiminasab , Gabor Karsai , Arvind Easwaran , Abhishek Dubey

Time series frequently manifest distribution shifts, diverse latent features, and non-stationary learning dynamics, particularly in open and evolving environments. These characteristics pose significant challenges for out-of-distribution…

Machine Learning · Computer Science 2026-05-20 Xin Wu , Fei Teng , Xingwang Li , Ji Zhang , Tianrui Li , Qiang Duan

Out-of-distribution (OOD) detection and lossless compression constitute two problems that can be solved by the training of probabilistic models on a first dataset with subsequent likelihood evaluation on a second dataset, where data…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Mingtian Zhang , Andi Zhang , Steven McDonagh

End-to-end visuomotor policies trained using behavior cloning have shown a remarkable ability to generate complex, multi-modal low-level robot behaviors. However, at deployment time, these policies still struggle to act reliably when faced…

Robotics · Computer Science 2025-06-17 Pranay Gupta , Henny Admoni , Andrea Bajcsy

The ability to generalize out-of-domain (OOD) is an important goal for deep neural network development, and researchers have proposed many high-performing OOD generalization methods from various foundations. While many OOD algorithms…

Machine Learning · Computer Science 2022-08-29 Zining Zhu , Soroosh Shahtalebi , Frank Rudzicz

When testing conditions differ from those represented in training data, so-called out-of-distribution (OOD) inputs can mar the reliability of learned components in the modern robot autonomy stack. Therefore, coping with OOD data is an…

Machine learning-assisted retrosynthesis prediction models have been gaining widespread adoption, though their performances oftentimes degrade significantly when deployed in real-world applications embracing out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-12-19 Yemin Yu , Luotian Yuan , Ying Wei , Hanyu Gao , Xinhai Ye , Zhihua Wang , Fei Wu

Out-of-distribution (OOD) generalization remains a central challenge in deploying deep learning models to real-world scenarios, particularly in domains such as biomedical images, where distribution shifts are both subtle and pervasive.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Haoran Pei , Yuguang Yang , Kexin Liu , Baochang Zhang

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira