English
Related papers

Related papers: Building Resilience to Out-of-Distribution Visual …

200 papers

Accurate trajectory prediction is essential for the safe operation of autonomous vehicles in real-world environments. Even well-trained machine learning models may produce unreliable predictions due to discrepancies between training data…

Robotics · Computer Science 2025-04-24 Tongfe Guo , Taposh Banerjee , Rui Liu , Lili Su

In this paper, we consider the contextual robust optimization problem under an out-of-distribution setting. The contextual robust optimization problem considers a risk-sensitive objective function for an optimization problem with the…

Optimization and Control · Mathematics 2025-06-06 Zhongze Cai , Hansheng Jiang , Xiaocheng Li

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

Machine Learning · Computer Science 2022-02-21 Abderrahmen Amich , Birhanu Eshete

Distributed training in deep learning (DL) is common practice as data and models grow. The current practice for distributed training of deep neural networks faces the challenges of communication bottlenecks when operating at scale, and…

Machine Learning · Computer Science 2020-12-21 Shubhankar Gahlot , Junqi Yin , Mallikarjun Shankar

The increased success of Deep Learning (DL) has recently sparked large-scale deployment of DL models in many diverse industry segments. Yet, a crucial weakness of supervised model is the inherent difficulty in handling out-of-distribution…

Machine Learning · Computer Science 2021-07-15 Lixuan Yang , Dario Rossi

To create state-of-the-art models for many downstream tasks, it has become common practice to fine-tune a pre-trained large vision model. However, it remains an open question of how to best determine which of the many possible model…

Machine Learning · Computer Science 2025-12-08 Simon Guiroy , Mats Richter , Sarath Chandar , Christopher Pal

Progress in machine learning is typically measured by training and testing a model on the same distribution of data, i.e., the same domain. This over-estimates future accuracy on out-of-distribution data. The Visual Domain Adaptation…

Machine Learning · Computer Science 2021-07-26 Dina Bashkirova , Dan Hendrycks , Donghyun Kim , Samarth Mishra , Kate Saenko , Kuniaki Saito , Piotr Teterwak , Ben Usman

Out-of-distribution detection is one of the most critical issue in the deployment of machine learning. The data analyst must assure that data in operation should be compliant with the training phase as well as understand if the environment…

Artificial Intelligence · Computer Science 2023-08-22 Giacomo De Bernardi , Sara Narteni , Enrico Cambiaso , Maurizio Mongelli

Deep neural networks often suffer from overconfidence which can be partly remedied by improved out-of-distribution detection. For this purpose, we propose a novel approach that allows for the generation of out-of-distribution datasets based…

Machine Learning · Computer Science 2021-05-10 Felix Möller , Diego Botache , Denis Huseljic , Florian Heidecker , Maarten Bieshaar , Bernhard Sick

Several areas have been improved with Deep Learning during the past years. Implementing Deep Neural Networks (DNN) for non-safety related applications have shown remarkable achievements over the past years; however, for using DNNs in safety…

Robustness in AI systems refers to their ability to maintain reliable and accurate performance under various conditions, including out-of-distribution (OOD) samples, adversarial attacks, and environmental changes. This is crucial in…

Artificial Intelligence · Computer Science 2025-10-15 Wissam Salhab , Darine Ameyed , Hamid Mcheick , Fehmi Jaafar

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Supervised classification methods often assume the train and test data distributions are the same and that all classes in the test set are present in the training set. However, deployed classifiers often require the ability to recognize…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Ryne Roady , Tyler L. Hayes , Ronald Kemker , Ayesha Gonzales , Christopher Kanan

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are distributed (unevenly) over an extremely large number of \nodes, but the goal remains to…

Machine Learning · Computer Science 2015-11-12 Jakub Konečný , Brendan McMahan , Daniel Ramage

Standard classification theory assumes that the distribution of images in the test and training sets are identical. Unfortunately, real-life scenarios typically feature unseen data (``out-of-distribution data") which is different from data…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Gianluca Barone , Aashrit Cunchala , Rudy Nunez

Out-of-distribution (OOD) generalization is a challenging machine learning problem yet highly desirable in many high-stake applications. Existing methods suffer from overly pessimistic modeling with low generalization confidence. As…

Machine Learning · Computer Science 2024-06-10 Fengchun Qiao , Xi Peng

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

In the field of computer vision, fine-tuning pre-trained models has become a prevalent strategy for out-of-distribution (OOD) generalization tasks. Different from most prior work that has focused on advancing learning algorithms, we…

Machine Learning · Computer Science 2025-04-29 Hiroki Naganuma , Ryuichiro Hataya , Kotaro Yoshida , Ioannis Mitliagkas

In some scenarios, classifier requires detecting out-of-distribution samples far from its training data. With desirable characteristics, reconstruction autoencoder-based methods deal with this problem by using input reconstruction error as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yibo Zhou