English
Related papers

Related papers: Building Resilience to Out-of-Distribution Visual …

200 papers

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

Machine Learning · Computer Science 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

Deep Learning models are easily disturbed by variations in the input images that were not seen during training, resulting in unpredictable behaviours. Such Out-of-Distribution (OOD) images represent a significant challenge in the context of…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Benjamin Lambert , Florence Forbes , Senan Doyle , Alan Tucholka , Michel Dojat

Automated machine learning has been widely researched and adopted in the field of supervised classification and regression, but progress in unsupervised settings has been limited. We propose a novel approach to automate outlier detection…

Machine Learning · Computer Science 2024-09-10 Prabhant Singh , Joaquin Vanschoren

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

A serious problem in image classification is that a trained model might perform well for input data that originates from the same distribution as the data available for model training, but performs much worse for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Rajat Koner , Poulami Sinhamahapatra , Karsten Roscher , Stephan Günnemann , Volker Tresp

Uncertainties in machine learning are a significant roadblock for its application in safety-critical cyber-physical systems (CPS). One source of uncertainty arises from distribution shifts in the input data between training and test…

Machine Learning · Computer Science 2021-08-02 Yeli Feng , Daniel Jun Xian Ng , Arvind Easwaran

Out-of-distribution detection is crucial to the safe deployment of machine learning systems. Currently, unsupervised out-of-distribution detection is dominated by generative-based approaches that make use of estimates of the likelihood or…

Probabilistic models often use neural networks to control their predictive uncertainty. However, when making out-of-distribution (OOD)} predictions, the often-uncontrollable extrapolation properties of neural networks yield poor uncertainty…

Machine Learning · Computer Science 2022-01-19 Pierre Segonne , Yevgen Zainchkovskyy , Søren Hauberg

Out-of-distribution (O.O.D.) generalization remains to be a key challenge for real-world machine learning systems. We describe a method for O.O.D. generalization that, through training, encourages models to only preserve features in the…

Machine Learning · Computer Science 2022-08-09 Arjun Ashok , Chaitanya Devaguptapu , Vineeth Balasubramanian

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

When deployed for risk-sensitive tasks, deep neural networks must be able to detect instances with labels from outside the distribution for which they were trained. In this paper we present a novel framework to benchmark the ability of…

Machine Learning · Computer Science 2023-02-24 Ido Galil , Mohammed Dabbah , Ran El-Yaniv

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

Machine Learning · Computer Science 2023-12-05 Sergey Kolesnikov

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

Spatiotemporal neural networks have shown great promise in urban scenarios by effectively capturing temporal and spatial correlations. However, urban environments are constantly evolving, and current model evaluations are often limited to…

Machine Learning · Computer Science 2024-10-10 Hongjun Wang , Jiyuan Chen , Tong Pan , Zheng Dong , Lingyu Zhang , Renhe Jiang , Xuan Song

By design, discriminatively trained neural network classifiers produce reliable predictions only for in-distribution samples. For their real-world deployments, detecting out-of-distribution (OOD) samples is essential. Assuming OOD to be…

Machine Learning · Computer Science 2019-10-11 Sachin Vernekar , Ashish Gaurav , Vahdat Abdelzad , Taylor Denouden , Rick Salay , Krzysztof Czarnecki

Gradient-based meta-learning (GBML) algorithms are able to fast adapt to new tasks by transferring the learned meta-knowledge, while assuming that all tasks come from the same distribution (in-distribution, ID). However, in the real world,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Min Zhang , Zifeng Zhuang , Zhitao Wang , Donglin Wang , Wenbin Li

Refraining from confidently predicting when faced with categories of inputs different from those seen during training is an important requirement for the safe deployment of deep learning systems. While simple to state, this has been a…

Machine Learning · Computer Science 2021-05-18 Sunil Thulasidasan , Sushil Thapa , Sayera Dhaubhadel , Gopinath Chennupati , Tanmoy Bhattacharya , Jeff Bilmes

Deep Neural Networks are actively being used in the design of autonomous Cyber-Physical Systems (CPSs). The advantage of these models is their ability to handle high-dimensional state-space and learn compact surrogate representations of the…

Machine Learning · Computer Science 2021-08-27 Shreyas Ramakrishna , Zahra Rahiminasab , Gabor Karsai , Arvind Easwaran , Abhishek Dubey

Convolutional Neural Networks (CNNs) have shown to be powerful medical image segmentation models. In this study, we address some of the main unresolved issues regarding these models. Specifically, training of these models on small medical…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Davood Karimi , Ali Gholipour

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa