English
Related papers

Related papers: Improving Robustness to Out-of-Distribution Data b…

200 papers

Out-of-distribution (OOD) detection recently has drawn attention due to its critical role in the safe deployment of modern neural network architectures in real-world applications. The OOD detectors aim to distinguish samples that lie…

Signal Processing · Electrical Eng. & Systems 2023-06-16 Sabri Mustafa Kahya , Muhammet Sami Yavuz , Eckehard Steinbach

In this study, we show that diffusion models can be used in industrial scenarios to improve the data augmentation procedure in the context of surface defect detection. In general, defect detection classifiers are trained on ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Luigi Capogrosso , Federico Girella , Francesco Taioli , Michele Dalla Chiara , Muhammad Aqeel , Franco Fummi , Francesco Setti , Marco Cristani

Although pretrained Transformers such as BERT achieve high accuracy on in-distribution examples, do they generalize to new distributions? We systematically measure out-of-distribution (OOD) generalization for seven NLP datasets by…

Computation and Language · Computer Science 2020-04-17 Dan Hendrycks , Xiaoyuan Liu , Eric Wallace , Adam Dziedzic , Rishabh Krishnan , Dawn Song

Out-of-distribution generalization can be categorized into two types: common perturbations arising from natural variations in the real world and adversarial perturbations that are intentionally crafted to deceive neural networks. While deep…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Fatemeh Amerehi , Patrick Healy

In the problem of out-of-distribution (OOD) detection, the usage of auxiliary data as outlier data for fine-tuning has demonstrated encouraging performance. However, previous methods have suffered from a trade-off between classification…

Machine Learning · Computer Science 2023-08-03 Hyunjun Choi , JaeHo Chung , Hawook Jeong , Jin Young Choi

Detecting out-of-distribution (OOD) instances is crucial for the reliable deployment of machine learning models in real-world scenarios. OOD inputs are commonly expected to cause a more uncertain prediction in the primary task; however,…

Machine Learning · Computer Science 2024-05-22 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Cinà

Despite significant advancements in out-of-distribution (OOD) detection, existing methods still struggle to maintain robustness against adversarial attacks, compromising their reliability in critical real-world applications. Previous…

Machine Learning · Computer Science 2025-04-22 Hossein Mirzaei , Mackenzie W. Mathis

The crux of effective out-of-distribution (OOD) detection lies in acquiring a robust in-distribution (ID) representation, distinct from OOD samples. While previous methods predominantly leaned on recognition-based techniques for this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

Computer vision applications predict on digital images acquired by a camera from physical scenes through light. However, conventional robustness benchmarks rely on perturbations in digitized images, diverging from distribution shifts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Eunsu Baek , Keondo Park , Jiyoon Kim , Hyung-Sin Kim

Several areas have been improved with Deep Learning during the past years. Implementing Deep Neural Networks (DNN) for non-safety related applications have shown remarkable achievements over the past years; however, for using DNNs in safety…

A common explanation for the failure of out-of-distribution (OOD) generalization is that the model trained with empirical risk minimization (ERM) learns spurious features instead of invariant features. However, several recent studies…

Machine Learning · Computer Science 2023-10-31 Yongqiang Chen , Wei Huang , Kaiwen Zhou , Yatao Bian , Bo Han , James Cheng

This paper presents a fast, principled approach for detecting anomalous and out-of-distribution (OOD) samples in deep neural networks (DNN). We propose the application of linear statistical dimensionality reduction techniques on the…

Machine Learning · Computer Science 2022-03-22 Ibrahima J. Ndiour , Nilesh A. Ahuja , Omesh Tickoo

Graph neural networks (GNNs) have achieved impressive performance when testing and training graph data come from identical distribution. However, existing GNNs lack out-of-distribution generalization abilities so that their performance…

Machine Learning · Computer Science 2021-12-15 Haoyang Li , Xin Wang , Ziwei Zhang , Wenwu Zhu

Since deep learning models have been implemented in many commercial applications, it is important to detect out-of-distribution (OOD) inputs correctly to maintain the performance of the models, ensure the quality of the collected data, and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Qing Yu , Kiyoharu Aizawa

Convolutional neural networks applied for real-world classification tasks need to recognize inputs that are far or out-of-distribution (OoD) with respect to the known or training data. To achieve this, many methods estimate…

Machine Learning · Computer Science 2021-10-18 Kamil Szyc , Tomasz Walkowiak , Henryk Maciejewski

Cyber-physical systems (CPS) greatly benefit by using machine learning components that can handle the uncertainty and variability of the real-world. Typical components such as deep neural networks, however, introduce new types of hazards…

Machine Learning · Computer Science 2020-01-29 Feiyang Cai , Xenofon Koutsoukos

Neural networks are known to produce over-confident predictions on input images, even when these images are out-of-distribution (OOD) samples. This limits the applications of neural network models in real-world scenarios, where OOD samples…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Ke Fan , Yikai Wang , Qian Yu , Da Li , Yanwei Fu

Machine learning models are vulnerable to Out-Of-Distribution (OOD) examples, and such a problem has drawn much attention. However, current methods lack a full understanding of different types of OOD data: there are benign OOD data that can…

Machine Learning · Computer Science 2023-04-11 Zhuo Huang , Xiaobo Xia , Li Shen , Bo Han , Mingming Gong , Chen Gong , Tongliang Liu

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Sen Pei

Detecting out-of-distribution (OOD) inputs is a principal task for ensuring the safety of deploying deep-neural-network classifiers in open-set scenarios. OOD samples can be drawn from arbitrary distributions and exhibit deviations from…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Choubo Ding , Guansong Pang