中文
相关论文

相关论文: Improving Robustness to Out-of-Distribution Data b…

200 篇论文

Out-of-distribution (OOD) detection recently has drawn attention due to its critical role in the safe deployment of modern neural network architectures in real-world applications. The OOD detectors aim to distinguish samples that lie…

信号处理 · 电气工程与系统科学 2023-06-16 Sabri Mustafa Kahya , Muhammet Sami Yavuz , Eckehard Steinbach

In this study, we show that diffusion models can be used in industrial scenarios to improve the data augmentation procedure in the context of surface defect detection. In general, defect detection classifiers are trained on ground-truth…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Luigi Capogrosso , Federico Girella , Francesco Taioli , Michele Dalla Chiara , Muhammad Aqeel , Franco Fummi , Francesco Setti , Marco Cristani

Although pretrained Transformers such as BERT achieve high accuracy on in-distribution examples, do they generalize to new distributions? We systematically measure out-of-distribution (OOD) generalization for seven NLP datasets by…

计算与语言 · 计算机科学 2020-04-17 Dan Hendrycks , Xiaoyuan Liu , Eric Wallace , Adam Dziedzic , Rishabh Krishnan , Dawn Song

Out-of-distribution generalization can be categorized into two types: common perturbations arising from natural variations in the real world and adversarial perturbations that are intentionally crafted to deceive neural networks. While deep…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Fatemeh Amerehi , Patrick Healy

In the problem of out-of-distribution (OOD) detection, the usage of auxiliary data as outlier data for fine-tuning has demonstrated encouraging performance. However, previous methods have suffered from a trade-off between classification…

机器学习 · 计算机科学 2023-08-03 Hyunjun Choi , JaeHo Chung , Hawook Jeong , Jin Young Choi

Detecting out-of-distribution (OOD) instances is crucial for the reliable deployment of machine learning models in real-world scenarios. OOD inputs are commonly expected to cause a more uncertain prediction in the primary task; however,…

机器学习 · 计算机科学 2024-05-22 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Cinà

Despite significant advancements in out-of-distribution (OOD) detection, existing methods still struggle to maintain robustness against adversarial attacks, compromising their reliability in critical real-world applications. Previous…

机器学习 · 计算机科学 2025-04-22 Hossein Mirzaei , Mackenzie W. Mathis

The crux of effective out-of-distribution (OOD) detection lies in acquiring a robust in-distribution (ID) representation, distinct from OOD samples. While previous methods predominantly leaned on recognition-based techniques for this…

计算机视觉与模式识别 · 计算机科学 2024-01-08 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

Computer vision applications predict on digital images acquired by a camera from physical scenes through light. However, conventional robustness benchmarks rely on perturbations in digitized images, diverging from distribution shifts…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Eunsu Baek , Keondo Park , Jiyoon Kim , Hyung-Sin Kim

Several areas have been improved with Deep Learning during the past years. Implementing Deep Neural Networks (DNN) for non-safety related applications have shown remarkable achievements over the past years; however, for using DNNs in safety…

A common explanation for the failure of out-of-distribution (OOD) generalization is that the model trained with empirical risk minimization (ERM) learns spurious features instead of invariant features. However, several recent studies…

机器学习 · 计算机科学 2023-10-31 Yongqiang Chen , Wei Huang , Kaiwen Zhou , Yatao Bian , Bo Han , James Cheng

This paper presents a fast, principled approach for detecting anomalous and out-of-distribution (OOD) samples in deep neural networks (DNN). We propose the application of linear statistical dimensionality reduction techniques on the…

机器学习 · 计算机科学 2022-03-22 Ibrahima J. Ndiour , Nilesh A. Ahuja , Omesh Tickoo

Graph neural networks (GNNs) have achieved impressive performance when testing and training graph data come from identical distribution. However, existing GNNs lack out-of-distribution generalization abilities so that their performance…

机器学习 · 计算机科学 2021-12-15 Haoyang Li , Xin Wang , Ziwei Zhang , Wenwu Zhu

Since deep learning models have been implemented in many commercial applications, it is important to detect out-of-distribution (OOD) inputs correctly to maintain the performance of the models, ensure the quality of the collected data, and…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Qing Yu , Kiyoharu Aizawa

Convolutional neural networks applied for real-world classification tasks need to recognize inputs that are far or out-of-distribution (OoD) with respect to the known or training data. To achieve this, many methods estimate…

机器学习 · 计算机科学 2021-10-18 Kamil Szyc , Tomasz Walkowiak , Henryk Maciejewski

Cyber-physical systems (CPS) greatly benefit by using machine learning components that can handle the uncertainty and variability of the real-world. Typical components such as deep neural networks, however, introduce new types of hazards…

机器学习 · 计算机科学 2020-01-29 Feiyang Cai , Xenofon Koutsoukos

Neural networks are known to produce over-confident predictions on input images, even when these images are out-of-distribution (OOD) samples. This limits the applications of neural network models in real-world scenarios, where OOD samples…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Ke Fan , Yikai Wang , Qian Yu , Da Li , Yanwei Fu

Machine learning models are vulnerable to Out-Of-Distribution (OOD) examples, and such a problem has drawn much attention. However, current methods lack a full understanding of different types of OOD data: there are benign OOD data that can…

机器学习 · 计算机科学 2023-04-11 Zhuo Huang , Xiaobo Xia , Li Shen , Bo Han , Mingming Gong , Chen Gong , Tongliang Liu

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Sen Pei

Detecting out-of-distribution (OOD) inputs is a principal task for ensuring the safety of deploying deep-neural-network classifiers in open-set scenarios. OOD samples can be drawn from arbitrary distributions and exhibit deviations from…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Choubo Ding , Guansong Pang