English
Related papers

Related papers: Exploring Vicinal Risk Minimization for Lightweigh…

200 papers

Despite advances in image classification methods, detecting the samples not belonging to the training classes is still a challenging problem. There has been a burst of interest in this subject recently, which is called Open-Set Recognition…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.e., In-Distribution (InD), or from OoD. Diffusion Models (DMs) are recently utilized in OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Kun Fang , Qinghua Tao , Zuopeng Yang , Xiaolin Huang , Jie Yang

Detecting out-of-distribution (OOD) samples is essential for ensuring the reliability of deep neural networks (DNNs) in real-world scenarios. While previous research has predominantly investigated the disparity between in-distribution (ID)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yingwen Wu , Tao Li , Xinwen Cheng , Jie Yang , Xiaolin Huang

Research around Spiking Neural Networks has ignited during the last years due to their advantages when compared to traditional neural networks, including their efficient processing and inherent ability to model complex temporal dynamics.…

Neural and Evolutionary Computing · Computer Science 2022-10-04 Aitor Martinez Seras , Javier Del Ser , Jesus L. Lobo , Pablo Garcia-Bringas , Nikola Kasabov

Out-of-distribution (OOD) generalization on graphs aims at dealing with scenarios where the test graph distribution differs from the training graph distributions. Compared to i.i.d. data like images, the OOD generalization problem on…

Machine Learning · Computer Science 2025-02-13 Song Wang , Zhen Tan , Yaochen Zhu , Chuxu Zhang , Jundong Li

Addressing the Out-of-Distribution (OoD) segmentation task is a prerequisite for perception systems operating in an open-world environment. Large foundational models are frequently used in downstream tasks, however, their potential for OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Nazir Nayal , Youssef Shoeb , Fatma Güney

Detecting out-of-distribution (OOD) samples is vital for developing machine learning based models for critical safety systems. Common approaches for OOD detection assume access to some OOD samples during training which may not be available…

Machine Learning · Computer Science 2021-10-19 Koby Bibas , Meir Feder , Tal Hassner

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

Empirical Risk Minimization (ERM) based machine learning algorithms have suffered from weak generalization performance on data obtained from out-of-distribution (OOD). To address this problem, Invariant Risk Minimization (IRM) objective was…

Machine Learning · Computer Science 2021-03-25 Jun-Hyun Bae , Inchul Choi , Minho Lee

Out-of-Distribution (OoD) inputs are examples that do not belong to the true underlying distribution of the dataset. Research has shown that deep neural nets make confident mispredictions on OoD inputs. Therefore, it is critical to identify…

Machine Learning · Computer Science 2022-05-10 Deepak Ravikumar , Kaushik Roy

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in an open-world setting. However, existing OOD detection solutions can be brittle in the open world, facing various types of adversarial OOD…

Machine Learning · Computer Science 2021-07-01 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Out-of-distribution (OOD) detection is essential for ensuring the reliability of deep learning models operating in open-world scenarios. Current OOD detectors mainly rely on statistical models to identify unusual patterns in the latent…

Machine Learning · Computer Science 2025-06-06 Konstantin Kirchheim , Frank Ortmeier

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

The vicinal risk minimization (VRM) principle is an empirical risk minimization (ERM) variant that replaces Dirac masses with vicinal functions. There is strong numerical and theoretical evidence showing that VRM outperforms ERM in terms of…

Machine Learning · Computer Science 2021-10-19 Puneet Mangla , Vedant Singh , Shreyas Jayant Havaldar , Vineeth N Balasubramanian

Out-of-distribution (OOD) detectors can act as safety monitors in embedded cyber-physical systems by identifying samples outside a machine learning model's training distribution to prevent potentially unsafe actions. However, OOD detectors…

Machine Learning · Computer Science 2024-09-04 Aditya Bansal , Michael Yuhas , Arvind Easwaran

Deep neural networks have achieved great success in classification tasks during the last years. However, one major problem to the path towards artificial intelligence is the inability of neural networks to accurately detect samples from…

Machine Learning · Computer Science 2021-03-16 Aristotelis-Angelos Papadopoulos , Mohammad Reza Rajati , Nazim Shaikh , Jiamian Wang

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

Machine Learning · Statistics 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be…