English
Related papers

Related papers: Functional Indirection Neural Estimator for Better…

200 papers

Adoption of deep learning in safety-critical systems raise the need for understanding what deep neural networks do not understand after models have been deployed. The behaviour of deep neural networks is undefined for so called…

Machine Learning · Computer Science 2021-08-25 Rickard Sjögren , Johan Trygg

Deep learning-based image reconstruction methods have achieved remarkable success in phase recovery and holographic imaging. However, the generalization of their image reconstruction performance to new types of samples never seen by the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Hanlong Chen , Luzhe Huang , Tairan Liu , Aydogan Ozcan

Machine learning models often fail to generalize well under distributional shifts. Understanding and overcoming these failures have led to a research field of Out-of-Distribution (OOD) generalization. Despite being extensively studied for…

Learning general-purpose representations from perceptual inputs is a hallmark of human intelligence. For example, people can write out numbers or characters, or even draw doodles, by characterizing these tasks as different instantiations of…

Machine Learning · Computer Science 2022-06-28 Yichao Liang , Joshua B. Tenenbaum , Tuan Anh Le , N. Siddharth

We expect the generalization error to improve with more samples from a similar task, and to deteriorate with more samples from an out-of-distribution (OOD) task. In this work, we show a counter-intuitive phenomenon: the generalization error…

Machine Learning · Computer Science 2023-07-20 Ashwin De Silva , Rahul Ramesh , Carey E. Priebe , Pratik Chaudhari , Joshua T. Vogelstein

Several data augmentation methods deploy unlabeled-in-distribution (UID) data to bridge the gap between the training and inference of neural networks. However, these methods have clear limitations in terms of availability of UID data and…

Machine Learning · Computer Science 2021-11-23 Saehyung Lee , Changhwa Park , Hyungyu Lee , Jihun Yi , Jonghyun Lee , Sungroh Yoon

Out-of-distribution (OOD) detection is a critical issue for the stable and reliable operation of systems using a deep neural network (DNN). Although many OOD detection methods have been proposed, it remains unclear how the differences…

Machine Learning · Computer Science 2024-10-30 Kazuki Uematsu , Kosuke Haruki , Taiji Suzuki , Mitsuhiro Kimura , Takahiro Takimoto , Hideyuki Nakagawa

Few-shot Out-of-Distribution (OOD) detection has emerged as a critical research direction in machine learning for practical deployment. Most existing Few-shot OOD detection methods suffer from insufficient generalization capability for the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Pinxuan Li , Bing Cao , Changqing Zhang , Qinghua Hu

Machine learning models deployed in the open world may encounter observations that they were not trained to recognize, and they risk misclassifying such observations with high confidence. Therefore, it is essential that these models are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Noah Fleischmann , Walter Bennette , Nathan Inkawhich

Likelihood-based deep generative models such as score-based diffusion models and variational autoencoders are state-of-the-art machine learning models approximating high-dimensional distributions of data such as images, text, or audio. One…

Machine Learning · Statistics 2024-05-28 Sam Dauncey , Chris Holmes , Christopher Williams , Fabian Falck

Out-of-distribution (OOD) generalisation aims to build a model that can generalise well on an unseen target domain using knowledge from multiple source domains. To this end, the model should seek the causal dependence between inputs and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Toan Nguyen , Kien Do , Duc Thanh Nguyen , Bao Duong , Thin Nguyen

It is an important problem in trustworthy machine learning to recognize out-of-distribution (OOD) inputs which are inputs unrelated to the in-distribution task. Many out-of-distribution detection methods have been suggested in recent years.…

Machine Learning · Computer Science 2022-06-22 Julian Bitterwolf , Alexander Meinke , Maximilian Augustin , Matthias Hein

Deep neural networks often struggle to recognize when an input lies outside their training experience, leading to unreliable and overconfident predictions. Building dependable machine learning systems therefore requires methods that can…

Machine Learning · Computer Science 2025-12-02 Pirzada Suhail , Rehna Afroz , Amit Sethi

Uncertainty estimation is crucial for machine learning models to detect out-of-distribution (OOD) inputs. However, the conventional discriminative deep learning classifiers produce uncalibrated closed-set predictions for OOD data. A more…

We address the problem of out-of-distribution (OOD) detection for the task of object detection. We show that residual convolutional layers with batch normalisation produce Sensitivity-Aware FEatures (SAFE) that are consistently powerful for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Samuel Wilson , Tobias Fischer , Feras Dayoub , Dimity Miller , Niko Sünderhauf

Out-of-distribution (OOD) detection is a crucial part of deploying machine learning models safely. It has been extensively studied with a plethora of methods developed in the literature. This problem is tackled with an OOD score…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Jingqiu Zhou , Aojun Zhou , Hongsheng Li

In neuroscience, identifying distinct patterns linked to neurological disorders, such as Alzheimer's and Autism, is critical for early diagnosis and effective intervention. Graph Neural Networks (GNNs) have shown promising in analyzing…

Machine Learning · Computer Science 2025-02-05 Jiaxing Xu , Yongqiang Chen , Xia Dong , Mengcheng Lan , Tiancheng Huang , Qingtian Bian , James Cheng , Yiping Ke

Determining whether AI systems process information similarly to humans is central to cognitive science and trustworthy AI. While modern AI models can match human accuracy on standard tasks, such parity does not guarantee that their…

Artificial Intelligence · Computer Science 2026-04-14 Binxia Xu , Xiaoliang Luo , Luke Dickens , Robert M. Mok

The crux of effective out-of-distribution (OOD) detection lies in acquiring a robust in-distribution (ID) representation, distinct from OOD samples. While previous methods predominantly leaned on recognition-based techniques for this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger