English
Related papers

Related papers: Hyperparameter Sensitivity in Deep Outlier Detecti…

200 papers

Hyperparameter optimization is a ubiquitous challenge in machine learning, and the performance of a trained model depends crucially upon their effective selection. While a rich set of tools exist for this purpose, there are currently no…

Machine Learning · Statistics 2021-11-10 Shubhankar Mohapatra , Sajin Sasy , Xi He , Gautam Kamath , Om Thakkar

We introduce and develop a novel approach to outlier detection based on adaptation of random subspace learning. Our proposed method handles both high-dimension low-sample size and traditional low-dimensional high-sample size datasets.…

Machine Learning · Statistics 2015-05-05 Bohan Liu , Ernest Fokoue

Outlier detection tasks have been playing a critical role in AI safety. There has been a great challenge to deal with this task. Observations show that deep neural network classifiers usually tend to incorrectly classify out-of-distribution…

Machine Learning · Computer Science 2022-09-27 Jingyang Lin , Yu Wang , Qi Cai , Yingwei Pan , Ting Yao , Hongyang Chao , Tao Mei

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can…

Machine Learning · Computer Science 2025-03-10 Juniper Tyree , Andreas Rupp , Petri S. Clusius , Michael H. Boy

Out-of-distribution (OOD) detection is important for machine learning models deployed in the wild. Recent methods use auxiliary outlier data to regularize the model for improved OOD detection. However, these approaches make a strong…

Machine Learning · Computer Science 2022-06-30 Julian Katz-Samuels , Julia Nakhleh , Robert Nowak , Yixuan Li

Addressing the Out-of-Distribution (OoD) segmentation task is a prerequisite for perception systems operating in an open-world environment. Large foundational models are frequently used in downstream tasks, however, their potential for OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Nazir Nayal , Youssef Shoeb , Fatma Güney

Outlier detection is a key field of machine learning for identifying abnormal data objects. Due to the high expense of acquiring ground truth, unsupervised models are often chosen in practice. To compensate for the unstable nature of…

Machine Learning · Computer Science 2020-02-11 Yue Zhao , Xueying Ding , Jianing Yang , Haoping Bai

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

Out-of-distribution (OOD) detection aims to detect test samples that do not fall into any training in-distribution (ID) classes. Prior efforts focus on regularizing models with ID data only, largely underperforming counterparts that utilize…

Machine Learning · Computer Science 2025-05-20 Puning Yang , Jian Liang , Jie Cao , Ran He

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

Machine Learning · Computer Science 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Deep learning models are defined in terms of a large number of hyperparameters, such as network architectures and optimiser settings. These hyperparameters must be determined separately from the model parameters such as network weights, and…

High Energy Physics - Phenomenology · Physics 2024-10-22 Juan Cruz-Martinez , Aaron Jansen , Gijs van Oord , Tanjona R. Rabemananjara , Carlos M. R. Rocha , Juan Rojo , Roy Stegeman

Out-of-distribution (OOD) detection is essential for ensuring the reliability and safety of machine learning systems. In recent years, it has received increasing attention, particularly through post-hoc detection and training-based methods.…

Machine Learning · Statistics 2025-11-04 Mouïn Ben Ammar , David Brellmann , Arturo Mendoza , Antoine Manzanera , Gianni Franchi

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

Machine Learning · Computer Science 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Detecting out-of-distribution (OOD) instances is crucial for the reliable deployment of machine learning models in real-world scenarios. OOD inputs are commonly expected to cause a more uncertain prediction in the primary task; however,…

Machine Learning · Computer Science 2024-05-22 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Cinà

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Out-of-distribution (OOD) detection is a crucial task for deploying deep learning models in the wild. One of the major challenges is that well-trained deep models tend to perform over-confidence on unseen test data. Recent research attempts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Mingrong Gong , Chaoqi Chen , Qingqiang Sun , Yue Wang , Hui Huang

Recent research underscores the pivotal role of the Out-of-Distribution (OOD) feature representation field scale in determining the efficacy of models in OOD detection. Consequently, the adoption of model ensembles has emerged as a…

Machine Learning · Computer Science 2024-08-19 Chenhui Xu , Fuxun Yu , Zirui Xu , Nathan Inkawhich , Xiang Chen

Out-of-distribution (OOD) detection is indispensable for safely deploying machine learning models in the wild. One of the key challenges is that models lack supervision signals from unknown data, and as a result, can produce overconfident…

Machine Learning · Computer Science 2023-03-07 Leitian Tao , Xuefeng Du , Xiaojin Zhu , Yixuan Li

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger