English
Related papers

Related papers: Uncertainty quantification and out-of-distribution…

200 papers

It is an important problem in trustworthy machine learning to recognize out-of-distribution (OOD) inputs which are inputs unrelated to the in-distribution task. Many out-of-distribution detection methods have been suggested in recent years.…

Machine Learning · Computer Science 2022-06-22 Julian Bitterwolf , Alexander Meinke , Maximilian Augustin , Matthias Hein

Out-of-distribution (OOD) detection is an indispensable aspect of secure AI when deploying machine learning models in real-world applications. Previous paradigms either explore better scoring functions or utilize the knowledge of outliers…

Machine Learning · Computer Science 2023-06-07 Jianing Zhu , Hengzhuang Li , Jiangchao Yao , Tongliang Liu , Jianliang Xu , Bo Han

Deep neural networks (DNNs) often exhibit overconfidence when encountering out-of-distribution (OOD) samples, posing significant challenges for deployment. Since DNNs are trained on in-distribution (ID) datasets, the information flow of ID…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Guide Yang , Chao Hou , Weilong Peng , Xiang Fang , Yongwei Nie , Peican Zhu , Keke Tang

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

Machine Learning · Computer Science 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

Uncertainty quantification is critical for ensuring robustness in high-stakes machine learning applications. We introduce HybridFlow, a modular hybrid architecture that unifies the modeling of aleatoric and epistemic uncertainty by…

Machine Learning · Computer Science 2025-10-16 Peter Van Katwyk , Karianne J. Bergen

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Data-driven decision-making under uncertainty typically presumes the collection of historical data from an unknown target probability distribution. However, one may have no access to any data from the target distribution prior to…

Optimization and Control · Mathematics 2026-04-23 Xianyu Li , Huan Xu , Xiaolin Huang , Chao Shang

Deep neural networks have achieved significant success in the last decades, but they are not well-calibrated and often produce unreliable predictions. A large number of literature relies on uncertainty quantification to evaluate the…

Machine Learning · Computer Science 2023-11-13 Russell Alan Hart , Linlin Yu , Yifei Lou , Feng Chen

Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.e., In-Distribution (InD), or from OoD. Diffusion Models (DMs) are recently utilized in OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Kun Fang , Qinghua Tao , Zuopeng Yang , Xiaolin Huang , Jie Yang

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Neural networks are known to produce over-confident predictions on input images, even when these images are out-of-distribution (OOD) samples. This limits the applications of neural network models in real-world scenarios, where OOD samples…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Ke Fan , Yikai Wang , Qian Yu , Da Li , Yanwei Fu

Generative modelling has been a topic at the forefront of machine learning research for a substantial amount of time. With the recent success in the field of machine learning, especially in deep learning, there has been an increased…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 M. M. A. Valiuddin , C. G. A. Viviers

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution…

Machine Learning · Computer Science 2023-08-07 Wang Lu , Jindong Wang , Xinwei Sun , Yiqiang Chen , Xiangyang Ji , Qiang Yang , Xing Xie

Graph machine learning has witnessed rapid growth, driving advancements across diverse domains. However, the in-distribution assumption, where training and testing data share the same distribution, often breaks in real-world scenarios,…

Machine Learning · Computer Science 2025-02-13 Tingyi Cai , Yunliang Jiang , Yixin Liu , Ming Li , Changqin Huang , Shirui Pan

Precise estimation of uncertainty in predictions for AI systems is a critical factor in ensuring trust and safety. Deep neural networks trained with a conventional method are prone to over-confident predictions. In contrast to Bayesian…

Machine Learning · Computer Science 2021-01-05 Theodoros Tsiligkaridis

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

Machine Learning · Computer Science 2023-10-11 Yiyou Sun

The use of neural networks has been very successful in a wide variety of applications. However, it has recently been observed that it is difficult to generalize the performance of neural networks under the condition of distributional shift.…

Computational Finance · Quantitative Finance 2022-09-20 Dangxing Chen

Statistical learning algorithms provide a generally-applicable framework to sidestep time-consuming experiments, or accurate physics-based modeling, but they introduce a further source of error on top of the intrinsic limitations of the…

Chemical Physics · Physics 2024-05-17 Matthias Kellner , Michele Ceriotti

Out-of-Distribution (OoD) inputs are examples that do not belong to the true underlying distribution of the dataset. Research has shown that deep neural nets make confident mispredictions on OoD inputs. Therefore, it is critical to identify…

Machine Learning · Computer Science 2022-05-10 Deepak Ravikumar , Kaushik Roy

Using the dynamics of information propagation on a network as our illustrative example, we present and discuss a systematic approach to quantifying heterogeneity and its propagation that borrows established tools from Uncertainty…

Adaptation and Self-Organizing Systems · Physics 2015-11-25 Karthikeyan Rajendran , Andreas C. Tsoumanis , Constantinos I. Siettos , Carlo R. Laing , Ioannis G. Kevrekidis