中文
相关论文

相关论文: Know Your Limits: Uncertainty Estimation with ReLU…

200 篇论文

Transformers excel in natural language processing and computer vision tasks. However, they still face challenges in generalizing to Out-of-Distribution (OOD) datasets, i.e. data whose distribution differs from that seen during training. OOD…

机器学习 · 计算机科学 2026-01-30 Yijin Zhou , Yutang Ge , Wenyuan Xie , Linqian Zeng , Xiaowen Dong , Yuguang Wang

An issue concerning the use of deep reinforcement learning (RL) agents is whether they can be trusted to perform reliably when deployed, as training environments may not reflect real-life environments. Anticipating instances outside their…

机器学习 · 计算机科学 2025-03-10 Mohit Prashant , Arvind Easwaran , Suman Das , Michael Yuhas

Deep learning has shown to have great potential in medical applications. In critical domains as such, it is of high interest to have trustworthy algorithms which are able to tell when reliable assessments cannot be guaranteed. Detecting…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Jennie Karlsson , Marisa Wodrich , Niels Christian Overgaard , Freja Sahlin , Kristina Lång , Anders Heyden , Ida Arvidsson

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

机器学习 · 计算机科学 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

Improving the accuracy of deep neural networks (DNNs) on out-of-distribution (OOD) data is critical to an acceptance of deep learning (DL) in real world applications. It has been observed that accuracies on in-distribution (ID) versus OOD…

Despite their success, Machine Learning (ML) models do not generalize effectively to data not originating from the training distribution. To reliably employ ML models in real-world healthcare systems and avoid inaccurate predictions on…

机器学习 · 计算机科学 2023-09-29 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Ciná

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution inputs (OODs). This limitation is one of the key challenges in the adoption of DNNs in high-assurance systems such as…

机器学习 · 计算机科学 2021-08-21 Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Oleg Sokolsky , Insup Lee

Modern neural networks can assign high confidence to inputs drawn from outside the training distribution, posing threats to models in real-world deployments. While much research attention has been placed on designing new out-of-distribution…

机器学习 · 计算机科学 2022-03-08 Yifei Ming , Hang Yin , Yixuan Li

Bayesian neural networks and deep ensemble methods have been proposed for uncertainty quantification; however, they are computationally intensive and require large storage. By utilizing a single deterministic model, we can solve the above…

机器学习 · 计算机科学 2025-08-04 Yaxin Ma , Benjamin Colburn , Jose C. Principe

Out-of-distribution (OOD) detection discerns OOD data where the predictor cannot make valid predictions as in-distribution (ID) data, thereby increasing the reliability of open-world classification. However, it is typically hard to collect…

机器学习 · 计算机科学 2023-12-06 Haotian Zheng , Qizhou Wang , Zhen Fang , Xiaobo Xia , Feng Liu , Tongliang Liu , Bo Han

Out-of-distribution (OOD) detection and uncertainty estimation (UE) are critical components for building safe machine learning systems, especially in real-world scenarios where unexpected inputs are inevitable. However the two problems…

机器学习 · 计算机科学 2025-12-01 Pirzada Suhail , Rehna Afroz , Gouranga Bala , Amit Sethi

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

机器学习 · 计算机科学 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Out-of-distribution (OOD) detection is essential for the reliability of ML models. Most existing methods for OOD detection learn a fixed decision criterion from a given in-distribution dataset and apply it universally to decide if a data…

机器学习 · 计算机科学 2023-11-29 YiFan Zhang , Xue Wang , Tian Zhou , Kun Yuan , Zhang Zhang , Liang Wang , Rong Jin , Tieniu Tan

While reinforcement learning (RL) algorithms have been successfully applied across numerous sequential decision-making problems, their generalization to unforeseen testing environments remains a significant concern. In this paper, we study…

机器学习 · 计算机科学 2024-04-11 Linas Nasvytis , Kai Sandbrink , Jakob Foerster , Tim Franzmeyer , Christian Schroeder de Witt

Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing…

机器学习 · 计算机科学 2025-01-16 Konstantin Garov , Kamalika Chaudhuri

Deep neural networks often face generalization problems to handle out-of-distribution (OOD) data, and there remains a notable theoretical gap between the contributing factors and their respective impacts. Literature evidence from…

机器学习 · 计算机科学 2024-04-24 Songming Zhang , Yuxiao Luo , Qizhou Wang , Haoang Chi , Xiaofeng Chen , Bo Han , Jinyan Li

Deep Neural Networks for classification behave unpredictably when confronted with inputs not stemming from the training distribution. This motivates out-of-distribution detection (OOD) mechanisms. The usual lack of prior information on…

机器学习 · 计算机科学 2022-03-02 Konstantin Kirchheim , Tim Gonschorek , Frank Ortmeier

Subset selection-based methods are widely used to explain deep vision models: they attribute predictions by highlighting the most influential image regions and support object-level explanations. While these methods perform well in…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Madhav Gupta , Vishak Prasad C , Ganesh Ramakrishnan

Recent remarkable success in the deep-learning industries has unprecedentedly increased the need for reliable model deployment. For example, the model should alert the user if the produced model outputs might not be reliable. Previous…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Dasol Choi , Dongbin Na

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

机器学习 · 计算机科学 2023-10-11 Yiyou Sun