中文
相关论文

相关论文: Trust Issues: Uncertainty Estimation Does Not Enab…

200 篇论文

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

机器学习 · 计算机科学 2023-11-07 Reza Averly , Wei-Lun Chao

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

机器学习 · 计算机科学 2023-12-05 Sergey Kolesnikov

The precision of contouring target structures and organs-at-risk (OAR) in radiotherapy planning is crucial for ensuring treatment efficacy and patient safety. Recent advancements in deep learning (DL) have significantly improved OAR…

图像与视频处理 · 电气工程与系统科学 2024-09-30 Marvin Tom Teichmann , Manasi Datar , Lisa Kratzke , Fernando Vega , Florin C. Ghesu

The quantification of uncertainty is important for the adoption of machine learning, especially to reject out-of-distribution (OOD) data back to human experts for review. Yet progress has been slow, as a balance must be struck between…

机器学习 · 计算机科学 2022-09-12 Derek Everett , Andre T. Nguyen , Luke E. Richards , Edward Raff

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution inputs (OODs). This limitation is one of the key challenges in the adoption of DNNs in high-assurance systems such as…

机器学习 · 计算机科学 2021-08-21 Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Oleg Sokolsky , Insup Lee

A crucial requirement for machine learning algorithms is not only to perform well, but also to show robustness and adaptability when encountering novel scenarios. One way to achieve these characteristics is to endow the deep learning models…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Eduardo Aguilar , Bogdan Raducanu , Petia Radeva

Out-of-distribution (OOD) detection plays a crucial role in ensuring the robustness and reliability of machine learning systems deployed in real-world applications. Recent approaches have explored the use of unlabeled data, showing…

机器学习 · 计算机科学 2025-10-09 Momin Abbas , Ali Falahati , Hossein Goli , Mohammad Mohammadi Amiri

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

Detecting out-of-distribution (OOD) instances is crucial for the reliable deployment of machine learning models in real-world scenarios. OOD inputs are commonly expected to cause a more uncertain prediction in the primary task; however,…

机器学习 · 计算机科学 2024-05-22 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Cinà

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can…

机器学习 · 计算机科学 2025-03-10 Juniper Tyree , Andreas Rupp , Petri S. Clusius , Michael H. Boy

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

机器学习 · 计算机科学 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

Accurate trajectory prediction is essential for the safe operation of autonomous vehicles in real-world environments. Even well-trained machine learning models may produce unreliable predictions due to discrepancies between training data…

机器人学 · 计算机科学 2025-04-24 Tongfe Guo , Taposh Banerjee , Rui Liu , Lili Su

Out-of-distribution (OOD) detection is essential for building reliable AI systems, as models that produce outputs for invalid inputs cannot be trusted. Although deep learning (DL) is often assumed to outperform traditional machine learning…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Jihyeon Baek , Seunghoon Lee , Gitaek Kwon , Doohyun Park

Motivation: Deep learning models deployed for use on medical tasks can be equipped with Out-of-Distribution Detection (OoDD) methods in order to avoid erroneous predictions. However it is unclear which OoDD method should be used in…

机器学习 · 计算机科学 2020-08-06 Tianshi Cao , Chin-Wei Huang , David Yu-Tung Hui , Joseph Paul Cohen

In computational histopathology algorithms now outperform humans on a range of tasks, but to date none are employed for automated diagnoses in the clinic. Before algorithms can be involved in such high-stakes decisions they need to "know…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Lea Goetz

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

机器学习 · 计算机科学 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

软件工程 · 计算机科学 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

We consider the problem of detecting out-of-distribution (OOD) samples in deep reinforcement learning. In a value based reinforcement learning setting, we propose to use uncertainty estimation techniques directly on the agent's value…

机器学习 · 计算机科学 2019-01-09 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

Deep Learning models perform unreliably when the data comes from a distribution different from the training one. In critical applications such as medical imaging, out-of-distribution (OOD) detection methods help to identify such data…

图像与视频处理 · 电气工程与系统科学 2023-06-26 Anton Vasiliuk , Daria Frolova , Mikhail Belyaev , Boris Shirokikh

In monocular depth estimation, uncertainty estimation approaches mainly target the data uncertainty introduced by image noise. In contrast to prior work, we address the uncertainty due to lack of knowledge, which is relevant for the…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Julia Hornauer , Adrian Holzbock , Vasileios Belagiannis