中文
相关论文

相关论文: Why Should we Combine Training and Post-Training M…

200 篇论文

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Effective out-of-distribution (OOD) detection is crucial for reliable machine learning models, yet most current methods are limited in practical use due to requirements like access to training data or intervention in training. We present a…

机器学习 · 计算机科学 2024-03-13 Fran Jelenić , Josip Jukić , Martin Tutek , Mate Puljiz , Jan Šnajder

Deep neural networks for image classification only learn to map in-distribution inputs to their corresponding ground truth labels in training without differentiating out-of-distribution samples from in-distribution ones. This results from…

机器学习 · 计算机科学 2023-08-29 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

During the forward pass of Deep Neural Networks (DNNs), inputs gradually transformed from low-level features to high-level conceptual labels. While features at different layers could summarize the important factors of the inputs at varying…

机器学习 · 计算机科学 2022-03-02 Haoliang Wang , Chen Zhao , Xujiang Zhao , Feng Chen

Commonly used AI networks are very self-confident in their predictions, even when the evidence for a certain decision is dubious. The investigation of a deep learning model output is pivotal for understanding its decision processes and…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Damian Matuszewski , Ida-Maria Sintorn

Deep learning-based approaches have produced models with good insect classification accuracy; Most of these models are conducive for application in controlled environmental conditions. One of the primary emphasis of researchers is to…

Image classification models deployed in the real world may receive inputs outside the intended data distribution. For critical applications such as clinical decision making, it is important that a model can detect such out-of-distribution…

计算机视觉与模式识别 · 计算机科学 2021-07-07 Christoph Berger , Magdalini Paschali , Ben Glocker , Konstantinos Kamnitsas

Deep neural networks have demonstrated great generalization capabilities for tasks whose training and test sets are drawn from the same distribution. Nevertheless, out-of-distribution (OOD) detection remains a challenging task that has…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Brian K. S. Isaac-Medina , Toby P. Breckon

Out-of-distribution (OOD) detection is essential to prevent anomalous inputs from causing a model to fail during deployment. While improved OOD detection methods have emerged, they often rely on the final layer outputs and require a full…

计算机视觉与模式识别 · 计算机科学 2021-05-03 Ziqian Lin , Sreya Dutta Roy , Yixuan Li

Machine learning methods such as deep neural networks (DNNs), despite their success across different domains, are known to often generate incorrect predictions with high confidence on inputs outside their training distribution. The…

机器学习 · 计算机科学 2022-01-10 Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Edgar Dobriban , Oleg Sokolsky , Insup Lee

Reliable detection of out-of-distribution (OOD) inputs is increasingly understood to be a precondition for deployment of machine learning systems. This paper proposes and investigates the use of contrastive training to boost OOD detection…

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

机器学习 · 计算机科学 2023-10-11 Yiyou Sun

State-of-the-art models can perform well in controlled environments, but they often struggle when presented with out-of-distribution (OOD) examples, making OOD detection a critical component of NLP systems. In this paper, we focus on…

计算与语言 · 计算机科学 2023-07-17 Mateusz Baran , Joanna Baran , Mateusz Wójcik , Maciej Zięba , Adam Gonczarek

We consider the problem of detecting OoD(Out-of-Distribution) input data when using deep neural networks, and we propose a simple yet effective way to improve the robustness of several popular OoD detection methods against label shift. Our…

It is essential for safety-critical applications of deep neural networks to determine when new inputs are significantly different from the training distribution. In this paper, we explore this out-of-distribution (OOD) detection problem for…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Poulami Sinhamahapatra , Rajat Koner , Karsten Roscher , Stephan Günnemann

The lack of well-calibrated confidence estimates makes neural networks inadequate in safety-critical domains such as autonomous driving or healthcare. In these settings, having the ability to abstain from making a prediction on…

机器学习 · 计算机科学 2022-07-27 Adam Dziedzic , Stephan Rabanser , Mohammad Yaghini , Armin Ale , Murat A. Erdogdu , Nicolas Papernot

Out-of-distribution (OOD) detection has recently gained substantial attention due to the importance of identifying out-of-domain samples in reliability and safety. Although OOD detection methods have advanced by a great deal, they are still…

计算机视觉与模式识别 · 计算机科学 2022-10-03 Mohammad Azizmalayeri , Arshia Soltani Moakhar , Arman Zarei , Reihaneh Zohrabi , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

For a machine learning model deployed in real world scenarios, the ability of detecting out-of-distribution (OOD) samples is indispensable and challenging. Most existing OOD detection methods focused on exploring advanced training skills or…

机器学习 · 计算机科学 2024-02-16 Chao Chen , Zhihang Fu , Kai Liu , Ze Chen , Mingyuan Tao , Jieping Ye

Deep neural networks (DNN) have outstanding performance in various applications. Despite numerous efforts of the research community, out-of-distribution (OOD) samples remain a significant limitation of DNN classifiers. The ability to…

机器学习 · 计算机科学 2023-03-27 Bartlomiej Olber , Krystian Radlak , Adam Popowicz , Michal Szczepankiewicz , Krystian Chachuła

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be…