中文
相关论文

相关论文: OOD Detection with immature Models

200 篇论文

Detecting out-of-distribution (OOD) examples is crucial to guarantee the reliability and safety of deep neural networks in real-world settings. In this paper, we offer an innovative perspective on quantifying the disparities between…

机器学习 · 计算机科学 2024-01-17 Jinggang Chen , Junjie Li , Xiaoyang Qu , Jianzong Wang , Jiguang Wan , Jing Xiao

Collaborative inference enables resource-constrained edge devices to make inferences by uploading inputs (e.g., images) to a server (i.e., cloud) where the heavy deep learning models run. While this setup works cost-effectively for…

计算机视觉与模式识别 · 计算机科学 2021-06-30 Sumaiya Tabassum Nimi , Md Adnan Arefeen , Md Yusuf Sarwar Uddin , Yugyung Lee

Out-of-distribution (OOD) detection aims to detect "unknown" data whose labels have not been seen during the in-distribution (ID) training process. Recent progress in representation learning gives rise to distance-based OOD detection that…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Ji Zhang , Lianli Gao , Bingguang Hao , Hao Huang , Jingkuan Song , Hengtao Shen

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

In the context of modern machine learning, models deployed in real-world scenarios often encounter diverse data shifts like covariate and semantic shifts, leading to challenges in both out-of-distribution (OOD) generalization and detection.…

机器学习 · 计算机科学 2024-09-30 Han Wang , Yixuan Li

Graph neural networks (GNNs) have found widespread application in modeling graph data across diverse domains. While GNNs excel in scenarios where the testing data shares the distribution of their training counterparts (in distribution, ID),…

机器学习 · 计算机科学 2024-01-15 Luzhi Wang , Dongxiao He , He Zhang , Yixin Liu , Wenjie Wang , Shirui Pan , Di Jin , Tat-Seng Chua

Detecting data points deviating from the training distribution is pivotal for ensuring reliable machine learning. Extensive research has been dedicated to the challenge, spanning classical anomaly detection techniques to contemporary…

机器学习 · 计算机科学 2024-05-30 Xuefeng Du , Yiyou Sun , Yixuan Li

One of the early weaknesses identified in deep neural networks trained for image classification tasks was their inability to provide low confidence predictions on out-of-distribution (OOD) data that was significantly different from the…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Evelyn Mannix , Howard Bondell

As machine learning becomes increasingly prevalent in impactful decisions, recognizing when inference data is outside the model's expected input distribution is paramount for giving context to predictions. Out-of-distribution (OOD)…

机器学习 · 计算机科学 2024-01-19 Anish Lakkapragada , Amol Khanna , Edward Raff , Nathan Inkawhich

Out-of-distribution (OOD) detection is critical for safety-sensitive machine learning applications and has been extensively studied, yielding a plethora of methods developed in the literature. However, most studies for OOD detection did not…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Deep neural networks (DNNs) often exhibit overconfidence when encountering out-of-distribution (OOD) samples, posing significant challenges for deployment. Since DNNs are trained on in-distribution (ID) datasets, the information flow of ID…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Guide Yang , Chao Hou , Weilong Peng , Xiang Fang , Yongwei Nie , Peican Zhu , Keke Tang

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

机器学习 · 计算机科学 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

We consider the problem of detecting out-of-distribution (OOD) samples in deep reinforcement learning. In a value based reinforcement learning setting, we propose to use uncertainty estimation techniques directly on the agent's value…

机器学习 · 计算机科学 2019-01-09 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

Detecting out-of-distribution (OOD) data has become a critical component in ensuring the safe deployment of machine learning models in the real world. Existing OOD detection approaches primarily rely on the output or feature space for…

机器学习 · 计算机科学 2021-10-12 Rui Huang , Andrew Geng , Yixuan Li

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

机器学习 · 计算机科学 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can…

机器学习 · 计算机科学 2025-03-10 Juniper Tyree , Andreas Rupp , Petri S. Clusius , Michael H. Boy

In the realm of task-oriented dialogue systems, a robust intent detection mechanism must effectively handle malformed utterances encountered in real-world scenarios. This study presents a novel fine-tuning framework for large language…

计算与语言 · 计算机科学 2024-09-23 Bo Liu , Liming Zhan , Yujie Feng , Zexin Lu , Chengqiang Xie , Lei Xue , Albert Y. S. Lam , Xiao-Ming Wu

The ability to detect objects that are not prevalent in the training set is a critical capability in many 3D applications, including autonomous driving. Machine learning methods for object recognition often assume that all object categories…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Zizhao Li , Xueyang Kang , Joseph West , Kourosh Khoshelham

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…