中文
相关论文

相关论文: Logit Scaling for Out-of-Distribution Detection

200 篇论文

This paper reexamines the research on out-of-distribution (OOD) robustness in the field of NLP. We find that the distribution shift settings in previous studies commonly lack adequate challenges, hindering the accurate evaluation of OOD…

计算与语言 · 计算机科学 2023-10-27 Lifan Yuan , Yangyi Chen , Ganqu Cui , Hongcheng Gao , Fangyuan Zou , Xingyi Cheng , Heng Ji , Zhiyuan Liu , Maosong Sun

Recent years have witnessed significant progress in the development of machine learning models across a wide range of fields, fueled by increased computational resources, large-scale datasets, and the rise of deep learning architectures.…

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

机器学习 · 计算机科学 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques in these years. Traditional supervised deep learning methods assume that the test sample is drawn from the identical…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Zesheng Hong , Yubiao Yue , Yubin Chen , Lele Cong , Huanjie Lin , Yuanmei Luo , Mini Han Wang , Weidong Wang , Jialong Xu , Xiaoqi Yang , Hechang Chen , Zhenzhang Li , Sihong Xie

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

机器学习 · 统计学 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

One critical challenge in deploying highly performant machine learning models in real-life applications is out of distribution (OOD) detection. Given a predictive model which is accurate on in distribution (ID) data, an OOD detection system…

机器学习 · 计算机科学 2022-05-24 Conor Igoe , Youngseog Chung , Ian Char , Jeff Schneider

Out-of-Distribution (OOD) detection is essential in real-world applications, which has attracted increasing attention in recent years. However, most existing OOD detection methods require many labeled In-Distribution (ID) data, causing a…

机器学习 · 计算机科学 2022-10-14 Yi-Xuan Sun , Wei Wang

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

机器学习 · 计算机科学 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Out-of-distribution (OOD) detection is indispensable for deploying reliable machine learning systems in real-world scenarios. Recent works, using auxiliary outliers in training, have shown good potential. However, they seldom concern the…

机器学习 · 计算机科学 2024-12-17 Yutian Lei , Luping Ji , Pei Liu

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

机器学习 · 计算机科学 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

机器学习 · 计算机科学 2021-12-03 Peyman Morteza , Yixuan Li

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Out-of-distribution (OOD) detection is essential for ensuring the robustness of machine learning models by identifying samples that deviate from the training distribution. While traditional OOD detection has primarily focused on…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Shawn Li , Huixian Gong , Hao Dong , Tiankai Yang , Zhengzhong Tu , Yue Zhao

Deploying machine learning in open environments presents the challenge of encountering diverse test inputs that differ significantly from the training data. These out-of-distribution samples may exhibit shifts in local or global features…

机器学习 · 计算机科学 2024-03-19 Jiawei Li , Sitong Li , Shanshan Wang , Yicheng Zeng , Falong Tan , Chuanlong Xie

Distinguishing in- and out-of-distribution (OOD) inputs is crucial for reliable deployment of classification systems. However, OOD data is typically unavailable or difficult to collect, posing a significant challenge for accurate OOD…

计算与语言 · 计算机科学 2025-10-03 Momin Abbas , Muneeza Azmat , Raya Horesh , Mikhail Yurochkin

Graph-level representation learning is important in a wide range of applications. Existing graph-level models are generally built on i.i.d. assumption for both training and testing graphs. However, in an open world, models can encounter…

机器学习 · 计算机科学 2024-07-19 Zhihao Ding , Jieming Shi , Shiqi Shen , Xuequn Shang , Jiannong Cao , Zhipeng Wang , Zhi Gong

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature. However, the field currently lacks a unified,…

As deep learning methods form a critical part in commercially important applications such as autonomous driving and medical diagnostics, it is important to reliably detect out-of-distribution (OOD) inputs while employing these algorithms.…

机器学习 · 计算机科学 2018-09-12 Apoorv Vyas , Nataraj Jammalamadaka , Xia Zhu , Dipankar Das , Bharat Kaul , Theodore L. Willke

Robust out-of-distribution (OOD) detection is an indispensable component of modern artificial intelligence (AI) systems, especially in safety-critical applications where models must identify inputs from unfamiliar classes not seen during…

机器学习 · 计算机科学 2025-09-09 Tarhib Al Azad , Shahana Ibrahim

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

机器学习 · 计算机科学 2023-10-11 Yiyou Sun