中文
相关论文

相关论文: Likelihood Regret: An Out-of-Distribution Detectio…

200 篇论文

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Assefa Seyoum Wahd

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

机器学习 · 计算机科学 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

机器学习 · 计算机科学 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Perhaps surprisingly, recent studies have shown probabilistic model likelihoods have poor specificity for out-of-distribution (OOD) detection and often assign higher likelihoods to OOD data than in-distribution data. To ameliorate this…

Detecting out-of-distribution (OOD) examples is crucial to guarantee the reliability and safety of deep neural networks in real-world settings. In this paper, we offer an innovative perspective on quantifying the disparities between…

机器学习 · 计算机科学 2024-01-17 Jinggang Chen , Junjie Li , Xiaoyang Qu , Jianzong Wang , Jiguang Wan , Jing Xiao

Recent successes of artificial intelligence and deep learning often depend on the well-collected training dataset which is assumed to have an identical distribution with the test dataset. However, this assumption, which is called closed-set…

人工智能 · 计算机科学 2025-01-14 Eui-Soo Jung , Hae-Hun Seo , Hyun-Woo Jung , Je-Geon Oh , Yoon-Yeong Kim

Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A…

机器学习 · 计算机科学 2024-04-17 Pietro Recalcati , Fabio Garcea , Luca Piano , Fabrizio Lamberti , Lia Morra

Out-of-distribution (OOD) detection is essential for model trustworthiness which aims to sensitively identify semantic OOD samples and robustly generalize for covariate-shifted OOD samples. However, we discover that the superior OOD…

机器学习 · 计算机科学 2024-10-16 Qingyang Zhang , Qiuxuan Feng , Joey Tianyi Zhou , Yatao Bian , Qinghua Hu , Changqing Zhang

The task of identifying out-of-domain (OOD) input examples directly at test-time has seen renewed interest recently due to increased real world deployment of models. In this work, we focus on OOD detection for natural language sentence…

计算与语言 · 计算机科学 2020-01-01 Varun Gangal , Abhinav Arora , Arash Einolghozati , Sonal Gupta

Out-of-distribution (OOD) detection is a critical task for deploying machine learning models in the open world. Distance-based methods have demonstrated promise, where testing samples are detected as OOD if they are relatively far away from…

机器学习 · 计算机科学 2022-12-09 Yiyou Sun , Yifei Ming , Xiaojin Zhu , Yixuan Li

Detecting out-of-distribution (OOD) samples is essential for ensuring the reliability of deep neural networks (DNNs) in real-world scenarios. While previous research has predominantly investigated the disparity between in-distribution (ID)…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yingwen Wu , Tao Li , Xinwen Cheng , Jie Yang , Xiaolin Huang

The ability to detect out-of-distribution (OOD) inputs is critical to guarantee the reliability of classification models deployed in an open environment. A fundamental challenge in OOD detection is that a discriminative classifier is…

机器学习 · 计算机科学 2024-08-12 Jirayu Burapacheep , Yixuan Li

Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models, especially in areas where security is critical. However, traditional OOD detection methods often fail to capture complex data distributions from…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Armando Zhu , Jiabei Liu , Keqin Li , Shuying Dai , Bo Hong , Peng Zhao , Changsong Wei

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

软件工程 · 计算机科学 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

Out-of-distribution (OOD) detection is a crucial task for ensuring the reliability and robustness of machine learning models. Recent works have shown that generative models often assign high confidence scores to OOD samples, indicating that…

机器学习 · 计算机科学 2023-11-29 Rui Sun , Andi Zhang , Haiming Zhang , Jinke Ren , Yao Zhu , Ruimao Zhang , Shuguang Cui , Zhen Li

Recent research has revealed that deep generative models including flow-based models and Variational Autoencoders may assign higher likelihoods to out-of-distribution (OOD) data than in-distribution (ID) data. However, we cannot sample OOD…

机器学习 · 计算机科学 2023-03-03 Yufeng Zhang , Jialu Pan , Wanwei Liu , Zhenbang Chen , Ji Wang , Zhiming Liu , Kenli Li , Hongmei Wei

Out-of-distribution (OOD) detection is a critical task in machine learning that seeks to identify abnormal samples. Traditionally, unsupervised methods utilize a deep generative model for OOD detection. However, such approaches require a…

机器学习 · 计算机科学 2024-10-25 Alvin Heng , Alexandre H. Thiery , Harold Soh

When deploying a trained machine learning model in the real world, it is inevitable to receive inputs from out-of-distribution (OOD) sources. For instance, in continual learning settings, it is common to encounter OOD samples due to the…

机器学习 · 计算机科学 2024-01-23 Chuanwen Feng , Wenlong Chen , Ao Ke , Yilong Ren , Xike Xie , S. Kevin Zhou

Generative models can now produce photorealistic synthetic data which is virtually indistinguishable from the real data used to train it. This is a significant evolution over previous models which could produce reasonable facsimiles of the…

机器学习 · 计算机科学 2024-12-10 Debargha Ganguly , Warren Morningstar , Andrew Yu , Vipin Chaudhary

Out-of-distribution (OOD) detection is an essential approach to robustifying deep learning models, enabling them to identify inputs that fall outside of their trained distribution. Existing OOD detection methods usually depend on crafted…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Yifan Wu , Xichen Ye , Songmin Dai , Dengye Pan , Xiaoqiang Li , Weizhong Zhang , Yifan Chen