中文
相关论文

相关论文: On Out-of-distribution Detection with Energy-based…

200 篇论文

Out-of-distribution recognition forms an important and well-studied problem in deep learning, with the goal to filter out samples that do not belong to the distribution on which a network has been trained. The conclusion of this paper is…

机器学习 · 计算机科学 2025-06-13 Tejaswi Kasarla , Max van Spengler , Pascal Mettes

We study a new approach to learning energy-based models (EBMs) based on adversarial training (AT). We show that (binary) AT learns a special kind of energy function that models the support of the data distribution, and the learning process…

机器学习 · 计算机科学 2022-12-29 Xuwang Yin , Shiying Li , Gustavo K. Rohde

Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully…

机器学习 · 计算机科学 2022-10-28 Qizhou Wang , Feng Liu , Yonggang Zhang , Jing Zhang , Chen Gong , Tongliang Liu , Bo Han

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Assefa Seyoum Wahd

While energy-based models (EBMs) exhibit a number of desirable properties, training and sampling on high-dimensional datasets remains challenging. Inspired by recent progress on diffusion probabilistic models, we present a diffusion…

机器学习 · 计算机科学 2021-03-30 Ruiqi Gao , Yang Song , Ben Poole , Ying Nian Wu , Diederik P. Kingma

Out-of-distribution (OOD) detection aims to discern outliers from the intended data distribution, which is crucial to maintaining high reliability and a good user experience. Most recent studies in OOD detection utilize the information from…

计算与语言 · 计算机科学 2022-10-21 Hyunsoo Cho , Choonghyun Park , Jaewook Kang , Kang Min Yoo , Taeuk Kim , Sang-goo Lee

Despite machine learning models' success in Natural Language Processing (NLP) tasks, predictions from these models frequently fail on out-of-distribution (OOD) samples. Prior works have focused on developing state-of-the-art methods for…

计算与语言 · 计算机科学 2021-11-30 Dyah Adila , Dongyeop Kang

Text-attributed graphs, where nodes are enriched with textual attributes, have become a powerful tool for modeling real-world networks such as citation, social, and transaction networks. However, existing methods for learning from these…

人工智能 · 计算机科学 2026-03-24 Xiaoxu Ma , Dong Li , Minglai Shao , Xintao Wu , Chen Zhao

Machine Learning classifiers used in Brain-Computer Interfaces make classifications based on the distribution of data they were trained on. When they need to make inferences on samples that fall outside of this distribution, they can only…

Multi-label Out-Of-Distribution (OOD) detection aims to discriminate the OOD samples from the multi-label In-Distribution (ID) ones. Compared with its multiclass counterpart, it is crucial to model the joint information among classes. To…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Yuchen Sun , Qianqian Xu , Zitai Wang , Zhiyong Yang , Junwei He

Out-of-distribution (OOD) detection is essential for model trustworthiness which aims to sensitively identify semantic OOD samples and robustly generalize for covariate-shifted OOD samples. However, we discover that the superior OOD…

机器学习 · 计算机科学 2024-10-16 Qingyang Zhang , Qiuxuan Feng , Joey Tianyi Zhou , Yatao Bian , Qinghua Hu , Changqing Zhang

Recent semantic segmentation models accurately classify test-time examples that are similar to a training dataset distribution. However, their discriminative closed-set approach is not robust in practical data setups with distributional…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Denis Gudovskiy , Tomoyuki Okuno , Yohei Nakata

Energy-based models (EBMs) have become increasingly popular within computer vision in recent years. While they are commonly employed for generative image modeling, recent work has applied EBMs also for regression tasks, achieving…

计算机视觉与模式识别 · 计算机科学 2020-08-17 Fredrik K. Gustafsson , Martin Danelljan , Radu Timofte , Thomas B. Schön

Training energy-based models (EBMs) on discrete spaces is challenging because sampling over such spaces can be difficult. We propose to train discrete EBMs with energy discrepancy (ED), a novel type of contrastive loss functional which only…

机器学习 · 统计学 2023-07-18 Tobias Schröder , Zijing Ou , Yingzhen Li , Andrew B. Duncan

Efficient and effective Out-of-Distribution (OOD) detection is essential for the safe deployment of AI systems. Existing feature space methods, while effective, often incur significant computational overhead due to their reliance on…

机器学习 · 计算机科学 2024-06-05 Litian Liu , Yao Qin

Likelihood from a generative model is a natural statistic for detecting out-of-distribution (OoD) samples. However, generative models have been shown to assign higher likelihood to OoD samples compared to ones from the training…

机器学习 · 计算机科学 2019-10-22 Jiaming Song , Yang Song , Stefano Ermon

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

机器学习 · 计算机科学 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra

Recognizing out-of-distribution (OOD) samples is critical for machine learning systems deployed in the open world. The vast majority of OOD detection methods are driven by a single modality (e.g., either vision or language), leaving the…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Yifei Ming , Ziyang Cai , Jiuxiang Gu , Yiyou Sun , Wei Li , Yixuan Li

Learning on graphs, where instance nodes are inter-connected, has become one of the central problems for deep learning, as relational structures are pervasive and induce data inter-dependence which hinders trivial adaptation of existing…

机器学习 · 计算机科学 2023-03-10 Qitian Wu , Yiting Chen , Chenxiao Yang , Junchi Yan

Out-of-distribution (OOD) detection is essential to improve the reliability of machine learning models by detecting samples that do not belong to the training distribution. Detecting OOD samples effectively in certain tasks can pose a…

计算机视觉与模式识别 · 计算机科学 2023-11-02 Divyanshu Mishra , He Zhao , Pramit Saha , Aris T. Papageorghiou , J. Alison Noble