中文
相关论文

相关论文: Understanding normalization in contrastive represe…

200 篇论文

A recent popular approach to out-of-distribution (OOD) detection is based on a self-supervised learning technique referred to as contrastive learning. There are two main variants of contrastive learning, namely instance and class…

机器学习 · 计算机科学 2022-11-08 Nawid Keshtmand , Raul Santos-Rodriguez , Jonathan Lawry

Out-of-distribution (OOD) detection aims to discern outliers from the intended data distribution, which is crucial to maintaining high reliability and a good user experience. Most recent studies in OOD detection utilize the information from…

计算与语言 · 计算机科学 2022-10-21 Hyunsoo Cho , Choonghyun Park , Jaewook Kang , Kang Min Yoo , Taeuk Kim , Sang-goo Lee

Handling out-of-distribution (OOD) samples has become a major stake in the real-world deployment of machine learning systems. This work explores the use of self-supervised contrastive learning to the simultaneous detection of two types of…

机器学习 · 计算机科学 2024-12-11 Charles Guille-Escuret , Pau Rodriguez , David Vazquez , Ioannis Mitliagkas , Joao Monteiro

Outlier exposure (OE) is powerful in out-of-distribution (OOD) detection, enhancing detection capability via model fine-tuning with surrogate OOD data. However, surrogate data typically deviate from test OOD data. Thus, the performance of…

机器学习 · 计算机科学 2023-03-10 Qizhou Wang , Junjie Ye , Feng Liu , Quanyu Dai , Marcus Kalander , Tongliang Liu , Jianye Hao , Bo Han

Out-of-Distribution (OOD) detection is a crucial problem for the safe deployment of machine learning models identifying samples that fall outside of the training distribution, i.e. in-distribution data (ID). Most OOD works focus on the…

机器学习 · 计算机科学 2023-10-04 Soroush Seifi , Daniel Olmeda Reino , Nikolay Chumerin , Rahaf Aljundi

The outlier exposure method is an effective approach to address the unsupervised anomaly sound detection problem. The key focus of this method is how to make the model learn the distribution space of normal data. Based on biological…

声音 · 计算机科学 2025-09-22 Xinxin Meng , Jiangtao Guo , Yunxiang Zhang , Shun Huang

Unsupervised out-of-distribution (OOD) Detection aims to separate the samples falling outside the distribution of training data without label information. Among numerous branches, contrastive learning has shown its excellent capability of…

计算机视觉与模式识别 · 计算机科学 2023-02-07 Menglong Chen , Xingtai Gui , Shicai Fan

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

机器学习 · 计算机科学 2022-01-25 Jan Diers , Christian Pigorsch

Pretrained Transformers achieve remarkable performance when training and test data are from the same distribution. However, in real-world scenarios, the model often faces out-of-distribution (OOD) instances that can cause severe semantic…

计算与语言 · 计算机科学 2022-01-24 Wenxuan Zhou , Fangyu Liu , Muhao Chen

Detecting test data deviating from training data is a central problem for safe and robust machine learning. Likelihoods learned by a generative model, e.g., a normalizing flow via standard log-likelihood training, perform poorly as an…

机器学习 · 计算机科学 2023-04-28 Robert Schmier , Ullrich Köthe , Christoph-Nikolas Straehle

Unsupervised continual learning aims to learn new tasks incrementally without requiring human annotations. However, most existing methods, especially those targeted on image classification, only work in a simplified scenario by assuming all…

计算机视觉与模式识别 · 计算机科学 2022-04-13 Jiangpeng He , Fengqing Zhu

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribution examples. At the…

机器学习 · 计算机科学 2019-01-30 Dan Hendrycks , Mantas Mazeika , Thomas Dietterich

Standard classification theory assumes that the distribution of images in the test and training sets are identical. Unfortunately, real-life scenarios typically feature unseen data (``out-of-distribution data") which is different from data…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Gianluca Barone , Aashrit Cunchala , Rudy Nunez

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

计算与语言 · 计算机科学 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Out-of-distribution (OOD) detection is essential for deploying machine learning models in open-world and safety-critical scenarios, where test inputs may deviate from the training distribution and overconfident predictions on unknown…

机器学习 · 计算机科学 2026-05-28 Fengqiang Wan , Qing-Yuan Jiang , Yang Yang

Reliable detection of out-of-distribution (OOD) inputs is increasingly understood to be a precondition for deployment of machine learning systems. This paper proposes and investigates the use of contrastive training to boost OOD detection…

It is essential for safety-critical applications of deep neural networks to determine when new inputs are significantly different from the training distribution. In this paper, we explore this out-of-distribution (OOD) detection problem for…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Poulami Sinhamahapatra , Rajat Koner , Karsten Roscher , Stephan Günnemann

Detecting whether examples belong to a given in-distribution or are Out-Of-Distribution (OOD) requires identifying features specific to the in-distribution. In the absence of labels, these features can be learned by self-supervised…

人工智能 · 计算机科学 2022-01-19 Nima Rafiee , Rahil Gholamipoorfard , Nikolas Adaloglou , Simon Jaxy , Julius Ramakers , Markus Kollmann

Distance-based anomaly detection methods rely on compact in-distribution (ID) embeddings that are well separated from anomalies. However, conventional contrastive learning strategies often struggle to achieve this balance, either promoting…

机器学习 · 计算机科学 2026-02-02 Willian T. Lunardi , Abdulrahman Banabila , Dania Herzalla , Martin Andreoni

Text-attributed graphs, where nodes are enriched with textual attributes, have become a powerful tool for modeling real-world networks such as citation, social, and transaction networks. However, existing methods for learning from these…

人工智能 · 计算机科学 2026-03-24 Xiaoxu Ma , Dong Li , Minglai Shao , Xintao Wu , Chen Zhao
‹ 上一页 1 2 3 10 下一页 ›