English
Related papers

Related papers: Contrastive Representation Modeling for Anomaly De…

200 papers

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Recently, representation learning with contrastive learning algorithms has been successfully applied to challenging unlabeled datasets. However, these methods are unable to distinguish important features from unimportant ones under simply…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Toshiyuki Oshima , Kentaro Takagi , Kouta Nakata

Contrastive learning has recently emerged as a promising approach for learning data representations that discover and disentangle the explanatory factors of the data. Previous analyses of such approaches have largely focused on individual…

Machine Learning · Computer Science 2023-11-09 Stefan Matthes , Zhiwei Han , Hao Shen

Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. However, when…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Gaoang Wang , Yibing Zhan , Xinchao Wang , Mingli Song , Klara Nahrstedt

We study anomaly clustering, grouping data into coherent clusters of anomaly types. This is different from anomaly detection that aims to divide anomalies from normal data. Unlike object-centered image clustering, anomaly clustering is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Kihyuk Sohn , Jinsung Yoon , Chun-Liang Li , Chen-Yu Lee , Tomas Pfister

Out-of-Distribution (OOD) detection is a crucial problem for the safe deployment of machine learning models identifying samples that fall outside of the training distribution, i.e. in-distribution data (ID). Most OOD works focus on the…

Machine Learning · Computer Science 2023-10-04 Soroush Seifi , Daniel Olmeda Reino , Nikolay Chumerin , Rahaf Aljundi

Anomaly detection focuses on identifying samples that deviate from the norm. Discovering informative representations of normal samples is crucial to detecting anomalies effectively. Recent self-supervised methods have successfully learned…

Machine Learning · Computer Science 2025-09-22 Alain Ryser , Thomas M. Sutter , Alexander Marx , Julia E. Vogt

We study three intriguing properties of contrastive learning. First, we generalize the standard contrastive loss to a broader family of losses, and we find that various instantiations of the generalized loss perform similarly under the…

Machine Learning · Computer Science 2021-10-26 Ting Chen , Calvin Luo , Lala Li

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Contrastive learning operates on a simple yet effective principle: Embeddings of positive pairs are pulled together, while those of negative pairs are pushed apart. In this paper, we propose a unified framework for understanding contrastive…

Machine Learning · Computer Science 2025-07-16 Chungpa Lee , Sehee Lim , Kibok Lee , Jy-yong Sohn

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Typical methods for pedestrian detection focus on either tackling mutual occlusions between crowded pedestrians, or dealing with the various scales of pedestrians. Detecting pedestrians with substantial appearance diversities such as…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Zebin Lin , Wenjie Pei , Fanglin Chen , David Zhang , Guangming Lu

Contrastive learning produces coherent semantic feature embeddings by encouraging positive samples to cluster closely while separating negative samples. However, existing contrastive learning methods lack principled guarantees on coverage…

Machine Learning · Computer Science 2026-03-30 Yahya Alkhatib , Wee Peng Tay

Detecting test data deviating from training data is a central problem for safe and robust machine learning. Likelihoods learned by a generative model, e.g., a normalizing flow via standard log-likelihood training, perform poorly as an…

Machine Learning · Computer Science 2023-04-28 Robert Schmier , Ullrich Köthe , Christoph-Nikolas Straehle

Many unsupervised visual anomaly detection methods train an auto-encoder to reconstruct normal samples and then leverage the reconstruction error map to detect and localize the anomalies. However, due to the powerful modeling and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Qingqing Fang , Qinliang Su , Wenxi Lv , Wenchao Xu , Jianxing Yu

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model…

Machine Learning · Computer Science 2024-01-22 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Jian Lou , Li Xiong

Unsupervised anomaly detection (UAD) learns one-class classifiers exclusively with normal (i.e., healthy) images to detect any abnormal (i.e., unhealthy) samples that do not conform to the expected normal patterns. UAD has two main…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Yu Tian , Guansong Pang , Fengbei Liu , Yuanhong chen , Seon Ho Shin , Johan W. Verjans , Rajvinder Singh , Gustavo Carneiro

Contrastive learning has emerged as a competitive pretraining method for object detection. Despite this progress, there has been minimal investigation into the robustness of contrastively pretrained detectors when faced with domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kyle Buettner , Adriana Kovashka