English
Related papers

Related papers: Mean-Shifted Contrastive Loss for Anomaly Detectio…

200 papers

For anomaly detection (AD), early approaches often train separate models for individual classes, yielding high performance but posing challenges in scalability and resource management. Recent efforts have shifted toward training a single…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Lei Fan , Junjie Huang , Donglin Di , Anyang Su , Tianyou Song , Maurice Pagnucco , Yang Song

Visual anomaly detection targets to detect images that notably differ from normal pattern, and it has found extensive application in identifying defective parts within the manufacturing industry. These anomaly detection paradigms…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Anindya Sundar Das , Guansong Pang , Monowar Bhuyan

Contrastive representation learning has emerged as an outstanding approach for anomaly detection. In this work, we explore the $\ell_2$-norm of contrastive features and its applications in out-of-distribution detection. We propose a simple…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tai Le-Gia , Jaehyun Ahn

Unsupervised contrastive learning has gained increasing attention in the latest research and has proven to be a powerful method for learning representations from unlabeled data. However, little theoretical analysis was known for this…

Machine Learning · Computer Science 2021-06-01 Zixin Wen

Anomaly detection seeks to identify unusual phenomena, a central task in science and industry. The task is inherently unsupervised as anomalies are unexpected and unknown during training. Recent advances in self-supervised representation…

Machine Learning · Computer Science 2022-10-20 Tal Reiss , Niv Cohen , Eliahu Horwitz , Ron Abutbul , Yedid Hoshen

Training image-based object detectors presents formidable challenges, as it entails not only the complexities of object detection but also the added intricacies of precisely localizing objects within potentially diverse and noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

There are not many large medical image datasets available. For these datasets, too small deep learning models can't learn useful features, so they don't work well due to underfitting, and too big models tend to overfit the limited data. As…

Image and Video Processing · Electrical Eng. & Systems 2023-11-02 Pervaiz Iqbal Khan , Andreas Dengel , Sheraz Ahmed

Self-supervised learning of deep neural networks has become a prevalent paradigm for learning representations that transfer to a variety of downstream tasks. Similar to proposed models of the ventral stream of biological vision, it is…

Machine Learning · Computer Science 2023-06-26 Kion Fallah , Alec Helbling , Kyle A. Johnsen , Christopher J. Rozell

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Unsupervised anomaly detection using deep learning has garnered significant research attention due to its broad applicability, particularly in medical imaging where labeled anomalous data are scarce. While earlier approaches leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chunlei Li , Yilei Shi , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

Contrastive Analysis (CA) detects anomalies by contrasting patterns unique to a target group (e.g., unhealthy subjects) from those in a background group (e.g., healthy subjects). In the context of brain MRIs, existing CA approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Cristiano Patrício , Carlo Alberto Barbano , Attilio Fiandrotti , Riccardo Renzulli , Marco Grangetto , Luis F. Teixeira , João C. Neves

In neutrino physics, analyses often depend on large simulated datasets, making it essential for models to generalise effectively to real-world detector data. Contrastive learning, a well-established technique in deep learning, offers a…

High Energy Physics - Experiment · Physics 2025-05-23 Alex Wilkinson , Radi Radev , Saul Alonso-Monsalve

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

Contrastive learning has shown to learn better quality representations than models trained using cross-entropy loss. They also transfer better to downstream datasets from different domains. However, little work has been done to explore the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Alvin De Jun Tan , Clement Tan , Chai Kiat Yeo

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Recent methods for deep metric learning have been focusing on designing different contrastive loss functions between positive and negative pairs of samples so that the learned feature embedding is able to pull positive samples of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shichao Kan , Zhiquan He , Yigang Cen , Yang Li , Vladimir Mladenovic , Zhihai He

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

We consider the problem of anomaly detection with a small set of partially labeled anomaly examples and a large-scale unlabeled dataset. This is a common scenario in many important applications. Existing related methods either exclusively…

Machine Learning · Computer Science 2021-06-11 Guansong Pang , Anton van den Hengel , Chunhua Shen , Longbing Cao

Anomaly detection methods require high-quality features. In recent years, the anomaly detection community has attempted to obtain better features using advances in deep self-supervised feature learning. Surprisingly, a very promising…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Tal Reiss , Niv Cohen , Liron Bergman , Yedid Hoshen

Existing approaches towards anomaly detection~(AD) often rely on a substantial amount of anomaly-free data to train representation and density models. However, large anomaly-free datasets may not always be available before the inference…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Jingyi Liao , Xun Xu , Manh Cuong Nguyen , Adam Goodge , Chuan Sheng Foo