English
Related papers

Related papers: Filter or Compensate: Towards Invariant Representa…

200 papers

Anomaly detection is a critical task in computer vision with profound implications for medical imaging, where identifying pathologies early can directly impact patient outcomes. While recent unsupervised anomaly detection approaches show…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Le Dong , Qinzhong Tan , Chunlei Li , Jingliang Hu , Yilei Shi , Weisheng Dong , Xiao Xiang Zhu , Lichao Mou

We present a novel method for image anomaly detection, where algorithms that use samples drawn from some distribution of "normal" data, aim to detect out-of-distribution (abnormal) samples. Our approach includes a combination of encoder and…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Nina Tuluptceva , Bart Bakker , Irina Fedulova , Anton Konushin

The inability of deep learning models to handle data drawn from unseen distributions has sparked much interest in unsupervised out-of-distribution (U-OOD) detection, as it is crucial for reliable deep learning models. Despite considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Lars Doorenbos , Raphael Sznitman , Pablo Márquez-Neila

Anomaly detection (AD), separating anomalies from normal data, has many applications across domains, from security to healthcare. While most previous works were shown to be effective for cases with fully or partially labeled data, that…

Machine Learning · Computer Science 2022-08-08 Jinsung Yoon , Kihyuk Sohn , Chun-Liang Li , Sercan O. Arik , Chen-Yu Lee , Tomas Pfister

The detection and localization of anomalies is one important medical image analysis task. Most commonly, Computer Vision anomaly detection approaches rely on manual annotations that are both time consuming and expensive to obtain.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Sergio Naval Marimont , Giacomo Tarroni

In recent years, knowledge distillation has been proved to be an effective solution for model compression. This approach can make lightweight student models acquire the knowledge extracted from cumbersome teacher models. However, previous…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Xing Dai , Zeren Jiang , Zhao Wu , Yiping Bao , Zhicheng Wang , Si Liu , Erjin Zhou

Anomaly detection (AD) is often focused on detecting anomaly areas for industrial quality inspection and medical lesion examination. However, due to the specific scenario targets, the data scale for AD is relatively small, and evaluation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Jiangning Zhang , Chengjie Wang , Xiangtai Li , Guanzhong Tian , Zhucun Xue , Yong Liu , Guansong Pang , Dacheng Tao

Out-of-distribution (OOD) detection aims to detect "unknown" data whose labels have not been seen during the in-distribution (ID) training process. Recent progress in representation learning gives rise to distance-based OOD detection that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ji Zhang , Lianli Gao , Bingguang Hao , Hao Huang , Jingkuan Song , Hengtao Shen

Industrial defect detection is commonly addressed with anomaly detection (AD) methods where no or only incomplete data of potentially occurring defects is available. This work discovers previously unknown problems of student-teacher…

Machine Learning · Computer Science 2022-10-19 Marco Rudolph , Tom Wehrbein , Bodo Rosenhahn , Bastian Wandt

Anomaly detection is a critical task in industrial manufacturing, aiming to identify defective parts of products. Most industrial anomaly detection methods assume the availability of sufficient normal data for training. This assumption may…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zhenyu Yan , Qingqing Fang , Wenxi Lv , Qinliang Su

This paper explores the utility of diffusion-based models for anomaly detection, focusing on their efficacy in identifying deviations in both compact and high-resolution datasets. Diffusion-based architectures, including Denoising Diffusion…

Machine Learning · Computer Science 2024-12-11 Aryan Bhosale , Samrat Mukherjee , Biplab Banerjee , Fabio Cuzzolin

Multi-class anomaly detection aims to build unified models across diverse product categories. However, as the number of categories grows, its performance often degrades due to increasingly complex and heterogeneous normal distributions. To…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yaoxuan Feng , Yuxin Li , Weijiang Lv , Zixuan Zhao , Yubiao Wang , Wenchao Chen , Bo Chen , Hongwei Liu

Learning robust models under distribution shifts between training and test datasets is a fundamental challenge in machine learning. While learning invariant features across environments is a popular approach, it often assumes that these…

Machine Learning · Computer Science 2025-09-15 Taero Kim , Subeen Park , Sungjun Lim , Yonghan Jung , Krikamol Muandet , Kyungwoo Song

Data-Free Knowledge Distillation (DFKD) is a promising task to train high-performance small models to enhance actual deployment without relying on the original training data. Existing methods commonly avoid relying on private data by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yuzheng Wang , Dingkang Yang , Zhaoyu Chen , Yang Liu , Siao Liu , Wenqiang Zhang , Lihua Zhang , Lizhe Qi

This paper introduces a universal approach to seamlessly combine out-of-distribution (OOD) detection scores. These scores encompass a wide range of techniques that leverage the self-confidence of deep learning models and the anomalous…

Machine Learning · Statistics 2024-06-25 Eduardo Dadalto , Florence Alberge , Pierre Duhamel , Pablo Piantanida

Anomaly detection aims to identify samples that deviate from the nominal data distribution and is central to many safety-critical applications. However, developing effective anomaly detection methods for categorical, mixed-type, and…

Machine Learning · Computer Science 2026-05-29 Lixing Zhang , Yuchen Liang , Liyan Xie

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Qiaowei Miao , Yawei Luo , Yi Yang

Anomaly detection is a ubiquitous and challenging task relevant across many disciplines. With the vital role communication networks play in our daily lives, the security of these networks is imperative for smooth functioning of society. To…

Cryptography and Security · Computer Science 2022-10-18 Gopikrishna Rathinavel , Nikhil Muralidhar , Timothy O'Shea , Naren Ramakrishnan

For a very long time, unsupervised learning for anomaly detection has been at the heart of image processing research and a stepping stone for high performance industrial automation process. With the emergence of CNN, several methods have…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Simon Thomine , Hichem Snoussi , Mahmoud Soua

Non-independent and identically distributed (Non-IID) data across edge clients have long posed significant challenges to federated learning (FL) training in edge computing environments. Prior works have proposed various methods to mitigate…

Machine Learning · Computer Science 2025-04-25 Weijie Liu , Ziwei Zhan , Carlee Joe-Wong , Edith Ngai , Jingpu Duan , Deke Guo , Xu Chen , Xiaoxi Zhang