English
Related papers

Related papers: Filter or Compensate: Towards Invariant Representa…

200 papers

Diffusion models (DMs) have emerged as a powerful class of generative AI models, showing remarkable potential in anomaly detection (AD) tasks across various domains, such as cybersecurity, fraud detection, healthcare, and manufacturing. The…

Machine Learning · Computer Science 2025-02-28 Jing Liu , Zhenchao Ma , Zepu Wang , Chenxuanyin Zou , Jiayang Ren , Zehua Wang , Liang Song , Bo Hu , Yang Liu , Victor C. M. Leung

Unsupervised anomaly detection encompasses diverse applications in industrial settings where a high-throughput and precision is imperative. Early works were centered around one-class-one-model paradigm, which poses significant challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Sushovan Jena , Vishwas Saini , Ujjwal Shaw , Pavitra Jain , Abhay Singh Raihal , Anoushka Banerjee , Sharad Joshi , Ananth Ganesh , Arnav Bhavsar

Most unsupervised image anomaly localization methods suffer from overgeneralization because of the high generalization abilities of convolutional neural networks, leading to unreliable predictions. To mitigate the overgeneralization, this…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yunkang Cao , Xiaohao Xu , Zhaoge Liu , Weiming Shen

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Deep neural networks are known to be vulnerable to unseen data: they may wrongly assign high confidence stcores to out-distribuion samples. Recent works try to solve the problem using representation learning methods and specific metrics. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Haowei He , Jiaye Teng , Yang Yuan

Anomaly detection (AD) plays a crucial role in time series applications, primarily because time series data is employed across real-world scenarios. Detecting anomalies poses significant challenges since anomalies take diverse forms making…

Machine Learning · Computer Science 2025-01-03 Jihan Ghanim , Mariette Awad

Knowledge Distillation (KD) has been used in image classification for model compression. However, rare studies apply this technology on single-stage object detectors. Focal loss shows that the accumulated errors of easily-classified samples…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Shitao Tang , Litong Feng , Wenqi Shao , Zhanghui Kuang , Wei Zhang , Yimin Chen

Unsupervised representation learning has proved to be a critical component of anomaly detection/localization in images. The challenges to learn such a representation are two-fold. Firstly, the sample size is not often large enough to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Mohammadreza Salehi , Niousha Sadjadi , Soroosh Baselizadeh , Mohammad Hossein Rohban , Hamid R. Rabiee

Existing approaches towards anomaly detection~(AD) often rely on a substantial amount of anomaly-free data to train representation and density models. However, large anomaly-free datasets may not always be available before the inference…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Jingyi Liao , Xun Xu , Manh Cuong Nguyen , Adam Goodge , Chuan Sheng Foo

Out-of-distribution (OOD) detection is the problem of identifying inputs which are unrelated to the in-distribution task. The OOD detection performance when the in-distribution (ID) is ImageNet-1K is commonly being tested on a small range…

Machine Learning · Computer Science 2023-06-02 Julian Bitterwolf , Maximilian Müller , Matthias Hein

Humans recognize anomalies through two aspects: larger patch-wise representation discrepancies and weaker patch-to-normal-patch correlations. However, the previous AD methods didn't sufficiently combine the two complementary aspects to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Xincheng Yao , Ruoqi Li , Zefeng Qian , Yan Luo , Chongyang Zhang

Vision-based inspection algorithms have significantly contributed to quality control in industrial settings, particularly in addressing structural defects like dent and contamination which are prevalent in mass production. Extensive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Kangil Lee , Geonuk Kim

Diffusion models excel at generative modeling (e.g., text-to-image) but sampling requires multiple denoising network passes, limiting practicality. Efforts such as progressive distillation or consistency distillation have shown promise by…

Machine Learning · Computer Science 2025-04-01 Risheek Garrepalli , Shweta Mahajan , Munawar Hayat , Fatih Porikli

This study explores the application of anomaly detection (AD) methods in imbalanced learning tasks, focusing on fraud detection using real online credit card payment data. We assess the performance of several recent AD methods and compare…

Machine Learning · Computer Science 2023-12-22 Hugo Thimonier , Fabrice Popineau , Arpad Rimmel , Bich-Liên Doan , Fabrice Daniel

Identifying Out-of-distribution (OOD) data is becoming increasingly critical as the real-world applications of deep learning methods expand. Post-hoc methods modify softmax scores fine-tuned on outlier data or leverage intermediate feature…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Saandeep Aathreya , Shaun Canavan

While image-based detectors have shown promise in Android malware detection, they often struggle to maintain their performance and interpretability when encountering out-of-distribution (OOD) samples. Specifically, OOD samples generated by…

Cryptography and Security · Computer Science 2026-01-09 Wei Wang , Junhui Li , Chengbin Feng , Zhiwei Yang , Qi Mo

This paper addresses the increasingly prominent problem of anomaly detection in distributed systems. It proposes a detection method based on federated contrastive learning. The goal is to overcome the limitations of traditional centralized…

Machine Learning · Computer Science 2025-06-25 Renzi Meng , Heyi Wang , Yumeng Sun , Qiyuan Wu , Lian Lian , Renhan Zhang

Knowledge Distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. While contrastive learning has shown promise in self-supervised learning by creating discriminative representations, its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

We tackle unsupervised anomaly detection (UAD), a problem of detecting data that significantly differ from normal data. UAD is typically solved by using density estimation. Recently, deep neural network (DNN)-based density estimators, such…

Machine Learning · Statistics 2019-03-14 Masataka Yamaguchi , Yuma Koizumi , Noboru Harada