English
Related papers

Related papers: Advancing Pre-trained Teacher: Towards Robust Feat…

200 papers

Knowledge Distillation (KD) for object detection aims to train a compact detector by transferring knowledge from a teacher model. Since the teacher model perceives data in a way different from humans, existing KD methods only distill…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jiawei Liang , Siyuan Liang , Aishan Liu , Ke Ma , Jingzhi Li , Xiaochun Cao

Neural networks can learn spurious correlations in the data, often leading to performance degradation for underrepresented subgroups. Studies have demonstrated that the disparity is amplified when knowledge is distilled from a complex…

Machine Learning · Computer Science 2025-11-11 Patrik Kenfack , Ulrich Aïvodji , Samira Ebrahimi Kahou

The incorporation of advanced sensors and machine learning techniques has enabled modern manufacturing enterprises to perform data-driven classification-based anomaly detection based on the sensor data collected in manufacturing processes.…

Machine Learning · Computer Science 2024-11-19 Yuxuan Li , Tianxin Xie , Chenang Liu , Zhangyue Shi

Video Anomaly Detection (VAD) can play a key role in spotting unusual activities in video footage. VAD is difficult to use in real-world settings due to the dynamic nature of human actions, environmental variations, and domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shanle Yao , Ghazal Alinezhad Noghre , Armin Danesh Pazho , Hamed Tabkhi

A popular method for anomaly detection is to use the generator of an adversarial network to formulate anomaly scores over reconstruction loss of input. Due to the rare occurrence of anomalies, optimizing such networks can be a cumbersome…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Muhammad Zaigham Zaheer , Jin-ha Lee , Marcella Astrid , Seung-Ik Lee

Anomaly detection (AD) aims to identify defective images and localize their defects (if any). Ideally, AD models should be able to detect defects over many image classes; without relying on hard-coded class names that can be uninformative…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Chih-Hui Ho , Kuan-Chuan Peng , Nuno Vasconcelos

Anomaly detection is a fundamental problem in computer vision area with many real-world applications. Given a wide range of images belonging to the normal class, emerging from some distribution, the objective of this task is to construct…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Chengwei Chen , Pan Chen , Haichuan Song , Yiqing Tao , Yuan Xie , Shouhong Ding , Lizhuang Ma

Knowledge distillation is effective for producing small, high-performance neural networks for classification, but these small networks are vulnerable to adversarial attacks. This paper studies how adversarial robustness transfers from…

Machine Learning · Computer Science 2020-07-02 Micah Goldblum , Liam Fowl , Soheil Feizi , Tom Goldstein

The task of image anomaly detection (IAD) aims to identify deviations from normality in image data. These anomalies are patterns that deviate significantly from what the IAD model has learned from the data during training. However, in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jihun Yi , Dahuin Jung , Sungroh Yoon

Although continual learning and anomaly detection have separately been well-studied in previous works, their intersection remains rather unexplored. The present work addresses a learning scenario where a model has to incrementally learn a…

Machine Learning · Computer Science 2022-07-15 Ahmed Frikha , Denis Krompaß , Volker Tresp

From a safety perspective, a machine learning method embedded in real-world applications is required to distinguish irregular situations. For this reason, there has been a growing interest in the anomaly detection (AD) task. Since we cannot…

Machine Learning · Computer Science 2021-04-21 JuneKyu Park , Jeong-Hyeon Moon , Namhyuk Ahn , Kyung-Ah Sohn

Multispectral pedestrian detection has been shown to be effective in improving performance within complex illumination scenarios. However, prevalent double-stream networks in multispectral detection employ two separate feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zizhao Chen , Yeqiang Qian , Xiaoxiao Yang , Chunxiang Wang , Ming Yang

Anomalies are intuitively easy for human experts to understand, but they are hard to define mathematically. Therefore, in order to have performance guarantees in unsupervised anomaly detection, priors need to be assumed on what the…

Machine Learning · Statistics 2020-04-08 Tiago Pimentel , Marianne Monteiro , Adriano Veloso , Nivio Ziviani

Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly…

Machine Learning · Computer Science 2020-10-07 Lucas Deecke , Lukas Ruff , Robert A. Vandermeulen , Hakan Bilen

Anomaly detection suffered from the lack of anomalies due to the diversity of abnormalities and the difficulties of obtaining large-scale anomaly data. Semi-supervised anomaly detection methods are often used to solely leverage normal data…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jian Shi , Ni Zhang

Anomaly detection (AD) tasks have been solved using machine learning algorithms in various domains and applications. The great majority of these algorithms use normal data to train a residual-based model and assign anomaly scores to unseen…

Machine Learning · Computer Science 2024-02-01 Markus Ulmer , Jannik Zgraggen , Lilach Goren Huber

Automatic Chord Recognition (ACR) is constrained by the scarcity of aligned chord labels, as well-aligned annotations are costly to acquire. At the same time, open-weight pre-trained models are currently more accessible than their…

Sound · Computer Science 2026-03-31 Nghia Phan , Rong Jin , Gang Liu , Xiao Dong

Anomaly detection has garnered extensive applications in real industrial manufacturing due to its remarkable effectiveness and efficiency. However, previous generative-based models have been limited by suboptimal reconstruction quality,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Hui Zhang , Zheng Wang , Dan Zeng , Zuxuan Wu , Yu-Gang Jiang

One pivot challenge for image anomaly (AD) detection is to learn discriminative information only from normal class training images. Most image reconstruction based AD methods rely on the discriminative capability of reconstruction error.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Dongyun Lin , Yiqun Li , Shudong Xie , Tin Lay Nwe , Sheng Dong

Detecting out of distribution (OOD) samples is of paramount importance in all Machine Learning applications. Deep generative modeling has emerged as a dominant paradigm to model complex data distributions without labels. However, prior work…

Machine Learning · Computer Science 2021-01-05 Gowthami Somepalli , Yexin Wu , Yogesh Balaji , Bhanukiran Vinzamuri , Soheil Feizi