English
Related papers

Related papers: Distilling Aggregated Knowledge for Weakly-Supervi…

200 papers

This paper proposes an ensemble learning model that is resistant to adversarial attacks. To build resilience, we introduced a training process where each member learns a radically distinct latent space. Member models are added one at a time…

Image and Video Processing · Electrical Eng. & Systems 2021-01-08 Ali Mirzaeian , Jana Kosecka , Houman Homayoun , Tinoosh Mohsenin , Avesta Sasan

Surface defect detection is one of the most essential processes for industrial quality inspection. Deep learning-based surface defect detection methods have shown great potential. However, the well-performed models usually require large…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Chen Sun , Liang Gao , Xinyu Li , Yiping Gao

Anomaly detection is critically important for intelligent surveillance systems to detect in a timely manner any malicious activities. Many video anomaly detection approaches using deep learning methods focus on a single camera video stream…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Chongke Wu , Sicong Shao , Cihan Tunc , Salim Hariri

Vision-based inspection algorithms have significantly contributed to quality control in industrial settings, particularly in addressing structural defects like dent and contamination which are prevalent in mass production. Extensive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Kangil Lee , Geonuk Kim

Video Anomaly Detection (VAD) automates the identification of unusual events, such as security threats in surveillance videos. In real-world applications, VAD models must effectively operate in cross-domain settings, identifying rare…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Yashika Jain , Ali Dabouei , Min Xu

We propose a very fast frame-level model for anomaly detection in video, which learns to detect anomalies by distilling knowledge from multiple highly accurate object-level teacher models. To improve the fidelity of our student, we distill…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Florinel-Alin Croitoru , Nicolae-Catalin Ristea , Dana Dascalescu , Radu Tudor Ionescu , Fahad Shahbaz Khan , Mubarak Shah

The emerging task of fine-grained image classification in low-data regimes assumes the presence of low inter-class variance and large intra-class variation along with a highly limited amount of training samples per class. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Dmitry Demidov , Abduragim Shtanchaev , Mihail Mihaylov , Mohammad Almansoori

We propose an efficient abnormal event detection model based on a lightweight masked auto-encoder (AE) applied at the video frame level. The novelty of the proposed model is threefold. First, we introduce an approach to weight tokens based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Nicolae-Catalin Ristea , Florinel-Alin Croitoru , Radu Tudor Ionescu , Marius Popescu , Fahad Shahbaz Khan , Mubarak Shah

Surveillance footage can catch a wide range of realistic anomalies. This research suggests using a weakly supervised strategy to avoid annotating anomalous segments in training videos, which is time consuming. In this approach only video…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Kapil Deshpande , Narinder Singh Punn , Sanjay Kumar Sonbhadra , Sonali Agarwal

Large convolutional neural network models have recently demonstrated impressive performance on video attention prediction. Conventionally, these models are with intensive computation and large memory. To address these issues, we design an…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Kui Fu , Peipei Shi , Yafei Song , Shiming Ge , Xiangju Lu , Jia Li

Performing anomaly detection in hybrid systems is a challenging task since it requires analysis of timing behavior and mutual dependencies of both discrete and continuous signals. Typically, it requires modeling system behavior, which is…

Machine Learning · Computer Science 2020-10-30 Nemanja Hranisavljevic , Oliver Niggemann , Alexander Maier

With the increasing adoption of video anomaly detection in intelligent surveillance domains, conventional visual-based detection approaches often struggle with information insufficiency and high false-positive rates in complex environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Peng Wu , Wanshun Su , Guansong Pang , Yujia Sun , Qingsen Yan , Peng Wang , Yanning Zhang

Knowledge Distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. While contrastive learning has shown promise in self-supervised learning by creating discriminative representations, its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

Knowledge distillation is an effective method for model compression. However, it is still a challenging topic to apply knowledge distillation to detection tasks. There are two key points resulting in poor distillation performance for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Zhenliang Ni , Fukui Yang , Shengzhao Wen , Gang Zhang

Weakly-supervised semantic segmentation aims to assign category labels to each pixel using weak annotations, significantly reducing manual annotation costs. Although existing methods have achieved remarkable progress in well-lit scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Chunyan Wang , Dong Zhang , Jinhui Tang

State-of-the-art CNN based recognition models are often computationally prohibitive to deploy on low-end devices. A promising high level approach tackling this limitation is knowledge distillation, which let small student model mimic…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Tao Wang , Li Yuan , Xiaopeng Zhang , Jiashi Feng

Knowledge distillation is normally used to compress a big network, or teacher, onto a smaller one, the student, by training it to match its outputs. Recently, some works have shown that robustness against adversarial attacks can also be…

Machine Learning · Computer Science 2022-03-15 Javier Maroto , Guillermo Ortiz-Jiménez , Pascal Frossard

Anomaly detection (AD) plays a pivotal role in numerous web-based applications, including malware detection, anti-money laundering, device failure detection, and network fault analysis. Most methods, which rely on unsupervised learning, are…

Machine Learning · Computer Science 2024-02-07 Haihong Zhao , Chenyi Zi , Yang Liu , Chen Zhang , Yan Zhou , Jia Li

Knowledge distillation is an effective image anomaly detection and localization scheme. However, a major drawback of this scheme is its tendency to overly generalize, primarily due to the similarities between input and supervisory signals.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yuxin Jiang , Yunkang Can , Weiming Shen

Despite the outstanding success of self-supervised pretraining methods for video representation learning, they generalise poorly when the unlabeled dataset for pretraining is small or the domain difference between unlabelled data in source…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Amirhossein Dadashzadeh , Alan Whone , Majid Mirmehdi