English
Related papers

Related papers: Distilling Aggregated Knowledge for Weakly-Supervi…

200 papers

Efficient object detection methods have recently received great attention in remote sensing. Although deep convolutional networks often have excellent detection accuracy, their deployment on resource-limited edge devices is difficult.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Pourya Shamsolmoali , Jocelyn Chanussot , Huiyu Zhou , Yue Lu

Although industrial anomaly detection (AD) technology has made significant progress in recent years, generating realistic anomalies and learning priors of normal remain challenging tasks. In this study, we propose an end-to-end industrial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xuan Xia , Weijie Lv , Xing He , Nan Li , Chuanqi Liu , Ning Ding

Graph anomaly detection in this paper aims to distinguish abnormal nodes that behave differently from the benign ones accounting for the majority of graph-structured instances. Receiving increasing attention from both academia and industry,…

Machine Learning · Computer Science 2022-10-19 Fanzhen Liu , Xiaoxiao Ma , Jia Wu , Jian Yang , Shan Xue , Amin Beheshti , Chuan Zhou , Hao Peng , Quan Z. Sheng , Charu C. Aggarwal

Significant memory and computational requirements of large deep neural networks restrict their application on edge devices. Knowledge distillation (KD) is a prominent model compression technique for deep neural networks in which the…

Computation and Language · Computer Science 2021-04-16 Aref Jafari , Mehdi Rezagholizadeh , Pranav Sharma , Ali Ghodsi

Weakly supervised video anomaly detection (WSVAD) is a challenging task since only video-level labels are available for training. In previous studies, the discriminative power of the learned features is not strong enough, and the data…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Congqi Cao , Xin Zhang , Shizhou Zhang , Peng Wang , Yanning Zhang

Many existing studies on knowledge distillation have focused on methods in which a student model mimics a teacher model well. Simply imitating the teacher's knowledge, however, is not sufficient for the student to surpass that of the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Jihyeon Seo , Kyusam Oh , Chanho Min , Yongkeun Yun , Sungwoo Cho

Anomaly activities such as robbery, explosion, accidents, etc. need immediate actions for preventing loss of human life and property in real world surveillance systems. Although the recent automation in surveillance systems are capable of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Snehashis Majhi , Srijan Das , Francois Bremond , Ratnakar Dash , Pankaj Kumar Sa

Knowledge distillation aims at transferring the knowledge from a large teacher model to a small student model with great improvements of the performance of the student model. Therefore, the student network can replace the teacher network to…

Machine Learning · Computer Science 2021-12-28 Jinhong Lin , Zhaoyang Li

Knowledge Distillation (KD) aims at improving the performance of a low-capacity student model by inheriting knowledge from a high-capacity teacher model. Previous KD methods typically train a student by minimizing a task-related loss and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Mengya Gao , Yujun Shen , Quanquan Li , Junjie Yan , Liang Wan , Dahua Lin , Chen Change Loy , Xiaoou Tang

Unsupervised representation learning has proved to be a critical component of anomaly detection/localization in images. The challenges to learn such a representation are two-fold. Firstly, the sample size is not often large enough to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Mohammadreza Salehi , Niousha Sadjadi , Soroosh Baselizadeh , Mohammad Hossein Rohban , Hamid R. Rabiee

In video understanding, most cross-modal knowledge distillation (KD) methods are tailored for classification tasks, focusing on the discriminative representation of the trimmed videos. However, action detection requires not only…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Rui Dai , Srijan Das , Francois Bremond

Knowledge distillation is a mainstream algorithm in model compression by transferring knowledge from the larger model (teacher) to the smaller model (student) to improve the performance of student. Despite many efforts, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Muhe Ding , Jianlong Wu , Xue Dong , Xiaojie Li , Pengda Qin , Tian Gan , Liqiang Nie

This paper investigates the performance of diffusion models for video anomaly detection (VAD) within the most challenging but also the most operational scenario in which the data annotations are not used. As being sparse, diverse,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Anil Osman Tur , Nicola Dall'Asen , Cigdem Beyan , Elisa Ricci

Change detection, which aims to detect spatial changes from a pair of multi-temporal images due to natural or man-made causes, has been widely applied in remote sensing, disaster management, urban management, etc. Most existing change…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Binghao Lu , Caiwen Ding , Jinbo Bi , Dongjin Song

Video anomaly detection is to determine whether there are any abnormal events, behaviors or objects in a given video, which enables effective and intelligent public safety management. As video anomaly labeling is both time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yang Wang , Jiaogen Zhou , Jihong Guan

Abnormal event detection or anomaly detection in surveillance videos is currently a challenge because of the diversity of possible events. Due to the lack of anomalous events at training time, anomaly detection requires the design of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Darshan Venkatrayappa

Knowledge distillation (KD) is a technique to derive optimal performance from a small student network (SN) by distilling knowledge of a large teacher network (TN) and transferring the distilled knowledge to the small SN. Since a role of…

Machine Learning · Computer Science 2019-07-10 Seunghyun Lee , Byung Cheol Song

Video anomaly detection is one of the hot research topics in computer vision nowadays, as abnormal events contain a high amount of information. Anomalies are one of the main detection targets in surveillance systems, usually needing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Mohammad Baradaran , Robert Bergevin

Multi-label image classification is a fundamental but challenging task towards general visual understanding. Existing methods found the region-level cues (e.g., features from RoIs) can facilitate multi-label classification. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Yongcheng Liu , Lu Sheng , Jing Shao , Junjie Yan , Shiming Xiang , Chunhong Pan

Knowledge distillation (KD) aims at improving the performance of a compact student model by distilling the knowledge from a high-performing teacher model. In this paper, we present an adaptive KD approach, namely AdaDistill, for deep face…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Fadi Boutros , Vitomir Štruc , Naser Damer