English
Related papers

Related papers: Fractals as Pre-training Datasets for Anomaly Dete…

200 papers

Detecting anomalous activity in video surveillance often involves using only normal activity data in order to learn an accurate detector. Due to lack of annotated data for some specific target domain, one could employ existing data from a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Fernando Pereira dos Santos , Leonardo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Anomaly detection is represented as an unsupervised learning to identify deviated images from normal images. In general, there are two main challenges of anomaly detection tasks, i.e., the class imbalance and the unexpectedness of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Shuting Yan , Pingping Chen , Honghui Chen , Huan Mao , Feng Chen , Zhijian Lin

Log anomaly detection is essential for system reliability, but it is extremely challenging to do considering it involves class imbalance. Additionally, the models trained in one domain are not applicable to other domains, necessitating the…

Machine Learning · Computer Science 2026-01-22 Krishna Sharma , Vivek Yelleti

Deep learning has transformed computer vision but relies heavily on large labeled datasets and computational resources. Transfer learning, particularly fine-tuning pretrained models, offers a practical alternative; however, models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Iván Matas , Carmen Serrano , Miguel Nogales , David Moreno , Lara Ferrándiz , Teresa Ojeda , Begoña Acha

In the backdrop of increasing data requirements of Deep Neural Networks for object recognition that is growing more untenable by the day, we present Developmental PreTraining (DPT) as a possible solution. DPT is designed as a…

Machine Learning · Computer Science 2023-12-04 Niranjan Rajesh , Debayan Gupta

1. Research question: With the growing interest in skin diseases and skin aesthetics, the ability to predict facial wrinkles is becoming increasingly important. This study aims to evaluate whether a computational model, convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ik Jun Moon , Junho Moon , Ikbeom Jang

The literature has proposed several methods to finetune pretrained GANs on new datasets, which typically results in higher performance compared to training from scratch, especially in the limited-data regime. However, despite the apparent…

Machine Learning · Computer Science 2022-03-11 Timofey Grigoryev , Andrey Voynov , Artem Babenko

It has been shown that deep learning models can under certain circumstances outperform traditional statistical methods at forecasting. Furthermore, various techniques have been developed for quantifying the forecast uncertainty (prediction…

Machine Learning · Computer Science 2021-10-08 Thabang Mathonsi , Terence L. van Zyl

Pretraining on large labeled datasets is a prerequisite to achieve good performance in many computer vision tasks like 2D object recognition, video classification etc. However, pretraining is not widely used for 3D recognition tasks where…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Zaiwei Zhang , Rohit Girdhar , Armand Joulin , Ishan Misra

Humans can easily detect a defect (anomaly) because it is different or salient when compared to the surface it resides on. Today, manual human visual inspection is still the norm because it is difficult to automate anomaly detection. Neural…

Machine Learning · Computer Science 2019-11-26 Manpreet Singh Minhas , John Zelek

With the wide application of knowledge distillation between an ImageNet pre-trained teacher model and a learnable student model, unsupervised anomaly detection has witnessed a significant achievement in the past few years. The success of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Canhui Tang , Sanping Zhou , Yizhe Li , Yonghao Dong , Le Wang

The recent rapid development of deep learning has laid a milestone in industrial Image Anomaly Detection (IAD). In this paper, we provide a comprehensive review of deep learning-based image anomaly detection techniques, from the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiaqi Liu , Guoyang Xie , Jinbao Wang , Shangnian Li , Chengjie Wang , Feng Zheng , Yaochu Jin

In recent years, pre-trained graph neural networks (GNNs) have been developed as general models which can be effectively fine-tuned for various potential downstream tasks in materials science, and have shown significant improvements in…

Materials Science · Physics 2025-03-04 Shuyi Jia , Shitij Govil , Manav Ramprasad , Victor Fung

Recent developments in computer vision and machine learning have made it possible to create realistic manipulated videos of human faces, raising the issue of ensuring adequate protection against the malevolent effects unlocked by such…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Michail Tarasiou , Stefanos Zafeiriou

Current unsupervised anomaly detection approaches perform well on public datasets but struggle with specific anomaly types due to the domain gap between pre-trained feature extractors and target-specific domains. To tackle this issue, this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yun Liang , Zhiguang Hu , Junjie Huang , Donglin Di , Anyang Su , Lei Fan

Advanced Persistent Threats (APTs) pose a significant security risk to organizations and industries. These attacks often lead to severe data breaches and compromise the system for a long time. Mitigating these sophisticated attacks is…

Cryptography and Security · Computer Science 2025-08-04 Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif

Formula-driven supervised learning (FDSL) has been shown to be an effective method for pre-training vision transformers, where ExFractalDB-21k was shown to exceed the pre-training effect of ImageNet-21k. These studies also indicate that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Sora Takashima , Ryo Hayamizu , Nakamasa Inoue , Hirokatsu Kataoka , Rio Yokota

The increasing automation in many areas of the Industry expressly demands to design efficient machine-learning solutions for the detection of abnormal events. With the ubiquitous deployment of sensors monitoring nearly continuously the…

Anomaly segmentation plays a pivotal role in identifying atypical objects in images, crucial for hazard detection in autonomous driving systems. While existing methods demonstrate noteworthy results on synthetic data, they often fail to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Ji Zhang , Xiao Wu , Zhi-Qi Cheng , Qi He , Wei Li

Formula-driven supervised learning (FDSL) is a pre-training method that relies on synthetic images generated from mathematical formulae such as fractals. Prior work on FDSL has shown that pre-training vision transformers on such synthetic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Ryo Nakamura , Hirokatsu Kataoka , Sora Takashima , Edgar Josafat Martinez Noriega , Rio Yokota , Nakamasa Inoue