English
Related papers

Related papers: mixed attention auto encoder for multi-class indus…

200 papers

Masked Autoencoder~(MAE) is a prevailing self-supervised learning method that achieves promising results in model pre-training. However, when the various downstream tasks have data distributions different from the pre-training data, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Zhili Liu , Kai Chen , Jianhua Han , Lanqing Hong , Hang Xu , Zhenguo Li , James T. Kwok

Unsupervised anomaly detection in medical images such as chest radiographs is stepping into the spotlight as it mitigates the scarcity of the labor-intensive and costly expert annotation of anomaly data. However, nearly all existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Behzad Bozorgtabar , Dwarikanath Mahapatra , Jean-Philippe Thiran

Multi-modal industrial anomaly detection typically relies on separate models for each product category, fundamentally limiting practical scalability. When shifting to a unified paradigm that handles diverse classes simultaneously, detection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yangchen Wu , Huiqiang Xie

While intrusion detection systems (IDSs) benefit from the diversity and generalization of IoT data features, the data diversity (e.g., the heterogeneity and high dimensions of data) also makes it difficult to train effective machine…

Machine Learning · Computer Science 2025-11-26 Phai Vu Dinh , Diep N. Nguyen , Dinh Thai Hoang , Quang Uy Nguyen , Eryk Dutkiewicz , Son Pham Bao

We propose a novel Conditional Latent space Variational Autoencoder (CL-VAE) to perform improved pre-processing for anomaly detection on data with known inlier classes and unknown outlier classes. This proposed variational autoencoder (VAE)…

Machine Learning · Computer Science 2024-10-17 Oskar Åström , Alexandros Sopasakis

Masked Autoencoders (MAE) play a pivotal role in learning potent representations, delivering outstanding results across various 3D perception tasks essential for autonomous driving. In real-world driving scenarios, it's commonplace to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jian Zou , Tianyu Huang , Guanglei Yang , Zhenhua Guo , Tao Luo , Chun-Mei Feng , Wangmeng Zuo

Due to the limited availability of anomalous samples for training, video anomaly detection is commonly viewed as a one-class classification problem. Many prevalent methods investigate the reconstruction difference produced by AutoEncoders…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Xiangyu Huang , Caidan Zhao , Chenxing Gao , Lvdong Chen , Zhiqiang Wu

In order to learn universal sentence representations, previous methods focus on complex recurrent neural networks or supervised learning. In this paper, we propose a mean-max attention autoencoder (mean-max AAE) within the encoder-decoder…

Computation and Language · Computer Science 2018-09-19 Minghua Zhang , Yunfang Wu , Weikang Li , Wei Li

Unsupervised anomaly detection is a challenging task. Autoencoders (AEs) or generative models are often employed to model the data distribution of normal inputs and subsequently identify anomalous, out-of-distribution inputs by high…

Machine Learning · Computer Science 2025-06-12 Yalin Liao , Austin J. Brockmeier

Masked Autoencoder (MAE) has demonstrated superior performance on various vision tasks via randomly masking image patches and reconstruction. However, effective data augmentation strategies for MAE still remain open questions, different…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

In this work, we propose a Multi-Window Masked Autoencoder (MW-MAE) fitted with a novel Multi-Window Multi-Head Attention (MW-MHA) module that facilitates the modelling of local-global interactions in every decoder transformer block through…

Sound · Computer Science 2023-10-03 Sarthak Yadav , Sergios Theodoridis , Lars Kai Hansen , Zheng-Hua Tan

Anomaly detection on attributed networks aims at finding nodes whose patterns deviate significantly from the majority of reference nodes, which is pervasive in many applications such as network intrusion detection and social spammer…

Machine Learning · Computer Science 2020-02-13 Haoyi Fan , Fengbin Zhang , Zuoyong Li

Stacked AutoEncoders (SAE) have been widely adopted in edge anomaly detection scenarios. However, the resource-intensive nature of SAE can pose significant challenges for edge devices, which are typically resource-constrained and must adapt…

Neural and Evolutionary Computing · Computer Science 2026-03-17 Lizhao Zhang , Shengsong Kong , Tao Guo , Shaobo Li , Zhenzhou Ji

This paper aims to develop an acoustic signal-based unsupervised anomaly detection method for automatic machine monitoring. Existing approaches such as deep autoencoder (DAE), variational autoencoder (VAE), conditional variational…

Machine Learning · Computer Science 2022-06-14 Harsh Purohit , Takashi Endo , Masaaki Yamamoto , Yohei Kawaguchi

Unsupervised anomaly detection and localization is a crucial task as it is impossible to collect and label all possible anomalies. Many studies have emphasized the importance of integrating local and global information to achieve accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 E. Mathian , H. Liu , L. Fernandez-Cuesta , D. Samaras , M. Foll , L. Chen

Although unsupervised generative modeling of an image dataset using a Variational AutoEncoder (VAE) has been used to detect anomalous images, or anomalous regions in images, recent works have shown that this method often identifies images…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 David Dehaene , Pierre Eline

The problem of domain generalization is to take knowledge acquired from a number of related domains where training data is available, and to then successfully apply it to previously unseen domains. We propose a new feature learning…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Muhammad Ghifary , W. Bastiaan Kleijn , Mengjie Zhang , David Balduzzi

Most unsupervised anomaly detection methods based on representations of normal samples to distinguish anomalies have recently made remarkable progress. However, existing methods only learn a single decision boundary for distinguishing the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Tianwu Lei , Silin Chen , Bohan Wang , Zhengkai Jiang , Ningmu Zou

In contemporary society, surveillance anomaly detection, i.e., spotting anomalous events such as crimes or accidents in surveillance videos, is a critical task. As anomalies occur rarely, most training data consists of unlabeled videos…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 MyeongAh Cho , Taeoh Kim , Woo Jin Kim , Suhwan Cho , Sangyoun Lee

Anomaly detection is a prominent data preprocessing step in learning applications for correction and/or removal of faulty data. Automating this data type with the use of autoencoders could increase the quality of the dataset by isolating…

Machine Learning · Computer Science 2020-04-10 Benjamin Smith , Kevin Cant , Gloria Wang