English
Related papers

Related papers: MSS-PAE: Saving Autoencoder-based Outlier Detectio…

200 papers

This paper introduces a methodology based on Denoising AutoEncoder (DAE) for missing data imputation. The proposed methodology, called mDAE hereafter, results from a modification of the loss function and a straightforward procedure for…

Machine Learning · Computer Science 2024-11-21 Mariette Dupuy , Marie Chavent , Remi Dubois

Autoencoder and its variants have been widely applicated in anomaly detection.The previous work memory-augmented deep autoencoder proposed memorizing normality to detect anomaly, however it neglects the feature discrepancy between different…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Yifei Yang , Shibing Xiang , Ruixiang Zhang

In machine learning, novelty detection is the task of identifying novel unseen data. During training, only samples from the normal class are available. Test samples are classified as normal or abnormal by assignment of a novelty score. Here…

Automated anomaly detection is essential for managing information and communications technology (ICT) systems to maintain reliable services with minimum burden on operators. For detecting varying and continually emerging anomalies as…

Machine Learning · Statistics 2018-12-19 Yasuhiro Ikeda , Keisuke Ishibashi , Yuusuke Nakano , Keishiro Watanabe , Ryoichi Kawahara

In anomaly detection (AD), one seeks to identify whether a test sample is abnormal, given a data set of normal samples. A recent and promising approach to AD relies on deep generative models, such as variational autoencoders (VAEs), for…

Machine Learning · Computer Science 2021-11-05 Tal Daniel , Thanard Kurutach , Aviv Tamar

Deep autoencoder has been extensively used for anomaly detection. Training on the normal data, the autoencoder is expected to produce higher reconstruction error for the abnormal inputs than the normal ones, which is adopted as a criterion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Dong Gong , Lingqiao Liu , Vuong Le , Budhaditya Saha , Moussa Reda Mansour , Svetha Venkatesh , Anton van den Hengel

Deep Learning models possess two key traits that, in combination, make their use in the real world a risky prospect. One, they do not typically generalize well outside of the distribution for which they were trained, and two, they tend to…

Machine Learning · Computer Science 2021-09-29 Jonathan S. Kent , Bo Li

After an autoencoder (AE) has learnt to reconstruct one dataset, it might be expected that the likelihood on an out-of-distribution (OOD) input would be low. This has been studied as an approach to detect OOD inputs. Recent work showed this…

Machine Learning · Computer Science 2021-07-29 Bang Xiang Yong , Tim Pearce , Alexandra Brintrup

Anomaly detection is a prominent data preprocessing step in learning applications for correction and/or removal of faulty data. Automating this data type with the use of autoencoders could increase the quality of the dataset by isolating…

Machine Learning · Computer Science 2020-04-10 Benjamin Smith , Kevin Cant , Gloria Wang

We propose an out-of-distribution detection method that combines density and restoration-based approaches using Vector-Quantized Variational Auto-Encoders (VQ-VAEs). The VQ-VAE model learns to encode images in a categorical latent space.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Sergio Naval Marimont , Giacomo Tarroni

Unsupervised anomaly detection (UAD) has been widely implemented in industrial and medical applications, which reduces the cost of manual annotation and improves efficiency in disease diagnosis. Recently, deep auto-encoder with its variants…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Mingqing Wang , Jiawei Li , Zhenyang Li , Chengxiao Luo , Bin Chen , Shu-Tao Xia , Zhi Wang

Out-of-distribution (OOD) detection is the task of identifying data sampled from distributions that were not used during training. This task is essential for reliable machine learning and a better understanding of their generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Kohei Fukuda , Hiroaki Aizawa

Despite numerous studies of deep autoencoders (AEs) for unsupervised anomaly detection, AEs still lack a way to express uncertainty in their predictions, crucial for ensuring safe and trustworthy machine learning systems in high-stake…

Machine Learning · Computer Science 2022-02-28 Bang Xiang Yong , Alexandra Brintrup

Outlier detection is a crucial analytical tool in various fields. In critical systems like manufacturing, malfunctioning outlier detection can be costly and safety-critical. Therefore, there is a significant need for explainable artificial…

Machine Learning · Computer Science 2025-02-04 Patrick Knab , Sascha Marton , Christian Bartelt , Robert Fuder

Sparse autoencoders (SAEs) are widely used in mechanistic interpretability to project LLM activations onto sparse latent spaces. However, sparsity alone is an imperfect proxy for interpretability, and current training objectives often…

Machine Learning · Computer Science 2026-04-09 Vivek Narayanaswamy , Kowshik Thopalli , Bhavya Kailkhura , Wesam Sakla

Deep networks often make confident, yet, incorrect, predictions when tested with outlier data that is far removed from their training distributions. Likelihoods computed by deep generative models (DGMs) are a candidate metric for outlier…

Machine Learning · Computer Science 2022-07-20 Kushal Chauhan , Barath Mohan U , Pradeep Shenoy , Manish Gupta , Devarajan Sridharan

Anomaly Detection (AD) defines the task of identifying observations or events that deviate from typical - or normal - patterns, a critical capability in IT security for recognizing incidents such as system misconfigurations, malware…

How can we detect anomalies: that is, samples that significantly differ from a given set of high-dimensional data, such as images or sensor data? This is a practical problem with numerous applications and is also relevant to the goal of…

Machine Learning · Computer Science 2022-06-16 Adam Goodge , Bryan Hooi , See Kiong Ng , Wee Siong Ng

A clear need for automatic anomaly detection applied to automotive testing has emerged as more and more attention is paid to the data recorded and manual evaluation by humans reaches its capacity. Such real-world data is massive, diverse,…

Machine Learning · Computer Science 2024-11-22 Lucas Correia , Jan-Christoph Goos , Philipp Klein , Thomas Bäck , Anna V. Kononova

High dimensional data is often assumed to be concentrated on or near a low-dimensional manifold. Autoencoders (AE) is a popular technique to learn representations of such data by pushing it through a neural network with a low dimension…

Machine Learning · Computer Science 2020-10-06 Amos Gropp , Matan Atzmon , Yaron Lipman