English
Related papers

Related papers: Unsupervised Boosting-based Autoencoder Ensembles …

200 papers

Variational autoencoder (VAE) is a deep generative model for unsupervised learning, allowing to encode observations into the meaningful latent space. VAE is prone to catastrophic forgetting when tasks arrive sequentially, and only the data…

Machine Learning · Computer Science 2021-11-04 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev

Building a scalable machine learning system for unsupervised anomaly detection via representation learning is highly desirable. One of the prevalent methods is using a reconstruction error from variational autoencoder (VAE) via maximizing…

Machine Learning · Computer Science 2020-05-08 Seonho Park , George Adosoglou , Panos M. Pardalos

Use of an autoencoder (AE) as a normal model is a state-of-the-art technique for unsupervised-anomaly detection in sounds (ADS). The AE is trained to minimize the sample mean of the anomaly score of normal sounds in a mini-batch. One…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-22 Yuma Koizumi , Shoichiro Saito , Masataka Yamaguchi , Shin Murata , Noboru Harada

In industry, machine anomalous sound detection (ASD) is in great demand. However, collecting enough abnormal samples is difficult due to the high cost, which boosts the rapid development of unsupervised ASD algorithms. Autoencoder (AE)…

Sound · Computer Science 2023-11-16 Yifan Zhou , Dongxing Xu , Haoran Wei , Yanhua Long

Most of the data-driven approaches applied to bearing fault diagnosis up to date are established in the supervised learning paradigm, which usually requires a large set of labeled data collected a priori. In practical applications, however,…

Machine Learning · Computer Science 2019-12-10 Shen Zhang , Fei Ye , Bingnan Wang , Thomas G. Habetler

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially…

Image and Video Processing · Electrical Eng. & Systems 2020-01-03 David Zimmerer , Simon Kohl , Jens Petersen , Fabian Isensee , Klaus Maier-Hein

This paper aims to improve the explainability of Autoencoder's (AE) predictions by proposing two explanation methods based on the mean and epistemic uncertainty of log-likelihood estimate, which naturally arise from the probabilistic…

Machine Learning · Computer Science 2021-10-20 Bang Xiang Yong , Alexandra Brintrup

Semi-supervised and unsupervised Generative Adversarial Networks (GAN)-based methods have been gaining popularity in anomaly detection task recently. However, GAN training is somewhat challenging and unstable. Inspired from previous work in…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Ha Son Vu , Daisuke Ueta , Kiyoshi Hashimoto , Kazuki Maeno , Sugiri Pranata , Sheng Mei Shen

Self-supervised models allow (pre-)training on unlabeled data and therefore have the potential to overcome the need for large annotated cohorts. One leading self-supervised model is the masked autoencoder (MAE) which was developed on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-13 Daniel M. Lang , Eli Schwartz , Cosmin I. Bercea , Raja Giryes , Julia A. Schnabel

A new semi-supervised ensemble algorithm called XGBOD (Extreme Gradient Boosting Outlier Detection) is proposed, described and demonstrated for the enhanced detection of outliers from normal observations in various practical datasets. The…

Machine Learning · Computer Science 2020-09-22 Yue Zhao , Maciej K. Hryniewicki

This paper introduces a hybrid attention and autoencoder (AE) model for unsupervised online anomaly detection in time series. The autoencoder captures local structural patterns in short embeddings, while the attention model learns long-term…

Machine Learning · Computer Science 2024-01-09 Seyed Amirhossein Najafi , Mohammad Hassan Asemani , Peyman Setoodeh

Anomaly detection is a prominent data preprocessing step in learning applications for correction and/or removal of faulty data. Automating this data type with the use of autoencoders could increase the quality of the dataset by isolating…

Machine Learning · Computer Science 2020-04-10 Benjamin Smith , Kevin Cant , Gloria Wang

Many real-world monitoring and surveillance applications require non-trivial anomaly detection to be run in the streaming model. We consider an incremental-learning approach, wherein a deep-autoencoding (DAE) model of what is normal is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Albert Akhriev , Jakub Marecek

Recent progress in Generative Artificial Intelligence (AI) relies on efficient data representations, often featuring encoder-decoder architectures. We formalize the mathematical problem of finding the optimal encoder-decoder pair and…

Machine Learning · Computer Science 2023-08-29 Semyon Malamud , Teng Andrea Xu , Antoine Didisheim

We present a new flavor of Variational Autoencoder (VAE) that interpolates seamlessly between unsupervised, semi-supervised and fully supervised learning domains. We show that unlabeled datapoints not only boost unsupervised tasks, but also…

Machine Learning · Computer Science 2019-11-15 Felix Berkhahn , Richard Keys , Wajih Ouertani , Nikhil Shetty , Dominik Geißler

Explainable Artificial Intelligence (XAI) models have recently attracted a great deal of interest from a variety of application sectors. Despite significant developments in this area, there are still no standardized methods or approaches…

Machine Learning · Computer Science 2023-12-08 Sarit Maitra , Vivek Mishra , Pratima Verma , Manav Chopra , Priyanka Nath

Even though auto-encoders (AEs) have the desirable property of learning compact representations without labels and have been widely applied to out-of-distribution (OoD) detection, they are generally still poorly understood and are used…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Cosmin I. Bercea , Daniel Rueckert , Julia A. Schnabel

As a powerful approach for exploratory data analysis, unsupervised clustering is a fundamental task in computer vision and pattern recognition. Many clustering algorithms have been developed, but most of them perform unsatisfactorily on the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Pengfei Ge , Chuan-Xian Ren , Jiashi Feng , Shuicheng Yan

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Identifying complex phenotypes from high-dimensional biological data is challenging due to the intricate interdependencies among different physiological indicators. Traditional approaches often focus on detecting outliers in single…

Machine Learning · Statistics 2024-10-24 Yafei Shen , Tao Zhang , Zhiwei Liu , Kalliopi Kostelidou , Ying Xu , Ling Yang