English
Related papers

Related papers: Mitigating the reconstruction-detection trade-off …

200 papers

Deep generative models have been demonstrated as problematic in the unsupervised out-of-distribution (OOD) detection task, where they tend to assign higher likelihoods to OOD samples. Previous studies on this issue are usually not…

Machine Learning · Computer Science 2024-01-04 Zezhen Zeng , Bin Liu

We propose a novel Conditional Latent space Variational Autoencoder (CL-VAE) to perform improved pre-processing for anomaly detection on data with known inlier classes and unknown outlier classes. This proposed variational autoencoder (VAE)…

Machine Learning · Computer Science 2024-10-17 Oskar Åström , Alexandros Sopasakis

Anomaly detection is a prominent data preprocessing step in learning applications for correction and/or removal of faulty data. Automating this data type with the use of autoencoders could increase the quality of the dataset by isolating…

Machine Learning · Computer Science 2020-04-10 Benjamin Smith , Kevin Cant , Gloria Wang

Surrogate models that combine dimensionality reduction and regression techniques are essential to reduce the need for costly high-fidelity computational fluid dynamics data. New approaches using $\beta$-Variational Autoencoder ($\beta$-VAE)…

Variational Autoencoders (VAEs) have experienced recent success as data-generating models by using simple architectures that do not require significant fine-tuning of hyperparameters. However, VAEs are known to suffer from…

Machine Learning · Statistics 2020-07-22 Wei Cheng , Gregory Darnell , Sohini Ramachandran , Lorin Crawford

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

This paper introduces a hybrid attention and autoencoder (AE) model for unsupervised online anomaly detection in time series. The autoencoder captures local structural patterns in short embeddings, while the attention model learns long-term…

Machine Learning · Computer Science 2024-01-09 Seyed Amirhossein Najafi , Mohammad Hassan Asemani , Peyman Setoodeh

Unsupervised anomaly detection could be crucial in future analyses searching for rare phenomena in large datasets, as for example collected at the LHC. To this end, we introduce a physics inspired variational autoencoder (VAE) architecture…

High Energy Physics - Phenomenology · Physics 2022-06-08 Blaž Bortolato , Barry M. Dillon , Jernej F. Kamenik , Aleks Smolkovič

Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in…

Machine Learning · Computer Science 2023-12-13 Julia Huiming Wang , Dexter Tsin , Tatiana Engel

A trade-off exists between reconstruction quality and the prior regularisation in the Evidence Lower Bound (ELBO) loss that Variational Autoencoder (VAE) models use for learning. There are few satisfactory approaches to deal with a balance…

Machine Learning · Computer Science 2019-09-10 Shuyu Lin , Stephen Roberts , Niki Trigoni , Ronald Clark

We focus on the problem of unsupervised cell outlier detection and repair in mixed-type tabular data. Traditional methods are concerned only with detecting which rows in the dataset are outliers. However, identifying which cells are…

Machine Learning · Computer Science 2020-03-05 Simão Eduardo , Alfredo Nazábal , Christopher K. I. Williams , Charles Sutton

Anomaly detection without priors of the anomalies is challenging. In the field of unsupervised anomaly detection, traditional auto-encoder (AE) tends to fail based on the assumption that by training only on normal images, the model will not…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yajie Cui , Zhaoxiang Liu , Shiguo Lian

Out-of-distribution (OOD) detection is a critical task in machine learning, particularly for safety-critical applications where unexpected inputs must be reliably flagged. While hierarchical variational autoencoders (HVAEs) offer improved…

Machine Learning · Computer Science 2025-06-13 Dane Williamson , Yangfeng Ji , Matthew Dwyer

Detecting anomalies for multivariate time-series without manual supervision continues a challenging problem due to the increased scale of dimensions and complexity of today's IT monitoring systems. Recent progress of unsupervised…

Machine Learning · Computer Science 2021-10-19 Qinfeng Xiao , Shikuan Shao , Jing Wang

We claim that a source of severe failures for Variational Auto-Encoders is the choice of the distribution class used for the observation model.A first theoretical and experimental contribution of the paper is to establish that even in the…

Machine Learning · Computer Science 2020-03-05 Michele Sebag , Victor Berger , Michèle Sebag

We propose a robust variational autoencoder with $\beta$ divergence for tabular data (RTVAE) with mixed categorical and continuous features. Variational autoencoders (VAE) and their variations are popular frameworks for anomaly detection…

Machine Learning · Computer Science 2020-06-17 Haleh Akrami , Sergul Aydore , Richard M. Leahy , Anand A. Joshi

Microstructure reconstruction is an important and emerging field of research and an essential foundation to improving inverse computational materials engineering (ICME). Much of the recent progress in the field is made based on generative…

Machine Learning · Computer Science 2023-03-08 Yichi Zhang , Paul Seibert , Alexandra Otto , Alexander Raßloff , Marreddy Ambati , Markus Kästner

Probabilistic generative models are attractive for scientific modeling because their inferred parameters can be used to generate hypotheses and design experiments. This requires that the learned model provide an accurate representation of…

Machine Learning · Statistics 2023-01-18 Liyun Tu , Austin Talbot , Neil Gallagher , David Carlson

Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the…

Signal Processing · Electrical Eng. & Systems 2023-12-07 Michael Baur , Franz Weißer , Benedikt Böck , Wolfgang Utschick

In autonomous driving, detection of abnormal driving behaviors is essential to ensure the safety of vehicle controllers. Prior works in vehicle anomaly detection have shown that modeling interactions between agents improves detection…