English
Related papers

Related papers: Better Latent Spaces for Better Autoencoders

200 papers

In this paper, we provide the first focused study on the discontinuities (aka. holes) in the latent space of Variational Auto-Encoders (VAEs), a phenomenon which has been shown to have a detrimental effect on model capacity. When…

Machine Learning · Computer Science 2021-10-08 Ruizhe Li , Xutan Peng , Chenghua Lin

Autoencoders have been proposed as a powerful tool for model-independent anomaly detection in high-energy physics. The operating principle is that events which do not belong to the space of training data will be reconstructed poorly, thus…

High Energy Physics - Phenomenology · Physics 2021-05-06 Joshua Batson , C. Grace Haaf , Yonatan Kahn , Daniel A. Roberts

Optimizing molecular design and discovering novel chemical structures to meet certain objectives, such as quantitative estimates of the drug-likeness score (QEDs), is NP-hard due to the vast combinatorial design space of discrete molecular…

Machine Learning · Computer Science 2023-02-23 Mohammad Sajjad Ghaemi , Hang Hu , Anguang Hu , Hsu Kiang Ooi

This paper discusses model-agnostic searches for new physics at the Large Hadron Collider (LHC) using anomaly-detection techniques for the identification of event signatures that deviate from the Standard Model (SM). We investigate anomaly…

High Energy Physics - Phenomenology · Physics 2022-09-26 S. V. Chekanov , W. Hopkins

Data-driven reduced-order models based on autoencoders generally lack interpretability compared to classical methods such as the proper orthogonal decomposition. More interpretability can be gained by disentangling the latent variables and…

Machine Learning · Computer Science 2025-02-21 Henning Schwarz , Pyei Phyo Lin , Jens-Peter M. Zemke , Thomas Rung

The problem of learning a manifold structure on a dataset is framed in terms of a generative model, to which we use ideas behind autoencoders (namely adversarial/Wasserstein autoencoders) to fit deep neural networks. From a machine learning…

Machine Learning · Statistics 2018-03-02 Eric O. Korman

There has been significant work recently in developing machine learning (ML) models in high energy physics (HEP) for tasks such as classification, simulation, and anomaly detection. Often these models are adapted from those designed for…

High Energy Physics - Experiment · Physics 2023-06-13 Zichun Hao , Raghav Kansal , Javier Duarte , Nadezda Chernyavskaya

Among other uses, neural networks are a powerful tool for solving deterministic and Bayesian inverse problems in real-time, where variational autoencoders, a specialized type of neural network, enable the Bayesian estimation of model…

Machine Learning · Computer Science 2025-09-25 Andrea Tonini , Luca Dede'

Anomaly detection is a classical but worthwhile problem, and many deep learning-based anomaly detection algorithms have been proposed, which can usually achieve better detection results than traditional methods. In view of reconstruct…

Machine Learning · Computer Science 2020-04-16 Chunkai Zhang , Shaocong Li , Hongye Zhang , Yingyang Chen

Variational Autoencoders for multimodal data hold promise for many tasks in data analysis, such as representation learning, conditional generation, and imputation. Current architectures either share the encoder output, decoder input, or…

Learning in the latent variable model is challenging in the presence of the complex data structure or the intractable latent variable. Previous variational autoencoders can be low effective due to the straightforward encoder-decoder…

Machine Learning · Computer Science 2018-04-13 Jiangchao Yao , Ivor Tsang , Ya Zhang

The generative autoencoders, such as the variational autoencoders or the adversarial autoencoders, have achieved great success in lots of real-world applications, including image generation, and signal communication. However, little concern…

Machine Learning · Computer Science 2023-07-06 Mingfei Lu , Badong Chen

Unsupervised discovery of latent representations, in addition to being useful for density modeling, visualisation and exploratory data analysis, is also increasingly important for learning features relevant to discriminative tasks.…

Machine Learning · Statistics 2011-10-27 Jasper Snoek , Ryan Prescott Adams , Hugo Larochelle

Reliable aero-engine anomaly detection is crucial for ensuring aircraft safety and operational efficiency. This research explores the application of the Fisher autoencoder as an unsupervised deep learning method for detecting anomalies in…

Signal Processing · Electrical Eng. & Systems 2025-02-11 Saba Sanami , Amir G. Aghdam

The use of Variational Autoencoders in different Machine Learning tasks has drastically increased in the last years. They have been developed as denoising, clustering and generative tools, highlighting a large potential in a wide range of…

Machine Learning · Computer Science 2019-07-12 Helena Andrés-Terré , Pietro Lió

Anomaly detection algorithms are often thought to be limited because they don't facilitate the process of validating results performed by domain experts. In Contrast, deep learning algorithms for anomaly detection, such as autoencoders,…

Machine Learning · Computer Science 2020-07-02 Liat Antwarg , Ronnie Mindlin Miller , Bracha Shapira , Lior Rokach

Novelty detection is a important research area which mainly solves the classification problem of inliers which usually consists of normal samples and outliers composed of abnormal samples. Auto-encoder is often used for novelty detection.…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Miao Tian , Dongyan Guo , Ying Cui , Xiang Pan , Shengyong Chen

We investigate a method of model-agnostic anomaly detection through studying jets, collimated sprays of particles produced in high-energy collisions. We train a transformer neural network to encode simulated QCD "event space" dijets into a…

High Energy Physics - Phenomenology · Physics 2023-05-17 Barry M. Dillon , Radha Mastandrea , Benjamin Nachman

Due to the growing amount of data from in-situ sensors in wastewater systems, it becomes necessary to automatically identify abnormal behaviours and ensure high data quality. This paper proposes an anomaly detection method based on a deep…

Signal Processing · Electrical Eng. & Systems 2020-03-09 Stefania Russo , Andy Disch , Frank Blumensaat , Kris Villez

Anomaly detection relies on designing a score to determine whether a particular event is uncharacteristic of a given background distribution. One way to define a score is to use autoencoders, which rely on the ability to reconstruct certain…

High Energy Physics - Phenomenology · Physics 2022-03-30 Katherine Fraser , Samuel Homiller , Rashmish K. Mishra , Bryan Ostdiek , Matthew D. Schwartz