English
Related papers

Related papers: Autoencoder with Ordered Variance for Nonlinear Mo…

200 papers

The high cost of acquiring labels is one of the main challenges in deploying supervised machine learning algorithms. Active learning is a promising approach to control the learning process and address the difficulties of data labeling by…

Machine Learning · Computer Science 2019-11-19 Farhad Pourkamali-Anaraki , Michael B. Wakin

We introduce a novel variational autoencoder (VAE) architecture that can generate realistic and diverse high energy physics events. The model we propose utilizes several techniques from VAE literature in order to simulate high fidelity jet…

High Energy Physics - Phenomenology · Physics 2020-09-11 Kosei Dohi

Existing black box modeling approaches in machine learning suffer from a fixed input and output feature combination. In this paper, a new approach to reconstruct missing variables in a set of time series is presented. An autoencoder is…

Machine Learning · Computer Science 2023-08-22 Jan-Philipp Roche , Oliver Niggemann , Jens Friebe

Discrete latent variables are considered important for real world data, which has motivated research on Variational Autoencoders (VAEs) with discrete latents. However, standard VAE training is not possible in this case, which has motivated…

Machine Learning · Statistics 2023-03-27 Enrico Guiraud , Jakob Drefs , Jörg Lücke

The process of tuning the size of the hidden layers for autoencoders has the benefit of providing optimally compressed representations for the input data. However, such hyper-parameter tuning process would take a lot of computation and time…

Machine Learning · Computer Science 2025-07-08 Sarthak Ketanbhai Modi , Zi Pong Lim , Yushi Cao , Yupeng Cheng , Yon Shin Teo , Shang-Wei Lin

Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional…

Machine Learning · Computer Science 2021-03-02 A. Asperti , D. Evangelista , E. Loli Piccolomini

Obesity is a common issue in modern societies today that can lead to various diseases and significantly reduced quality of life. Currently, research has been conducted to investigate resting state EEG (electroencephalogram) signals with an…

Machine Learning · Computer Science 2023-02-03 Yuan Yue , Jeremiah D. Deng , Dirk De Ridder , Patrick Manning , Divya Adhia

Sequence-to-sequence (Seq2seq) models have played an important role in the recent success of various natural language processing methods, such as machine translation, text summarization, and speech recognition. However, current Seq2seq…

Computation and Language · Computer Science 2018-06-05 Myeongjun Jang , Seungwan Seo , Pilsung Kang

Modeling and controlling complex spatiotemporal dynamical systems driven by partial differential equations (PDEs) often necessitate dimensionality reduction techniques to construct lower-order models for computational efficiency. This paper…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Priyabrata Saha , Saibal Mukhopadhyay

Variational autoencoders (VAEs) are a popular framework for modeling complex data distributions; they can be efficiently trained via variational inference by maximizing the evidence lower bound (ELBO), at the expense of a gap to the exact…

Auto-encoders are perhaps the best-known non-probabilistic methods for representation learning. They are conceptually simple and easy to train. Recent theoretical work has shed light on their ability to capture manifold structure, and drawn…

Machine Learning · Computer Science 2015-06-16 Daniel Jiwoong Im , Graham W. Taylor

It is a widely accepted fact that data representations intervene noticeably in machine learning tools. The more they are well defined the better the performance results are. Feature extraction-based methods such as autoencoders are…

Neural and Evolutionary Computing · Computer Science 2018-06-12 Naima Chouikhi , Boudour Ammar , Adel M. Alimi

An algorithm is described that adaptively learns a non-linear mutation distribution. It works by training a denoising autoencoder (DA) online at each generation of a genetic algorithm to reconstruct a slowly decaying memory of the best…

Neural and Evolutionary Computing · Computer Science 2014-04-08 Alexander W. Churchill , Siddharth Sigtia , Chrisantha Fernando

Machine learning methods often need a large amount of labeled training data. Since the training data is assumed to be the ground truth, outliers can severely degrade learned representations and performance of trained models. Here we apply…

Machine Learning · Statistics 2019-12-24 Haleh Akrami , Anand A. Joshi , Jian Li , Sergul Aydore , Richard M. Leahy

We introduce an improved variational autoencoder (VAE) for text modeling with topic information explicitly modeled as a Dirichlet latent variable. By providing the proposed model topic awareness, it is more superior at reconstructing input…

Computation and Language · Computer Science 2018-11-02 Yijun Xiao , Tiancheng Zhao , William Yang Wang

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

This paper addresses the challenges of detecting anomalies in cellular networks in an interpretable way and proposes a new approach using variational autoencoders (VAEs) that learn interpretable representations of the latent space for each…

Machine Learning · Computer Science 2023-06-29 Amandeep Singh , Michael Weber , Markus Lange-Hegermann

Variational Autoencoder (VAE) is a powerful method for learning representations of high-dimensional data. However, VAEs can suffer from an issue known as latent variable collapse (or KL loss vanishing), where the posterior collapses to the…

Computation and Language · Computer Science 2019-11-14 Ruizhe Li , Xiao Li , Chenghua Lin , Matthew Collinson , Rui Mao

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chen Zhang , Riccardo Barbano , Bangti Jin

Conditional inference on arbitrary subsets of variables is a core problem in probabilistic inference with important applications such as masked language modeling and image inpainting. In recent years, the family of Any-Order Autoregressive…

Machine Learning · Computer Science 2022-10-25 Andy Shih , Dorsa Sadigh , Stefano Ermon