English
Related papers

Related papers: Probabilistic Autoencoder using Fisher Information

200 papers

The variational autoencoder (VAE) is a simple and efficient generative artificial intelligence method for modeling complex probability distributions of various types of data, such as images and texts. However, it suffers some main…

Machine Learning · Computer Science 2025-02-14 Xi Chen , Shaofan Li

In this tutorial, we explore Variational Autoencoders (VAEs), an essential framework for unsupervised learning, particularly suited for high-dimensional datasets such as neuroimaging. By integrating deep learning with Bayesian inference,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-15 C. Vázquez-García , F. J. Martínez-Murcia , F. Segovia Román , Juan M. Górriz Sáez

Variational Autoencoders (VAEs) have been a pioneering force in the realm of deep generative models. Amongst its legions of progenies, Wasserstein Autoencoders (WAEs) stand out in particular due to the dual offering of heightened generative…

Machine Learning · Statistics 2023-12-12 Anish Chakrabarty , Arkaprabha Basu , Swagatam Das

In this work we study Variational Autoencoders (VAEs) from the perspective of harmonic analysis. By viewing a VAE's latent space as a Gaussian Space, a variety of measure space, we derive a series of results that show that the encoder…

Machine Learning · Statistics 2022-04-26 Alexander Camuto , Matthew Willetts

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

The combination of machine learning models with physical models is a recent research path to learn robust data representations. In this paper, we introduce p$^3$VAE, a variational autoencoder that integrates prior physical knowledge about…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Romain Thoreau , Laurent Risser , Véronique Achard , Béatrice Berthelot , Xavier Briottet

While unsupervised variational autoencoders (VAE) have become a powerful tool in neuroimage analysis, their application to supervised learning is under-explored. We aim to close this gap by proposing a unified probabilistic model for…

Machine Learning · Computer Science 2019-07-15 Qingyu Zhao , Ehsan Adeli , Nicolas Honnorat , Tuo Leng , Kilian M. Pohl

Understanding the latent spaces learned by deep learning models is crucial in exploring how they represent and generate complex data. Autoencoders (AEs) have played a key role in the area of representation learning, with numerous…

Machine Learning · Computer Science 2025-01-17 Anika Shrivastava , Renu Rameshan , Samar Agnihotri

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

An autoencoder is a neural network which data projects to and from a lower dimensional latent space, where this data is easier to understand and model. The autoencoder consists of two sub-networks, the encoder and the decoder, which carry…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Saïd Ladjal , Alasdair Newson , Chi-Hieu Pham

Detectors in next-generation high-energy physics experiments face several daunting requirements, such as high data rates, damaging radiation exposure, and stringent constraints on power, space, and latency. To address these challenges,…

Data Analysis, Statistics and Probability · Physics 2025-08-18 Alexander Yue , Haoyi Jia , Julia Gonski

Variational Auto-Encoder (VAE) has been widely applied as a fundamental generative model in machine learning. For complex samples like imagery objects or scenes, however, VAE suffers from the dimensional dilemma between reconstruction…

Machine Learning · Computer Science 2020-02-18 Deli Zhao , Jiapeng Zhu , Bo Zhang

Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional…

Machine Learning · Computer Science 2021-03-02 A. Asperti , D. Evangelista , E. Loli Piccolomini

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

While enormous progress has been made to Variational Autoencoder (VAE) in recent years, similar to other deep networks, VAE with deep networks suffers from the problem of degeneration, which seriously weakens the correlation between the…

Machine Learning · Statistics 2018-09-26 Huangjie Zheng , Jiangchao Yao , Ya Zhang , Ivor W. Tsang

Variational autoencoders (VAEs) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their…

Machine Learning · Computer Science 2024-12-10 Hadi Vafaii , Dekel Galor , Jacob L. Yates

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

Machine Learning · Statistics 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

In this paper we propose Structuring AutoEncoders (SAE). SAEs are neural networks which learn a low dimensional representation of data which are additionally enriched with a desired structure in this low dimensional space. While traditional…

Machine Learning · Computer Science 2019-08-20 Marco Rudolph , Bastian Wandt , Bodo Rosenhahn

Variational auto-encoders (VAEs) have proven to be a well suited tool for performing dimensionality reduction by extracting latent variables lying in a potentially much smaller dimensional space than the data. Their ability to capture…

Machine Learning · Statistics 2020-10-23 Clément Chadebec , Clément Mantoux , Stéphanie Allassonnière

Discrete latent bottlenecks in variational autoencoders (VAEs) offer high bit efficiency and can be modeled with autoregressive discrete distributions, enabling parameter-efficient multimodal search with transformers. However, discrete…

Machine Learning · Computer Science 2026-02-12 Michael Drolet , Firas Al-Hafez , Aditya Bhatt , Jan Peters , Oleg Arenz