English
Related papers

Related papers: A Tutorial on VAEs: From Bayes' Rule to Lossless C…

200 papers

We introduce an approach for training Variational Autoencoders (VAEs) that are certifiably robust to adversarial attack. Specifically, we first derive actionable bounds on the minimal size of an input perturbation required to change a VAE's…

Machine Learning · Statistics 2022-04-26 Ben Barrett , Alexander Camuto , Matthew Willetts , Tom Rainforth

Selective manipulation of data attributes using deep generative models is an active area of research. In this paper, we present a novel method to structure the latent space of a Variational Auto-Encoder (VAE) to encode different…

Machine Learning · Computer Science 2020-07-30 Ashis Pati , Alexander Lerch

Since their inception, Variational Autoencoders (VAEs) have become central in machine learning. Despite their widespread use, numerous questions regarding their theoretical properties remain open. Using PAC-Bayesian theory, this work…

Machine Learning · Computer Science 2023-12-11 Sokhna Diarra Mbacke , Florence Clerc , Pascal Germain

A new approach for blind channel equalization and decoding, variational inference, and variational autoencoders (VAEs) in particular, is introduced. We first consider the reconstruction of uncoded data symbols transmitted over a noisy…

Machine Learning · Computer Science 2020-04-14 Avi Caciularu , David Burshtein

There are many problems in physics, biology, and other natural sciences in which symbolic regression can provide valuable insights and discover new laws of nature. A widespread Deep Neural Networks do not provide interpretable solutions.…

Machine Learning · Computer Science 2023-01-18 Sergei Popov , Mikhail Lazarev , Vladislav Belavin , Denis Derkach , Andrey Ustyuzhanin

In this study, an image-assisted Approximate Bayesian Computation (ABC) parameter inverse method is proposed to identify the design parameters. In the proposed method, the images are mapped to a low-dimensional latent space by Variational…

Image and Video Processing · Electrical Eng. & Systems 2019-07-09 Jiaquan Wang , Yang Zeng , Xinchao Jiang , Hu Wang , Enying Li , Guangyao Li

Variational Autoencoder (VAE), compressing videos into latent representations, is a crucial preceding component of Latent Video Diffusion Models (LVDMs). With the same reconstruction quality, the more sufficient the VAE's compression for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Liuhan Chen , Zongjian Li , Bin Lin , Bin Zhu , Qian Wang , Shenghai Yuan , Xing Zhou , Xinhua Cheng , Li Yuan

Inverse problems often involve matching observational data using a physical model that takes a large number of parameters as input. These problems tend to be under-constrained and require regularization to impose additional structure on the…

Computational Physics · Physics 2019-06-07 Daniel O'Malley , John K. Golden , Velimir V. Vesselinov

Detectors in next-generation high-energy physics experiments face several daunting requirements, such as high data rates, damaging radiation exposure, and stringent constraints on power, space, and latency. To address these challenges,…

Data Analysis, Statistics and Probability · Physics 2025-08-18 Alexander Yue , Haoyi Jia , Julia Gonski

The Variational Autoencoder (VAE) is a seminal approach in deep generative modeling with latent variables. Interpreting its reconstruction process as a nonlinear transformation of samples from the latent posterior distribution, we apply the…

Machine Learning · Computer Science 2023-06-09 Faris Janjoš , Lars Rosenbaum , Maxim Dolgov , J. Marius Zöllner

This paper proposes a non-parallel many-to-many voice conversion (VC) method using a variant of the conditional variational autoencoder (VAE) called an auxiliary classifier VAE (ACVAE). The proposed method has three key features. First, it…

Machine Learning · Statistics 2020-10-13 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Nobukatsu Hojo

Recent research has shown a strong theoretical connection between variational autoencoders (VAEs) and the rate-distortion theory. Motivated by this, we consider the problem of lossy image compression from the perspective of generative…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Zhihao Duan , Ming Lu , Zhan Ma , Fengqing Zhu

Compression is at the heart of effective representation learning. However, lossy compression is typically achieved through simple parametric models like Gaussian noise to preserve analytic tractability, and the limitations this imposes on…

Machine Learning · Computer Science 2019-11-15 Rob Brekelmans , Daniel Moyer , Aram Galstyan , Greg Ver Steeg

Discrete latent variables are considered important for real world data, which has motivated research on Variational Autoencoders (VAEs) with discrete latents. However, standard VAE training is not possible in this case, which has motivated…

Machine Learning · Statistics 2023-03-27 Enrico Guiraud , Jakob Drefs , Jörg Lücke

Constructing a compressed latent space through a variational autoencoder (VAE) is the key for efficient 3D diffusion models. This paper introduces COD-VAE that encodes 3D shapes into a COmpact set of 1D latent vectors without sacrificing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 In Cho , Youngbeom Yoo , Subin Jeon , Seon Joo Kim

Despite the empirical success of Diffusion Models (DMs) and Variational Autoencoders (VAEs), their generalization performance remains theoretically underexplored, especially lacking a full consideration of the shared encoder-generator…

Machine Learning · Computer Science 2025-06-03 Qi Chen , Jierui Zhu , Florian Shkurti

In this paper, an unsupervised deep learning framework based on dual-path model-driven variational auto-encoders (VAE) is proposed for angle-of-arrivals (AoAs) and channel estimation in massive MIMO systems. Specifically designed for…

Signal Processing · Electrical Eng. & Systems 2023-05-31 Zhiheng Guo , Yuanzhang Xiao , Xiang Chen

We would like to learn a representation of the data which decomposes an observation into factors of variation which we can independently control. Specifically, we want to use minimal supervision to learn a latent representation that…

Machine Learning · Computer Science 2017-05-25 Diane Bouchacourt , Ryota Tomioka , Sebastian Nowozin

Recent work has shown that Variational Autoencoders (VAEs) can be used to upper-bound the information rate-distortion (R-D) function of images, i.e., the fundamental limit of lossy image compression. In this paper, we report an improved…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Zhihao Duan , Jack Ma , Jiangpeng He , Fengqing Zhu

A fully disentangled variational auto-encoder (VAE) aims to identify disentangled latent components from observations. However, enforcing full independence between all latent components may be too strict for certain datasets. In some cases,…

Machine Learning · Computer Science 2025-02-05 Chengrui Li , Yunmiao Wang , Yule Wang , Weihan Li , Dieter Jaeger , Anqi Wu