English
Related papers

Related papers: Structural Equation-VAE: Disentangled Latent Repre…

200 papers

Variational Auto-Encoder (VAE) has been widely applied as a fundamental generative model in machine learning. For complex samples like imagery objects or scenes, however, VAE suffers from the dimensional dilemma between reconstruction…

Machine Learning · Computer Science 2020-02-18 Deli Zhao , Jiapeng Zhu , Bo Zhang

Deep generative models have been enjoying success in modeling continuous data. However it remains challenging to capture the representations for discrete structures with formal grammars and semantics, e.g., computer programs and molecular…

Machine Learning · Computer Science 2018-02-27 Hanjun Dai , Yingtao Tian , Bo Dai , Steven Skiena , Le Song

Traditional transformer-based semantic segmentation relies on quantized embeddings. However, our analysis reveals that autoencoder accuracy on segmentation mask using quantized embeddings (e.g. VQ-VAE) is 8% lower than continuous-valued…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Masud Ahmed , Zahid Hasan , Syed Arefinul Haque , Abu Zaher Md Faridee , Sanjay Purushotham , Suya You , Nirmalya Roy

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

Machine Learning · Statistics 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

The variational auto-encoder (VAE) is a popular method for learning a generative model and embeddings of the data. Many real datasets are hierarchically structured. However, traditional VAEs map data in a Euclidean latent space which cannot…

Machine Learning · Statistics 2019-11-27 Emile Mathieu , Charline Le Lan , Chris J. Maddison , Ryota Tomioka , Yee Whye Teh

Visual data can be understood at different levels of granularity, where global features correspond to semantic-level information and local features correspond to texture patterns. In this work, we propose a framework, called SPLIT, which…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Rujikorn Charakorn , Yuttapong Thawornwattana , Sirawaj Itthipuripat , Nick Pawlowski , Poramate Manoonpong , Nat Dilokthanakul

Learning interpretable representations of data remains a central challenge in deep learning. When training a deep generative model, the observed data are often associated with certain categorical labels, and, in parallel with learning to…

Machine Learning · Computer Science 2019-10-01 Yifan Xue , Michael Ding , Xinghua Lu

Traditional Variational Autoencoders (VAEs) are constrained by the limitations of the Evidence Lower Bound (ELBO) formulation, particularly when utilizing simplistic, non-analytic, or unknown prior distributions. These limitations inhibit…

Machine Learning · Computer Science 2024-07-10 Fotios Lygerakis , Elmar Rueckert

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

Machine Learning · Computer Science 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

Machine Learning · Computer Science 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

Variational autoencoders are among the most popular methods for distilling low-dimensional structure from high-dimensional data, making them increasingly valuable as tools for data exploration and scientific discovery. However, unlike…

Machine Learning · Computer Science 2022-01-17 Miles Martinez , John Pearson

Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Dooseop Choi , KyoungWook Min

We propose DoE2Vec, a variational autoencoder (VAE)-based methodology to learn optimization landscape characteristics for downstream meta-learning tasks, e.g., automated selection of optimization algorithms. Principally, using large…

Optimization and Control · Mathematics 2023-04-05 Bas van Stein , Fu Xing Long , Moritz Frenzel , Peter Krause , Markus Gitterle , Thomas Bäck

Variational autoencoders are powerful algorithms for identifying dominant latent structure in a single dataset. In many applications, however, we are interested in modeling latent structure and variation that are enriched in a target…

Machine Learning · Computer Science 2019-02-14 Abubakar Abid , James Zou

VAEs, or variational autoencoders, are autoencoders that explicitly learn the distribution of the input image space rather than assuming no prior information about the distribution. This allows it to classify similar samples close to each…

Machine Learning · Computer Science 2023-02-08 Fareed Sheriff , Sameer Pai

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

Fair and unbiased machine learning is an important and active field of research, as decision processes are increasingly driven by models that learn from data. Unfortunately, any biases present in the data may be learned by the model,…

Machine Learning · Computer Science 2020-02-27 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

State-of-the-art generative image and video models rely heavily on tokenizers that compress high-dimensional inputs into more efficient latent representations. While this paradigm has revolutionized RGB generation, Earth observation (EO)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Nils Lehmann , Yi Wang , Zhitong Xiong , Xiaoxiang Zhu

Data-driven reduced-order models based on autoencoders generally lack interpretability compared to classical methods such as the proper orthogonal decomposition. More interpretability can be gained by disentangling the latent variables and…

Machine Learning · Computer Science 2025-02-21 Henning Schwarz , Pyei Phyo Lin , Jens-Peter M. Zemke , Thomas Rung

Explainable Artificial Intelligence (XAI) models have recently attracted a great deal of interest from a variety of application sectors. Despite significant developments in this area, there are still no standardized methods or approaches…

Machine Learning · Computer Science 2023-12-08 Sarit Maitra , Vivek Mishra , Pratima Verma , Manav Chopra , Priyanka Nath