English
Related papers

Related papers: REPA-E: Unlocking VAE for End-to-End Tuning with L…

200 papers

We present two deep generative models based on Variational Autoencoders to improve the accuracy of drug response prediction. Our models, Perturbation Variational Autoencoder and its semi-supervised extension, Drug Response Variational…

Machine Learning · Statistics 2017-07-07 Ladislav Rampasek , Daniel Hidru , Petr Smirnov , Benjamin Haibe-Kains , Anna Goldenberg

Learning a disentangled, interpretable, and structured latent representation in 3D generative models of faces and bodies is still an open problem. The problem is particularly acute when control over identity features is required. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Simone Foti , Bongjin Koo , Danail Stoyanov , Matthew J. Clarkson

State-of-the-art Variational Auto-Encoders (VAEs) for learning disentangled latent representations give impressive results in discovering features like pitch, pause duration, and accent in speech data, leading to highly controllable…

Sound · Computer Science 2021-05-11 Shakti Kumar , Jithin Pradeep , Hussain Zaidi

Variational autoencoders (VAEs) are powerful generative models with the salient ability to perform inference. Here, we introduce a quantum variational autoencoder (QVAE): a VAE whose latent generative process is implemented as a quantum…

One major challenge of disentanglement learning with variational autoencoders is the trade-off between disentanglement and reconstruction fidelity. Previous studies, which increase the information bottleneck during training, tend to lose…

Machine Learning · Computer Science 2023-10-05 Jiantao Wu , Shentong Mo , Xiang Yang , Muhammad Awais , Sara Atito , Xingshen Zhang , Lin Wang , Xiang Yang

Variational autoencoders (VAEs) are used for transfer learning across various research domains such as music generation or medical image analysis. However, there is no principled way to assess before transfer which components to retrain or…

Machine Learning · Computer Science 2023-04-24 Lisa Bonheme , Marek Grzes

Variational autoencoders are among the most popular methods for distilling low-dimensional structure from high-dimensional data, making them increasingly valuable as tools for data exploration and scientific discovery. However, unlike…

Machine Learning · Computer Science 2022-01-17 Miles Martinez , John Pearson

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the…

Machine Learning · Computer Science 2019-04-25 Jason Chou

Diffusion models have emerged as powerful generative tools across various domains, yet tailoring pre-trained models to exhibit specific desirable properties remains challenging. While reinforcement learning (RL) offers a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Fengyuan Dai , Zifeng Zhuang , Yufei Huang , Siteng Huang , Bangyan Liao , Donglin Wang , Fajie Yuan

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

Machine Learning · Computer Science 2022-11-16 Rafael Pastrana

The variational autoencoder (VAE) is a simple and efficient generative artificial intelligence method for modeling complex probability distributions of various types of data, such as images and texts. However, it suffers some main…

Machine Learning · Computer Science 2025-02-14 Xi Chen , Shaofan Li

Deep generative models applied to audio have improved by a large margin the state-of-the-art in many speech and music related tasks. However, as raw waveform modelling remains an inherently difficult task, audio generative models are either…

Machine Learning · Computer Science 2021-12-16 Antoine Caillon , Philippe Esling

This paper presents a simulator-assisted training method (SimVAE) for variational autoencoders (VAE) that leads to a disentangled and interpretable latent space. Training SimVAE is a two-step process in which first a deep generator…

Machine Learning · Statistics 2019-11-20 Akash Srivastava , Jessie Rosenberg , Dan Gutfreund , David D. Cox

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

Machine Learning · Computer Science 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative…

Recent Mixture-of-Experts (MoE)-based large language models (LLMs) such as Qwen-MoE and DeepSeek-MoE are transforming generative AI in natural language processing. However, these models require vast and diverse training data. Federated…

Machine Learning · Computer Science 2026-02-17 Songyuan Li , Jia Hu , Ahmed M. Abdelmoniem , Geyong Min , Haojun Huang , Jiwei Huang

Leveraging powerful deep learning techniques, the end-to-end (E2E) learning of communication system is able to outperform the classical communication system. Unfortunately, this communication system cannot be trained by deep learning…

Information Theory · Computer Science 2022-04-04 Hao Jiang , Shuangkaisheng Bi , Linglong Dai , Hao Wang , Jiankun Zhang

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiyuan Wang , Muhan Zhang

Generative modeling aims to generate new data samples that resemble a given dataset, with diffusion models recently becoming the most popular generative model. One of the main challenges of diffusion models is solving the problem in the…

Numerical Analysis · Mathematics 2025-10-08 Wonjun Lee , Riley C. W. O'Neill , Dongmian Zou , Jeff Calder , Gilad Lerman

Unlearnable examples (UEs) seek to maximize testing error by making subtle modifications to training examples that are correctly labeled. Defenses against these poisoning attacks can be categorized based on whether specific interventions…

Cryptography and Security · Computer Science 2024-05-07 Yi Yu , Yufei Wang , Song Xia , Wenhan Yang , Shijian Lu , Yap-Peng Tan , Alex C. Kot