中文
相关论文

相关论文: Improved Video VAE for Latent Video Diffusion Mode…

200 篇论文

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a…

计算机视觉与模式识别 · 计算机科学 2018-04-30 Salman H. Khan , Munawar Hayat , Nick Barnes

Recent progress in diffusion-based visual generation has largely relied on latent diffusion models with variational autoencoders (VAEs). While effective for high-fidelity synthesis, this VAE+diffusion paradigm suffers from limited training…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Minglei Shi , Haolin Wang , Wenzhao Zheng , Ziyang Yuan , Xiaoshi Wu , Xintao Wang , Pengfei Wan , Jie Zhou , Jiwen Lu

The integrative analysis of histopathological images and genomic data has received increasing attention for survival prediction of human cancers. However, the existing studies always hold the assumption that full modalities are available.…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Junjie Zhou , Jiao Tang , Yingli Zuo , Peng Wan , Daoqiang Zhang , Wei Shao

Variational Autoencoder (VAE) is a powerful method for learning representations of high-dimensional data. However, VAEs can suffer from an issue known as latent variable collapse (or KL loss vanishing), where the posterior collapses to the…

计算与语言 · 计算机科学 2019-11-14 Ruizhe Li , Xiao Li , Chenghua Lin , Matthew Collinson , Rui Mao

Recent advances in deep learning have shown their ability to learn strong feature representations for images. The task of image clustering naturally requires good feature representations to capture the distribution of the data and…

计算机视觉与模式识别 · 计算机科学 2020-05-12 Vignesh Prasad , Dipanjan Das , Brojeshwar Bhowmick

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

机器学习 · 计算机科学 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

Latent diffusion models have emerged as the dominant paradigm for many generation tasks including audio generation such as text-to-audio, text-to-music and text-to-speech. A key component of latent diffusion is an autoencoder (VAE) that…

声音 · 计算机科学 2026-05-19 Prem Seetharaman , Rithesh Kumar

Variational autoencoders (VAEs) are powerful deep generative models widely used to represent high-dimensional complex data through a low-dimensional latent space learned in an unsupervised manner. In the original VAE model, the input data…

机器学习 · 计算机科学 2022-07-05 Laurent Girin , Simon Leglaive , Xiaoyu Bie , Julien Diard , Thomas Hueber , Xavier Alameda-Pineda

Latent Diffusion Models (LDMs) rely heavily on the compressed latent space provided by Variational Autoencoders (VAEs) for high-quality image generation. Recent studies have attempted to obtain generation-friendly VAEs by directly adopting…

计算机视觉与模式识别 · 计算机科学 2026-03-17 John Page , Xuesong Niu , Kai Wu , Kun Gai

Efficient image tokenization with high compression ratios remains a critical challenge for training generative models. We present SoftVQ-VAE, a continuous image tokenizer that leverages soft categorical posteriors to aggregate multiple…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Hao Chen , Ze Wang , Xiang Li , Ximeng Sun , Fangyi Chen , Jiang Liu , Jindong Wang , Bhiksha Raj , Zicheng Liu , Emad Barsoum

The Variational Autoencoder (VAE) is a seminal approach in deep generative modeling with latent variables. Interpreting its reconstruction process as a nonlinear transformation of samples from the latent posterior distribution, we apply the…

机器学习 · 计算机科学 2023-06-09 Faris Janjoš , Lars Rosenbaum , Maxim Dolgov , J. Marius Zöllner

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Controllable data generation aims to synthesize data by specifying values for target concepts. Achieving this reliably requires modeling the underlying generative factors and their relationships. In real-world scenarios, these factors…

机器学习 · 计算机科学 2025-11-21 Qilong Zhao , Shiyu Wang , Zeeshan Memon , Yang Qiao , Guangji Bai , Bo Pan , Zhaohui Qin , Liang Zhao

Being one of the most popular generative framework, variational autoencoders(VAE) are known to suffer from a phenomenon termed posterior collapse, i.e. the latent variational distributions collapse to the prior, especially when a strong…

机器学习 · 计算机科学 2021-03-23 Renfei Tu , Yang Liu , Yongzeng Xue , Cheng Wang , Maozu Guo

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder.…

机器学习 · 统计学 2017-07-12 Gautam Ramachandra

Estimating causal effects from observational data is challenging, especially in the presence of latent confounders. Much work has been done on addressing this challenge, but most of the existing research ignores the bias introduced by the…

机器学习 · 计算机科学 2024-08-15 Yang Xie , Ziqi Xu , Debo Cheng , Jiuyong Li , Lin Liu , Yinghao Zhang , Zaiwen Feng

Is there really much more to say about sparse autoencoders (SAEs)? Autoencoders in general, and SAEs in particular, represent deep architectures that are capable of modeling low-dimensional latent structure in data. Such structure could…

机器学习 · 计算机科学 2025-06-09 Yin Lu , Xuening Zhu , Tong He , David Wipf

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

机器学习 · 统计学 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

As big spatial data becomes increasingly prevalent, classical spatiotemporal (ST) methods often do not scale well. While methods have been developed to account for high-dimensional spatial objects, the setting where there are exceedingly…

应用统计 · 统计学 2019-08-27 Samuel I. Berchuck , Felipe A. Medeiros , Sayan Mukherjee

Variational autoencoder (VAE) neural networks can be trained to generate power system states that capture both marginal distribution and multivariate dependencies of historical data. The coordinates of the latent space codes of VAEs have…

系统与控制 · 电气工程与系统科学 2023-03-22 Chenguang Wang , Ensieh Sharifnia , Simon H. Tindemans , Peter Palensky