中文
相关论文

相关论文: Improved Video VAE for Latent Video Diffusion Mode…

200 篇论文

Variational Autoencoders and Generative Adversarial Networks remained the state-of-the-art (SOTA) generative models until 2022. Now they are superseded by diffusion-based models. Efforts to improve traditional models have stagnated as a…

机器学习 · 计算机科学 2026-03-10 Tuhin Subhra De

In this paper, we propose the Dynamic Latent Frame Rate VAE (DLFR-VAE), a training-free paradigm that can make use of adaptive temporal compression in latent space. While existing video generative models apply fixed compression rates via…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Zhihang Yuan , Siyuan Wang , Rui Xie , Hanling Zhang , Tongcheng Fang , Yuzhang Shang , Shengen Yan , Guohao Dai , Yu Wang

Variational autoencoders (VAEs) are a powerful class of deep generative latent variable model for unsupervised representation learning on high-dimensional data. To ensure computational tractability, VAEs are often implemented with a…

机器学习 · 计算机科学 2020-06-09 Alex Campbell , Pietro Liò

In end-to-end optimized learned image compression, it is standard practice to use a convolutional variational autoencoder with generalized divisive normalization (GDN) to transform images into a latent space. Recently, Operational Neural…

图像与视频处理 · 电气工程与系统科学 2021-05-31 M. Akın Yılmaz , Onur Keleş , Hilal Güven , A. Murat Tekalp , Junaid Malik , Serkan Kıranyaz

Variational Autoencoders (VAE) are probabilistic deep generative models underpinned by elegant theory, stable training processes, and meaningful manifold representations. However, they produce blurry images due to a lack of explicit…

计算机视觉与模式识别 · 计算机科学 2019-11-15 Prashnna K Gyawali , Rudra Saha , Linwei Wang , VSR Veeravasarapu , Maneesh Singh

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

计算机视觉与模式识别 · 计算机科学 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

机器学习 · 计算机科学 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

We present Qwen-Image-VAE-2.0, a suite of high-compression Variational Autoencoders (VAEs) that achieve significant advances in both reconstruction fidelity and diffusability. To address the reconstruction bottlenecks of high compression,…

Recent research has shown a strong theoretical connection between variational autoencoders (VAEs) and the rate-distortion theory. Motivated by this, we consider the problem of lossy image compression from the perspective of generative…

图像与视频处理 · 电气工程与系统科学 2023-03-28 Zhihao Duan , Ming Lu , Zhan Ma , Fengqing Zhu

Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton variational distributions and fail to account for the…

机器学习 · 计算机科学 2020-04-20 Da Tang , Dawen Liang , Tony Jebara , Nicholas Ruozzi

Variational auto-encoder (VAE) is a powerful unsupervised learning framework for image generation. One drawback of VAE is that it generates blurry images due to its Gaussianity assumption and thus L2 loss. To allow the generation of high…

计算机视觉与模式识别 · 计算机科学 2017-05-23 Lei Cai , Hongyang Gao , Shuiwang Ji

Recent video generation models largely rely on video autoencoders that compress pixel-space videos into latent representations. However, existing video autoencoders suffer from three major limitations: (1) fixed-rate compression that wastes…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Yao Teng , Minxuan Lin , Xian Liu , Shuai Wang , Xiao Yang , Xihui Liu

Reducing token count is crucial for efficient training and inference of latent diffusion models, especially at high resolution. A common strategy is to build high-compression image tokenizers with more channels per token. However, when…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Xin Cai , Zhiyuan You , Zhoutong Zhang , Tianfan Xue

The exponential growth of video traffic has placed increasing demands on bandwidth and storage infrastructure, particularly for content delivery networks (CDNs) and edge devices. While traditional video codecs like H.264 and HEVC achieve…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Manikanta Kotthapalli , Banafsheh Rekabdar

Variational Autoencoders (VAEs) are powerful generative models capable of learning compact latent representations. However, conventional VAEs often generate relatively blurry images due to their assumption of an isotropic Gaussian latent…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Andrew Kiruluta

VAEs, or variational autoencoders, are autoencoders that explicitly learn the distribution of the input image space rather than assuming no prior information about the distribution. This allows it to classify similar samples close to each…

机器学习 · 计算机科学 2023-02-08 Fareed Sheriff , Sameer Pai

VAEs (Variational AutoEncoders) have proved to be powerful in the context of density modeling and have been used in a variety of contexts for creative purposes. In many settings, the data we model possesses continuous attributes that we…

机器学习 · 计算机科学 2017-07-18 Gaëtan Hadjeres , Frank Nielsen , François Pachet

Advances in latent diffusion models (LDMs) have revolutionized high-resolution image generation, but the design space of the autoencoder that is central to these systems remains underexplored. In this paper, we introduce LiteVAE, a new…

机器学习 · 计算机科学 2025-01-22 Seyedmorteza Sadat , Jakob Buhmann , Derek Bradley , Otmar Hilliges , Romann M. Weber

Cross-modal retrieval is to utilize one modality as a query to retrieve data from another modality, which has become a popular topic in information retrieval, machine learning, and database. How to effectively measure the similarity between…

信息检索 · 计算机科学 2021-12-07 Jiwei Zhang , Yi Yu , Suhua Tang , Jianming Wu , Wei Li

Variational autoencoder (VAE) is one of the most common techniques in the field of medical image generation, where this architecture has shown advanced researchers in recent years and has developed into various architectures. VAE has…

机器学习 · 计算机科学 2024-11-13 Khadija Rais , Mohamed Amroune , Abdelmadjid Benmachiche , Mohamed Yassine Haouam