English
Related papers

Related papers: DA-VAE: Plug-in Latent Compression for Diffusion v…

200 papers

Data augmentation effectively addresses the imbalanced-small sample data (ISSD) problem in hyperspectral image classification (HSIC). While most methodologies extend features in the latent space, few leverage text-driven generation to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yimin Zhu , Lincoln Linlin Xu

Generative models serve as powerful tools for modeling the real world, with mainstream diffusion models, particularly those based on the latent diffusion model paradigm, achieving remarkable progress across various tasks, such as image and…

Machine Learning · Computer Science 2025-02-04 Wanghan Xu , Xiaoyu Yue , Zidong Wang , Yao Teng , Wenlong Zhang , Xihui Liu , Luping Zhou , Wanli Ouyang , Lei Bai

Learning a robust video Variational Autoencoder (VAE) is essential for reducing video redundancy and facilitating efficient video generation. Directly applying image VAEs to individual frames in isolation can result in temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yazhou Xing , Yang Fei , Yingqing He , Jingye Chen , Jiaxin Xie , Xiaowei Chi , Qifeng Chen

Deep learning (DL) methods where interpretability is intrinsically considered as part of the model are required to better understand the relationship of clinical and imaging-based attributes with DL outcomes, thus facilitating their use in…

Image and Video Processing · Electrical Eng. & Systems 2022-12-13 Irem Cetin , Maialen Stephens , Oscar Camara , Miguel Angel Gonzalez Ballester

The variational autoencoder (VAE) is a popular, deep, latent-variable model (DLVM) due to its simple yet effective formulation for modeling the data distribution. Moreover, optimizing the VAE objective function is more manageable than other…

Machine Learning · Computer Science 2025-01-28 Surojit Saha , Sarang Joshi , Ross Whitaker

Diffusion models have become the dominant paradigm for image generation and editing, with latent diffusion models shifting denoising to a compact latent space for efficiency and scalability. Recent attempts to leverage pretrained visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yue Gong , Hongyu Li , Shanyuan Liu , Bo Cheng , Yuhang Ma , Liebucha Wu , Xiaoyu Wu , Manyuan Zhang , Dawei Leng , Yuhui Yin , Lijun Zhang

Conventional class-guided diffusion models generally succeed in generating images with correct semantic content, but often struggle with texture details. This limitation stems from the usage of class priors, which only provide coarse and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Xiaoyu Yue , Zidong Wang , Zeyu Lu , Shuyang Sun , Meng Wei , Wanli Ouyang , Lei Bai , Luping Zhou

Variational Autoencoders (VAEs) have played a key role in scaling up diffusion-based generative models, as in Stable Diffusion, yet questions regarding their robustness remain largely underexplored. Although adversarial training has been an…

Machine Learning · Computer Science 2025-04-25 Hyomin Lee , Minseon Kim , Sangwon Jang , Jongheon Jeong , Sung Ju Hwang

Recent research has shown a strong theoretical connection between variational autoencoders (VAEs) and the rate-distortion theory. Motivated by this, we consider the problem of lossy image compression from the perspective of generative…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Zhihao Duan , Ming Lu , Zhan Ma , Fengqing Zhu

The Diffusion Transformer (DiT) architecture is the state-of-the-art paradigm for high-fidelity image generation, underpinning models like Stable Diffusion-3 and FLUX.1. However, deploying these models on resource-constrained mobile devices…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Kunpeng Du , Haizhen Xie , Sen Lu , Lei Yu , Binglei Bao , Huaao Tang , Chuntao Liu , Hao Wu , Yang Zhao , Zhicai Huang , Heyuan Gao , Zhijun Tu , Jie Hu , Xinghao Chen

Recent progress in diffusion-based visual generation has largely relied on latent diffusion models with variational autoencoders (VAEs). While effective for high-fidelity synthesis, this VAE+diffusion paradigm suffers from limited training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Minglei Shi , Haolin Wang , Wenzhao Zheng , Ziyang Yuan , Xiaoshi Wu , Xintao Wang , Pengfei Wan , Jie Zhou , Jiwen Lu

Recently most successful image synthesis models are multi stage process to combine the advantages of different methods, which always includes a VAE-like model for faithfully reconstructing embedding to image and a prior model to generate…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Jie Shi , Chenfei Wu , Jian Liang , Xiang Liu , Nan Duan

We consider the problem of lossy image compression with deep latent variable models. State-of-the-art methods build on hierarchical variational autoencoders (VAEs) and learn inference networks to predict a compressible latent representation…

Image and Video Processing · Electrical Eng. & Systems 2021-01-11 Yibo Yang , Robert Bamler , Stephan Mandt

Vector Quantized-Variational AutoEncoders (VQ-VAE) are generative models based on discrete latent representations of the data, where inputs are mapped to a finite set of learned embeddings.To generate new samples, an autoregressive prior…

Machine Learning · Statistics 2022-08-04 Max Cohen , Guillaume Quispe , Sylvain Le Corff , Charles Ollion , Eric Moulines

Existing methods for restoring degraded human-centric images often struggle with insufficient fidelity, particularly in human body restoration (HBR). Recent diffusion-based restoration methods commonly adapt pre-trained text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jue Gong , Zihan Zhou , Jingkai Wang , Shu Li , Libo Liu , Jianliang Lan , Yulun Zhang

Diffusion models have attained remarkable breakthroughs in the real-world super-resolution (SR) task, albeit at slow inference and high demand on devices. To accelerate inference, recent works like GenDR adopt step distillation to minimize…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yan Wang , Shijie Zhao , Junlin Li , Li Zhang

Latent generative models have shown remarkable progress in high-fidelity image synthesis, typically using a two-stage training process that involves compressing images into latent embeddings via learned tokenizers in the first stage. The…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Tejaswini Medi , Hsien-Yi Wang , Arianna Rampini , Margret Keuper

Design space exploration (DSE) is critical for developing optimized hardware architectures, especially for AI workloads such as deep neural networks (DNNs) and large language models (LLMs), which require specialized acceleration. As model…

Hardware Architecture · Computer Science 2025-08-15 Arkapravo Ghosh , Abhishek Moitra , Abhiroop Bhattacharjee , Ruokai Yin , Priyadarshini Panda

In recent years, applying Deep Learning (DL) techniques emerged as a common practice in the communication system, demonstrating promising results. The present paper proposes a new Convolutional Neural Network (CNN) based Variational…

Signal Processing · Electrical Eng. & Systems 2020-05-20 Raghu Vamshi Hemadri , Akshay Rayaluru , Rahul Jashvantbhai Pandya

Normalizing flows, autoregressive models, variational autoencoders (VAEs), and deep energy-based models are among competing likelihood-based frameworks for deep generative learning. Among them, VAEs have the advantage of fast and tractable…

Machine Learning · Statistics 2021-01-11 Arash Vahdat , Jan Kautz
‹ Prev 1 3 4 5 6 7 10 Next ›