English
Related papers

Related papers: ViT-DAE: Transformer-driven Diffusion Autoencoder …

200 papers

Generative learning models in medical research are crucial in developing training data for deep learning models and advancing diagnostic tools, but the problem of high-quality, diverse images is an open topic of research. Quantum-enhanced…

Quantum Physics · Physics 2025-08-14 Kübra Yeter-Aydeniz , Nora M. Bauer , Pranay Jain , Max Masnick

Diffusion Transformers (DiTs) are a powerful yet underexplored class of generative models compared to U-Net-based diffusion architectures. We propose TIDE-Temporal-aware sparse autoencoders for Interpretable Diffusion transformErs-a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Victor Shea-Jay Huang , Le Zhuo , Yi Xin , Zhaokai Wang , Fu-Yun Wang , Yuchi Wang , Renrui Zhang , Peng Gao , Hongsheng Li

Existing video tokenizers typically use the traditional Variational Autoencoder (VAE) architecture for video compression and reconstruction. However, to achieve good performance, its training process often relies on complex multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Nianzu Yang , Pandeng Li , Liming Zhao , Yang Li , Chen-Wei Xie , Yehui Tang , Xudong Lu , Zhihang Liu , Yun Zheng , Yu Liu , Junchi Yan

The rapid growth of digital pathology in recent years has provided an ideal opportunity for the development of artificial intelligence-based tools to improve the accuracy and efficiency of clinical diagnoses. One of the significant…

Image and Video Processing · Electrical Eng. & Systems 2024-03-08 Jack Breen , Kieran Zucker , Katie Allen , Nishant Ravikumar , Nicolas M. Orsi

Artificial Intelligence in healthcare is a new and exciting frontier and the possibilities are endless. With deep learning approaches beating human performances in many areas, the logical next step is to attempt their application in the…

Machine Learning · Computer Science 2018-08-21 Ally Salim

Latent diffusion models with Transformer architectures excel at generating high-fidelity images. However, recent studies reveal an optimization dilemma in this two-stage design: while increasing the per-token feature dimension in visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jingfeng Yao , Bin Yang , Xinggang Wang

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

Machine Learning · Computer Science 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

Autoencoder (AE) is the key to the success of latent diffusion models for image and video generation, reducing the denoising resolution and improving efficiency. However, the power of AE has long been underexplored in terms of network…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yushu Wu , Yanyu Li , Ivan Skorokhodov , Anil Kag , Willi Menapace , Sharath Girish , Aliaksandr Siarohin , Yanzhi Wang , Sergey Tulyakov

Vision Transformers (ViTs) outperforms convolutional neural networks (CNNs) in several vision tasks with its global modeling capabilities. However, ViT lacks the inductive bias inherent to convolution making it require a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Jiawei Mao , Honggu Zhou , Xuesong Yin , Yuanqi Chang. Binling Nie. Rui Xu

Counterfactual explanations (CEs) aim to enhance the interpretability of machine learning models by illustrating how alterations in input features would affect the resulting predictions. Common CE approaches require an additional model and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Matan Atad , David Schinz , Hendrik Moeller , Robert Graf , Benedikt Wiestler , Daniel Rueckert , Nassir Navab , Jan S. Kirschke , Matthias Keicher

Latent diffusion models for medical image super-resolution universally inherit variational autoencoders designed for natural photographs. We show that this default choice, not the diffusion architecture, is the dominant constraint on…

Artificial Intelligence (AI) in skin disease diagnosis has improved significantly, but a major concern is that these models frequently show biased performance across subgroups, especially regarding sensitive attributes such as skin color.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Nusrat Munia , Abdullah-Al-Zubaer Imran

Diffusion-based image compression has recently shown outstanding perceptual fidelity, yet its practicality is hindered by prohibitive sampling overhead and high memory usage. Most existing diffusion codecs employ U-Net architectures, where…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Junqi Shi , Ming Lu , Xingchen Li , Anle Ke , Ruiqi Zhang , Zhan Ma

Studies involving colourising images has been garnering researchers' keen attention over time, assisted by significant advances in various Machine Learning techniques and compute power availability. Traditionally, colourising images have…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Tejas Bana , Jatan Loya , Siddhant Kulkarni

Generative models have been applied in the medical imaging domain for various image recognition and synthesis tasks. However, a more controllable and interpretable image synthesis model is still lacking yet necessary for important…

Image and Video Processing · Electrical Eng. & Systems 2021-11-15 Jiarong Ye , Yuan Xue , Peter Liu , Richard Zaino , Keith Cheng , Xiaolei Huang

Recent progress in diffusion-based visual generation has largely relied on latent diffusion models with variational autoencoders (VAEs). While effective for high-fidelity synthesis, this VAE+diffusion paradigm suffers from limited training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Minglei Shi , Haolin Wang , Wenzhao Zheng , Ziyang Yuan , Xiaoshi Wu , Xintao Wang , Pengfei Wan , Jie Zhou , Jiwen Lu

Among the wide variety of image generative models, two models stand out: Variational Auto Encoders (VAE) and Generative Adversarial Networks (GAN). GANs can produce realistic images, but they suffer from mode collapse and do not provide…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

Virtual staining is a promising technique that uses deep generative models to recreate histological stains, providing a faster and more cost-effective alternative to traditional tissue chemical staining. Specifically for H&E-HER2 staining…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Pascal Klöckner , José Teixeira , Diana Montezuma , Jaime S. Cardoso , Hugo M. Horlings , Sara P. Oliveira

This study presents Latent Diffusion Autoencoder (LDAE), a novel encoder-decoder diffusion-based framework for efficient and meaningful unsupervised learning in medical imaging, focusing on Alzheimer disease (AD) using brain MR from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Gabriele Lozupone , Alessandro Bria , Francesco Fontanella , Frederick J. A. Meijer , Claudio De Stefano , Henkjan Huisman

Diffusion models have attained impressive visual quality for image synthesis. However, how to interpret and manipulate the latent space of diffusion models has not been extensively explored. Prior work diffusion autoencoders encode the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Zeyu Lu , Chengyue Wu , Xinyuan Chen , Yaohui Wang , Lei Bai , Yu Qiao , Xihui Liu