English
Related papers

Related papers: Latent Diffusion Autoencoders: Toward Efficient an…

200 papers

Multimodal generative models require a unified approach to handle both discrete data (e.g., text and code) and continuous data (e.g., image, audio, video). In this work, we propose Latent Language Modeling (LatentLM), which seamlessly…

Computation and Language · Computer Science 2024-12-12 Yutao Sun , Hangbo Bao , Wenhui Wang , Zhiliang Peng , Li Dong , Shaohan Huang , Jianyong Wang , Furu Wei

Diffusion autoencoders (DAs) are variants of diffusion generative models that use an input-dependent latent variable to capture representations alongside the diffusion process. These representations, to varying extents, can be used for…

Machine Learning · Computer Science 2025-06-03 Magdalena Proszewska , Nikolay Malkin , N. Siddharth

Recent advances in latent diffusion models have demonstrated their effectiveness for high-resolution image synthesis. However, the properties of the latent space from tokenizer for better learning and generation of diffusion models remain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Hao Chen , Yujin Han , Fangyi Chen , Xiang Li , Yidong Wang , Jindong Wang , Ze Wang , Zicheng Liu , Difan Zou , Bhiksha Raj

Alzheimer's disease (AD) progresses heterogeneously across individuals, motivating subject-specific synthesis of follow-up magnetic resonance imaging (MRI) to support progression assessment. While Diffusion Transformers (DiT), an emerging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Juneyong Lee , Geonwoo Baek , Ikbeom Jang

Once deployed, medical image analysis methods are often faced with unexpected image corruptions and noise perturbations. These unknown covariate shifts present significant challenges to deep learning based methods trained on "clean" images.…

Machine Learning · Computer Science 2025-07-01 Xing Shen , Hengguan Huang , Brennan Nichyporuk , Tal Arbel

Generative data augmentation with latent diffusion models is a promising strategy for addressing class imbalance in medical imaging, yet current approaches focus on perceptual fidelity and domain-specific autoencoder fine-tuning while…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mischa Dombrowski , Felix Nützel , Bernhard Kainz

Sparse autoencoders (SAEs) have become a standard tool for mechanistic interpretability in autoregressive large language models (LLMs), enabling researchers to extract sparse, human-interpretable features and intervene on model behavior.…

Machine Learning · Computer Science 2026-02-06 Xu Wang , Bingqing Jiang , Yu Wan , Baosong Yang , Lingpeng Kong , Difan Zou

Self-supervised learning has attracted increasing attention as it learns data-driven representation from data without annotations. Vision transformer-based autoencoder (ViT-AE) by He et al. (2021) is a recent self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Chinmay Prabhakar , Hongwei Bran Li , Jiancheng Yang , Suprosana Shit , Benedikt Wiestler , Bjoern Menze

Unsupervised multivariate time series (MTS) representation learning aims to extract compact and informative representations from raw sequences without relying on labels, enabling efficient transfer to diverse downstream tasks. In this…

Machine Learning · Computer Science 2025-09-22 Yi Xu , Yitian Zhang , Yun Fu

Blind face restoration from low-quality (LQ) images is a challenging task that requires not only high-fidelity image reconstruction but also the preservation of facial identity. While diffusion models like Stable Diffusion have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Runyi Li , Bin Chen , Jian Zhang , Radu Timofte

Deep learning has made significant strides in medical imaging, leveraging the use of large datasets to improve diagnostics and prognostics. However, large datasets often come with inherent errors through subject selection and acquisition.…

Diffusion models (DMs) have achieved state-of-the-art results for image synthesis tasks as well as density estimation. Applied in the latent space of a powerful pretrained autoencoder (LDM), their immense computational requirements can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jeremias Traub

This study introduces a deep learning framework for the inferential exploration of latent representations in 3D brain MRI, leveraging a simple convolutional autoencoder with a hierarchical encoder and a compact latent space. Trained on…

Applications · Statistics 2026-05-25 J. M. Gorriz , F. Segovia , C. Jimenez , J. E. Arco , F. J. Martinez , J Ramirez , S. Abulikemu , J. Suckling

Machine learning methods have shown large potential for the automatic early diagnosis of Alzheimer's Disease (AD). However, some machine learning methods based on imaging data have poor interpretability because it is usually unclear how…

We present DC-AE 1.5, a new family of deep compression autoencoders for high-resolution diffusion models. Increasing the autoencoder's latent channel number is a highly effective approach for improving its reconstruction quality. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Junyu Chen , Dongyun Zou , Wenkun He , Junsong Chen , Enze Xie , Song Han , Han Cai

Autoregressive models (ARMs) have long dominated the landscape of biomedical vision-language models (VLMs). Recently, masked diffusion models such as LLaDA have emerged as promising alternatives, yet their application in the biomedical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Xuanzhao Dong , Wenhui Zhu , Xiwen Chen , Zhipeng Wang , Peijie Qiu , Shao Tang , Xin Li , Yalin Wang

Clinical guidelines underscore the importance of regularly monitoring and surveilling arteriovenous fistula (AVF) access in hemodialysis patients to promptly detect any dysfunction. Although phono-angiography/sound analysis overcomes the…

Machine Learning · Computer Science 2023-06-13 Li-Chin Chen , Yi-Heng Lin , Li-Ning Peng , Feng-Ming Wang , Yu-Hsin Chen , Po-Hsun Huang , Shang-Feng Yang , Yu Tsao

With the increasing incidence of neurodegenerative diseases such as Alzheimer's Disease (AD), there is a need for further research that enhances detection and monitoring of the diseases. We present MORPHADE (Morphological Autoencoders for…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Mehmet Yigit Avci , Emily Chan , Veronika Zimmer , Daniel Rueckert , Benedikt Wiestler , Julia A. Schnabel , Cosmin I. Bercea

Tokenizers are a crucial component of latent diffusion models, as they define the latent space in which diffusion models operate. However, existing tokenizers are primarily designed to improve reconstruction fidelity or inherit pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zhengrong Yue , Taihang Hu , Mengting Chen , Haiyu Zhang , Zihao Pan , Tao Liu , Zikang Wang , Jinsong Lan , Xiaoyong Zhu , Bo Zheng , Yali Wang

Masked autoencoders (MAEs) have displayed significant potential in the classification and semantic segmentation of medical images in the last year. Due to the high similarity of human tissues, even slight changes in medical images may…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Jiawei Mao , Shujian Guo , Yuanqi Chang , Xuesong Yin , Binling Nie