English
Related papers

Related papers: Latent Space Disentanglement in Diffusion Transfor…

200 papers

Large-scale pre-training tasks like image classification, captioning, or self-supervised techniques do not incentivize learning the semantic boundaries of objects. However, recent generative foundation models built using text-based latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Koutilya Pnvr , Bharat Singh , Pallabi Ghosh , Behjat Siddiquie , David Jacobs

Building on the success of text-to-image diffusion models (DPMs), image editing is an important application to enable human interaction with AI-generated content. Among various editing methods, editing within the prompt space gains more…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Aosong Feng , Weikang Qiu , Jinbin Bai , Xiao Zhang , Zhen Dong , Kaicheng Zhou , Rex Ying , Leandros Tassiulas

Recent research arXiv:2410.15027 has explored the use of diffusion transformers (DiTs) for task-agnostic image generation by simply concatenating attention tokens across images. However, despite substantial computational resources, the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Lianghua Huang , Wei Wang , Zhi-Fan Wu , Yupeng Shi , Huanzhang Dou , Chen Liang , Yutong Feng , Yu Liu , Jingren Zhou

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

Diffusion models (DMs) have recently gained attention with state-of-the-art performance in text-to-image synthesis. Abiding by the tradition in deep learning, DMs are trained and evaluated on the images with fixed sizes. However, users are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zhiyu Jin , Xuli Shen , Bin Li , Xiangyang Xue

Latent Diffusion Models (LDMs) have markedly advanced the quality of image inpainting and local editing. However, the inherent latent compression often introduces pixel-level inconsistencies, such as chromatic shifts, texture mismatches,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Haitian Zheng , Yuan Yao , Yongsheng Yu , Yuqian Zhou , Jiebo Luo , Zhe Lin

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

Latent Diffusion Models (LDMs) rely heavily on the compressed latent space provided by Variational Autoencoders (VAEs) for high-quality image generation. Recent studies have attempted to obtain generation-friendly VAEs by directly adopting…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 John Page , Xuesong Niu , Kai Wu , Kun Gai

There has been tremendous progress in large-scale text-to-image synthesis driven by diffusion models enabling versatile downstream applications such as 3D object synthesis from texts, image editing, and customized generation. We present a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ting-Hsuan Liao , Songwei Ge , Yiran Xu , Yao-Chih Lee , Badour AlBahar , Jia-Bin Huang

Diffusion models have attained impressive visual quality for image synthesis. However, how to interpret and manipulate the latent space of diffusion models has not been extensively explored. Prior work diffusion autoencoders encode the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Zeyu Lu , Chengyue Wu , Xinyuan Chen , Yaohui Wang , Lei Bai , Yu Qiao , Xihui Liu

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges emerge especially…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Rui Jiang , Xinghe Fu , Guangcong Zheng , Teng Li , Taiping Yao , Xi Li

The rapid advancement in image generation models has predominantly been driven by diffusion models, which have demonstrated unparalleled success in generating high-fidelity, diverse images from textual prompts. Despite their success,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yusuf Dalva , Hidir Yesiltepe , Pinar Yanardag

Diffusion models have demonstrated high-quality performance in conditional text-to-image generation, particularly with structural cues such as edges, layouts, and depth. However, lighting conditions have received limited attention and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Ryugo Morita , Stanislav Frolov , Brian Bernhard Moser , Ko Watanabe , Riku Takahashi , Andreas Dengel

Generative models have been very popular in the recent years for their image generation capabilities. GAN-based models are highly regarded for their disentangled latent space, which is a key feature contributing to their success in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yusuf Dalva , Pinar Yanardag

Concept erasure in text-to-image diffusion models is crucial for mitigating harmful content, yet existing methods often compromise generative quality. We introduce Semantic Surgery, a novel training-free, zero-shot framework for concept…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Lexiang Xiong , Chengyu Liu , Jingwen Ye , Yan Liu , Yuecong Xu

Current text-to-image diffusion generation typically employs complete-text conditioning. Due to the intricate syntax, diffusion transformers (DiTs) inherently suffer from a comprehension defect of complete-text captions. One-fly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yu Zhang , Jialei Zhou , Xinchen Li , Qi Zhang , Zhongwei Wan , Tianyu Wang , Duoqian Miao , Changwei Wang , Longbing Cao

Recent advances in Text-to-Image (T2I) diffusion models have transformed image generation, enabling significant progress in stylized generation using only a few style reference images. However, current diffusion-based methods struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Jiang Qin , Senmao Li , Alexandra Gomez-Villa , Shiqi Yang , Yaxing Wang , Kai Wang , Joost van de Weijer

In light of recent breakthroughs in text-to-image (T2I) generation, particularly with diffusion transformers (DiT), subject-driven technologies are increasingly being employed for high-fidelity customized production that preserves subject…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yanbing Zhang , Zhe Wang , Qin Zhou , Mengping Yang

Recent advances in image generation have made diffusion models powerful tools for creating high-quality images. However, their iterative denoising process makes understanding and interpreting their semantic latent spaces more challenging…

Computation and Language · Computer Science 2024-11-06 E. Zhixuan Zeng , Yuhao Chen , Alexander Wong