中文
相关论文

相关论文: Latent Space Disentanglement in Diffusion Transfor…

200 篇论文

The correspondence between input text and the generated image exhibits opacity, wherein minor textual modifications can induce substantial deviations in the generated image. While, text embedding, as the pivotal intermediary between text…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Hu Yu , Hao Luo , Fan Wang , Feng Zhao

Recent research arXiv:2410.15027 arXiv:2410.23775 has highlighted the inherent in-context generation capabilities of pretrained diffusion transformers (DiTs), enabling them to seamlessly adapt to diverse visual tasks with minimal or no…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Lianghua Huang , Wei Wang , Zhi-Fan Wu , Yupeng Shi , Chen Liang , Tong Shen , Han Zhang , Huanzhang Dou , Yu Liu , Jingren Zhou

Recent breakthroughs of transformer-based diffusion models, particularly with Multimodal Diffusion Transformers (MMDiT) driven models like FLUX and Qwen Image, have facilitated thrilling experiences in text-to-image generation and editing.…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Binglei Li , Mengping Yang , Zhiyu Tan , Junping Zhang , Hao Li

Scene text editing aims to modify text in a target region of an image while preserving surrounding background style and texture. Existing methods rely solely on image background information while neglecting the visual details of target…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Hongxi Li , Tong Wang , Chengjing Wu , Tianbao Liu , Jiangtao Yao , Xiaochao Qu , Xinxiao Wu , Luoqi Liu , Ting Liu

Text-guided non-rigid editing involves complex edits for input images, such as changing motion or compositions within their surroundings. Since it requires manipulating the input structure, existing methods often struggle with preserving…

计算机视觉与模式识别 · 计算机科学 2024-10-17 Yunji Jung , Seokju Lee , Tair Djanibekov , Hyunjung Shim , Jong Chul Ye

The Diffusion Model has not only garnered noteworthy achievements in the realm of image generation but has also demonstrated its potential as an effective pretraining method utilizing unlabeled data. Drawing from the extensive potential…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Muzhi Zhu , Yang Liu , Zekai Luo , Chenchen Jing , Hao Chen , Guangkai Xu , Xinlong Wang , Chunhua Shen

Latent diffusion models excel at producing high-quality images from text. Yet, concerns appear about the lack of diversity in the generated imagery. To tackle this, we introduce Diverse Diffusion, a method for boosting image diversity…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Mariia Zameshina , Olivier Teytaud , Laurent Najman

Image-to-image translation aims to learn a mapping between a source and a target domain, enabling tasks such as style transfer, appearance transformation, and domain adaptation. In this work, we explore a diffusion-based framework for…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Qiang Zhu , Kuan Lu , Menghao Huo , Yuxiao Li

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

With the remarkable advent of text-to-image diffusion models, image editing methods have become more diverse and continue to evolve. A promising recent approach in this realm is Delta Denoising Score (DDS) - an image editing technique based…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Hyelin Nam , Gihyun Kwon , Geon Yeong Park , Jong Chul Ye

Diffusion Transformers (DiTs) have greatly advanced text-to-image generation, but models still struggle to generate the correct spatial relations between objects as specified in the text prompt. In this study, we adopt a mechanistic…

人工智能 · 计算机科学 2026-04-07 Binxu Wang , Jingxuan Fan , Xu Pan

Concept erasure in Text-To-Image (T2I) diffusion models is vital for safe content generation, but existing inference-time methods face significant limitations. Feature-correction approaches often cause uncontrolled over-correction, while…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Qinghui Gong

Scene text editing aims to modify or add texts on images while ensuring text fidelity and overall visual quality consistent with the background. Recent methods are primarily built on UNet-based diffusion models, which have improved scene…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Rui Lan , Yancheng Bai , Xu Duan , Mingxing Li , Dongyang Jin , Ryan Xu , Dong Nie , Lei Sun , Xiangxiang Chu

Recent developments in large-scale pre-trained text-to-image diffusion models have significantly improved the generation of high-fidelity images, particularly with the emergence of diffusion transformer models (DiTs). Among diffusion…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Xudong Lu , Aojun Zhou , Ziyi Lin , Qi Liu , Yuhui Xu , Renrui Zhang , Xue Yang , Junchi Yan , Peng Gao , Hongsheng Li

The latent space of diffusion model mostly still remains unexplored, despite its great success and potential in the field of generative modeling. In fact, the latent space of existing diffusion models are entangled, with a distorted mapping…

机器学习 · 计算机科学 2024-07-17 Jaehoon Hahm , Junho Lee , Sunghyun Kim , Joonseok Lee

Deep learning-based image generation has seen significant advancements with diffusion models, notably improving the quality of generated images. Despite these developments, generating images with unseen characteristics beneficial for…

While Diffusion Large Language Models (DLLMs) have demonstrated remarkable capabilities in multi-modal generation, performing precise, training-free image editing remains an open challenge. Unlike continuous diffusion models, the discrete…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Zifeng Zhu , Jiaming Han , Jiaxiang Zhao , Minnan Luo , Xiangyu Yue

Pre-trained diffusion models have demonstrated remarkable proficiency in synthesizing images across a wide range of scenarios with customizable prompts, indicating their effective capacity to capture universal features. Motivated by this,…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Yuxiang Ji , Boyong He , Chenyuan Qu , Zhuoyue Tan , Chuan Qin , Liaoni Wu

Latent space is one of the key concepts in generative AI, offering powerful means for creative exploration through vector manipulation. However, diffusion models like Stable Diffusion lack the intuitive latent vector control found in GANs,…

机器学习 · 计算机科学 2025-09-29 Zhihua Zhong , Xuanyang Huang