中文
相关论文

相关论文: Latent Space Disentanglement in Diffusion Transfor…

200 篇论文

Diffusion models achieve remarkable fidelity in image synthesis, yet precise control over their outputs for targeted editing remains challenging. A key step toward controllability is to identify interpretable directions in the model's…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Tharun Anand , Mohammad Hassan Vali , Arno Solin , Green Rosh , BH Pawan Prasad

Diffusion-based models have achieved state-of-the-art performance on text-to-image synthesis tasks. However, one critical limitation of these models is the low fidelity of generated images with respect to the text description, such as…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Qiucheng Wu , Yujian Liu , Handong Zhao , Trung Bui , Zhe Lin , Yang Zhang , Shiyu Chang

In this paper, we investigate how to convert a pre-trained Diffusion Transformer (DiT) into a linear DiT, as its simplicity, parallelism, and efficiency for image generation. Through detailed exploration, we offer a suite of ready-to-use…

Controllable pathology image synthesis requires reliable regulation of spatial layout, tissue morphology, and semantic detail. However, existing text-guided diffusion models offer only coarse global control and lack the ability to enforce…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Yuntao Shou , Xiangyong Cao , Qian Zhao , Deyu Meng

Generating accurate multilingual text with diffusion models has long been desired but remains challenging. Recent methods have made progress in rendering text in a single language, but rendering arbitrary languages is still an unexplored…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Runnan Lu , Yuxuan Zhang , Jiaming Liu , Haofan Wang , Yiren Song

Image manipulation under the guidance of textual descriptions has recently received a broad range of attention. In this study, we focus on the regional editing of images with the guidance of given text prompts. Different from current…

计算机视觉与模式识别 · 计算机科学 2023-02-24 Nisha Huang , Fan Tang , Weiming Dong , Tong-Yee Lee , Changsheng Xu

Recent advances in diffusion models (DMs) have achieved exceptional visual quality in image editing tasks. However, the global denoising dynamics of DMs inherently conflate local editing targets with the full-image context, leading to…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Wei Chow , Linfeng Li , Lingdong Kong , Zefeng Li , Qi Xu , Hang Song , Tian Ye , Xian Wang , Jinbin Bai , Shilin Xu , Xiangtai Li , Junting Pan , Shaoteng Liu , Ran Zhou , Tianshu Yang , Songhua Liu

Text-to-Image editing using diffusion models faces challenges in balancing content preservation with edit application and handling real-image editing. To address these, we propose LAMS-Edit, leveraging intermediate states from the inversion…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Wingwa Fu , Takayuki Okatani

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

The diffusion model has demonstrated superior performance in synthesizing diverse and high-quality images for text-guided image translation. However, there remains room for improvement in both the formulation of text prompts and the…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Qi Si , Bo Wang , Zhao Zhang

Diffusion models excel at image generation. Recent studies have shown that these models not only generate high-quality images but also encode text-image alignment information through attention maps or loss functions. This information is…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Qin Zhou , Zhiyang Zhang , Jinglong Wang , Xiaobin Li , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Diffusion-based text-to-image generative models, e.g., Stable Diffusion, have revolutionized the field of content generation, enabling significant advancements in areas like image editing and video synthesis. Despite their formidable…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Yanyu Li , Xian Liu , Anil Kag , Ju Hu , Yerlan Idelbayev , Dhritiman Sagar , Yanzhi Wang , Sergey Tulyakov , Jian Ren

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

计算机视觉与模式识别 · 计算机科学 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos

In-context diffusion models allow users to modify images with remarkable ease and realism. However, the same power raises serious privacy concerns: personal images can be easily manipulated for identity impersonation, misinformation, or…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Linghui Shen , Mingyue Cui , Xingyi Yang

Diffusion models have become the State-of-the-Art for text-to-image generation, and increasing research effort has been dedicated to adapting the inference process of pretrained diffusion models to achieve zero-shot capabilities. An example…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Fabio Quattrini , Vittorio Pippi , Silvia Cascianelli , Rita Cucchiara

Despite recent significant strides achieved by diffusion-based Text-to-Image (T2I) models, current systems are still less capable of ensuring decent compositional generation aligned with text prompts, particularly for the multi-object…

计算机视觉与模式识别 · 计算机科学 2024-02-01 Zhipeng Bao , Yijun Li , Krishna Kumar Singh , Yu-Xiong Wang , Martial Hebert

With the advent of an increasing number of Augmented and Virtual Reality applications that aim to perform meaningful and controlled style edits on images of human faces, the impetus for the task of parsing face images to produce accurate…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Snehal Singh Tomar , A. N. Rajagopalan

Recently, there has been a significant advancement in text-to-image diffusion models, leading to groundbreaking performance in 2D image generation. These advancements have been extended to 3D models, enabling the generation of novel 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Jangho Park , Gihyun Kwon , Jong Chul Ye

Latent diffusion models (LDMs) power state-of-the-art high-resolution generative image models. LDMs learn the data distribution in the latent space of an autoencoder (AE) and produce images by mapping the generated latents into RGB image…