中文
相关论文

相关论文: Image-to-Image Translation with Diffusion Transfor…

200 篇论文

As recent advances in large-scale Text-to-Image (T2I) diffusion models have yielded remarkable high-quality image generation, diverse downstream Image-to-Image (I2I) applications have emerged. Despite the impressive results achieved by…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Geonung Kim , Beomsu Kim , Eunhyeok Park , Sunghyun Cho

The excellent generative capabilities of text-to-image diffusion models suggest they learn informative representations of image-text data. However, what knowledge their representations capture is not fully understood, and they have not been…

计算机视觉与模式识别 · 计算机科学 2023-09-07 Kevin Clark , Priyank Jaini

Fashion illustration is a crucial medium for designers to convey their creative vision and transform design concepts into tangible representations that showcase the interplay between clothing and the human body. In the context of fashion…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Alberto Baldrati , Davide Morelli , Marcella Cornia , Marco Bertini , Rita Cucchiara

Diffusion Transformers (DiTs) have greatly advanced text-to-image generation, but models still struggle to generate the correct spatial relations between objects as specified in the text prompt. In this study, we adopt a mechanistic…

人工智能 · 计算机科学 2026-04-07 Binxu Wang , Jingxuan Fan , Xu Pan

Recent advances in diffusion transformers have shown remarkable generalization in visual synthesis, yet most dense perception methods still rely on text-to-image (T2I) generators designed for stochastic generation. We revisit this paradigm…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yiqing Shi , Yiren Song , Mike Zheng Shou

Text-guided image-to-image diffusion models excel in translating images based on textual prompts, allowing for precise and creative visual modifications. However, such a powerful technique can be misused for spreading misinformation,…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Wenhao Wang , Yifan Sun , Zongxin Yang , Zhentao Tan , Zhengdong Hu , Yi Yang

Despite promising progress in face swapping task, realistic swapped images remain elusive, often marred by artifacts, particularly in scenarios involving high pose variation, color differences, and occlusion. To address these issues, we…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Sanoojan Baliah , Qinliang Lin , Shengcai Liao , Xiaodan Liang , Muhammad Haris Khan

The image-to-image translation is a learning task to establish a visual mapping between an input and output image. The task has several variations differentiated based on the purpose of the translation, such as synthetic to real…

计算机视觉与模式识别 · 计算机科学 2021-01-26 Pranjal Singh Rajput , Kanya Satis , Sonnya Dellarosa , Wenxuan Huang , Obinna Agba

Cross-modality image segmentation aims to segment the target modalities using a method designed in the source modality. Deep generative models can translate the target modality images into the source modality, thus enabling cross-modality…

图像与视频处理 · 电气工程与系统科学 2024-04-11 Zihao Wang , Yingyu Yang , Yuzhou Chen , Tingting Yuan , Maxime Sermesant , Herve Delingette , Ona Wu

The Stable Diffusion model is a prominent text-to-image generation model that relies on a text prompt as its input, which is encoded using the Contrastive Language-Image Pre-Training (CLIP). However, text prompts have limitations when it…

计算机视觉与模式识别 · 计算机科学 2024-02-16 Yuxuan Ding , Chunna Tian , Haoxuan Ding , Lingqiao Liu

The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images. Although performs well for simple texts, the models may get confused when faced with complex texts that contain…

计算机视觉与模式识别 · 计算机科学 2024-01-15 Chang Yu , Junran Peng , Xiangyu Zhu , Zhaoxiang Zhang , Qi Tian , Zhen Lei

Cross-domain image-to-image translation should satisfy two requirements: (1) preserve the information that is common to both domains, and (2) generate convincing images covering variations that appear in the target domain. This is…

计算机视觉与模式识别 · 计算机科学 2019-10-22 Adam W. Harley , Shih-En Wei , Jason Saragih , Katerina Fragkiadaki

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Adversarial diffusion and diffusion-inversion methods have advanced unpaired image-to-image translation, but each faces key limitations. Adversarial approaches require target-domain adversarial loss during training, which can limit…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Jiaming Liu , Felix Petersen , Yunhe Gao , Yabin Zhang , Hyojin Kim , Akshay S. Chaudhari , Yu Sun , Stefano Ermon , Sergios Gatidis

With the development of generative technologies in deep learning, a large number of image-to-image translation and style transfer models have emerged at an explosive rate in recent years. These two technologies have made significant…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Xiaoming Yu , Jie Tian , Zhenhua Hu

Diffusion Transformers (DiTs) have emerged as a leading architecture for text-to-image synthesis, producing high-quality and photorealistic images. However, the quadratic scaling properties of the attention in DiTs hinder image generation…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Philipp Becker , Abhinav Mehrotra , Ruchika Chavhan , Malcolm Chadwick , Luca Morreale , Mehdi Noroozi , Alberto Gil Ramos , Sourav Bhattacharya

Most image-to-image translation methods focus on learning mappings across domains with the assumption that images share content (e.g., pose) but have their own domain-specific information known as style. When conditioned on a target image,…

计算机视觉与模式识别 · 计算机科学 2021-07-26 Mohamed Abderrahmen Abid , Ihsen Hedhli , Jean-François Lalonde , Christian Gagne

Recent progress in text-to-image (TTI) systems, such as StableDiffusion, Imagen, and DALL-E 2, have made it possible to create realistic images with simple text prompts. It is tempting to use these systems to eliminate the manual task of…

计算机视觉与模式识别 · 计算机科学 2023-11-02 David Marwood , Shumeet Baluja , Yair Alon

Recently, diffusion models were applied to a wide range of image analysis tasks. We build on a method for image-to-image translation using denoising diffusion implicit models and include a regression problem and a segmentation problem for…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe C. Cattin

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li