English
Related papers

Related papers: CycleNet: Rethinking Cycle Consistency in Text-Gui…

200 papers

Deep generative models have demonstrated remarkable success in medical image synthesis. However, ensuring conditioning faithfulness and high-quality synthetic images for direct or counterfactual generation remains a challenge. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Fangrui Huang , Alan Wang , Binxu Li , Bailey Trang , Ridvan Yesiloglu , Tianyu Hua , Wei Peng , Ehsan Adeli

The in-image machine translation task involves translating text embedded within images, with the translated results presented in image format. While this task has numerous applications in various scenarios such as film poster translation…

Computation and Language · Computer Science 2024-12-25 Chengpeng Fu , Xiaocheng Feng , Yichong Huang , Wenshuai Huo , Baohang Li , Zhirui Zhang , Yunfei Lu , Dandan Tu , Duyu Tang , Hui Wang , Bing Qin , Ting Liu

Diffusion models have revolutionized the field of content synthesis and editing. Recent models have replaced the traditional UNet architecture with the Diffusion Transformer (DiT), and employed flow-matching for improved training and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Omri Avrahami , Or Patashnik , Ohad Fried , Egor Nemchinov , Kfir Aberman , Dani Lischinski , Daniel Cohen-Or

The conditional text-to-image diffusion models have garnered significant attention in recent years. However, the precision of these models is often compromised mainly for two reasons, ambiguous condition input and inadequate condition…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Sicheng Li , Keqiang Sun , Zhixin Lai , Xiaoshi Wu , Feng Qiu , Haoran Xie , Kazunori Miyata , Hongsheng Li

Supervised deep learning techniques have achieved great success in various fields due to getting rid of the limitation of handcrafted representations. However, most previous image retargeting algorithms still employ fixed design principles…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Weimin Tan , Bo Yan , Chumin Lin , Xuejing Niu

Image-to-image translation (I2IT) refers to the process of transforming images from a source domain to a target domain while maintaining a fundamental connection in terms of image content. In the past few years, remarkable advancements in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Or Greenberg , Eran Kishon , Dani Lischinski

Recently, diffusion models have made remarkable progress in text-to-image (T2I) generation, synthesizing images with high fidelity and diverse contents. Despite this advancement, latent space smoothness within diffusion models remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jiayi Guo , Xingqian Xu , Yifan Pu , Zanlin Ni , Chaofei Wang , Manushree Vasu , Shiji Song , Gao Huang , Humphrey Shi

The purpose of this paper is to enable the conversion between machine-printed character images (i.e., font images) and handwritten character images through machine learning. For this purpose, we propose a novel unpaired image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Sho Shimotsumagari , Shumpei Takezaki , Daichi Haraguchi , Seiichi Uchida

Image-to-image translation (I2I) aims to transfer images from a source domain to a target domain while preserving the content representations. I2I has drawn increasing attention and made tremendous progress in recent years because of its…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Yingxue Pang , Jianxin Lin , Tao Qin , Zhibo Chen

We introduce a simple and versatile framework for image-to-image translation. We unearth the importance of normalization layers, and provide a carefully designed two-stream generative model with newly proposed feature transformations in a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Liming Jiang , Changxu Zhang , Mingyang Huang , Chunxiao Liu , Jianping Shi , Chen Change Loy

Recent advances in diffusion transformers have shown remarkable generalization in visual synthesis, yet most dense perception methods still rely on text-to-image (T2I) generators designed for stochastic generation. We revisit this paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yiqing Shi , Yiren Song , Mike Zheng Shou

The original publication Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks served as the inspiration for this implementation project. Researchers developed a novel method for doing image-to-image translations…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Sai Pavan Tadem

Despite the ability of existing large-scale text-to-image (T2I) models to generate high-quality images from detailed textual descriptions, they often lack the ability to precisely edit the generated or real images. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

This paper develops a unified framework for image-to-image translation based on conditional diffusion models and evaluates this framework on four challenging image-to-image translation tasks, namely colorization, inpainting, uncropping, and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Chitwan Saharia , William Chan , Huiwen Chang , Chris A. Lee , Jonathan Ho , Tim Salimans , David J. Fleet , Mohammad Norouzi

Scaling up model and data size has been quite successful for the evolution of LLMs. However, the scaling law for the diffusion based text-to-image (T2I) models is not fully explored. It is also unclear how to efficiently scale the model for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Hao Li , Yang Zou , Ying Wang , Orchid Majumder , Yusheng Xie , R. Manmatha , Ashwin Swaminathan , Zhuowen Tu , Stefano Ermon , Stefano Soatto

Unsupervised image-to-image (I2I) translation learns cross-domain image mapping that transfers input from the source domain to output in the target domain while preserving its semantics. One challenge is that different semantic statistics…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Ganning Zhao , Wenhui Cui , Suya You , C. -C. Jay Kuo

Image to Image Translation (I2I) is a challenging computer vision problem used in numerous domains for multiple tasks. Recently, ophthalmology became one of the major fields where the application of I2I is increasing rapidly. One such…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Hemanth Pasupuleti , G. N. Girish

Background-Induced Text2Image (BIT2I) aims to generate foreground content according to the text on the given background image. Most studies focus on generating high-quality foreground content, although they ignore the relationship between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Ryugo Morita , Zhiqiang Zhang , Jinjia Zhou

Image-to-image translation (I2I) is defined as a computer vision task where the aim is to transfer images in a source domain to a target domain with minimal loss or alteration of the content representations. Major progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Zhuohao Yin

In this work, we address two limitations of existing conditional diffusion models: their slow inference speed due to the iterative denoising process and their reliance on paired data for model fine-tuning. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Gaurav Parmar , Taesung Park , Srinivasa Narasimhan , Jun-Yan Zhu