English
Related papers

Related papers: One-Step Image Translation with Text-to-Image Mode…

200 papers

Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from available conditioning information in one step. One practical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Alaaeldin El-Nouby , Shikhar Sharma , Hannes Schulz , Devon Hjelm , Layla El Asri , Samira Ebrahimi Kahou , Yoshua Bengio , Graham W. Taylor

We present Imagen, a text-to-image diffusion model with an unprecedented degree of photorealism and a deep level of language understanding. Imagen builds on the power of large transformer language models in understanding text and hinges on…

Generative artificial intelligence (GenAI) has made significant progress in understanding world knowledge and generating content from human languages across various modalities, like text-to-text large language models, text-to-image stable…

Machine Learning · Computer Science 2025-03-27 Zexi Li , Lingzhi Gao , Chao Wu

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

In this paper, we investigate the emotion manipulation capabilities of diffusion models with "in-the-wild" images, a rather unexplored application area relative to the vast and rapidly growing literature for image-to-image translation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Ioannis Pikoulis , Panagiotis P. Filntisis , Petros Maragos

Ubiquitous image transmission in emerging applications brings huge overheads to limited wireless resources. Since that text has the characteristic of conveying a large amount of information with very little data, the transmission of the…

Multimedia · Computer Science 2024-09-26 Xinfeng Wei , Haonan Tong , Nuocheng Yang , Changchuan Yin

Restoration of images contaminated by different adverse weather conditions such as fog, snow, and rain is a challenging task due to the varying nature of the weather conditions. Most of the existing methods focus on any one particular…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Kotha Kartheek , Lingamaneni Gnanesh Chowdary , Snehasis Mukherjee

Scene text editing is a challenging task that involves modifying or inserting specified texts in an image while maintaining its natural and realistic appearance. Most previous approaches to this task rely on style-transfer models that crop…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jiabao Ji , Guanhua Zhang , Zhaowen Wang , Bairu Hou , Zhifei Zhang , Brian Price , Shiyu Chang

The success of agricultural artificial intelligence depends heavily on large, diverse, and high-quality plant image datasets, yet collecting such data in real field conditions is costly, labor intensive, and seasonally constrained. This…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Da Tan , Michael Beck , Christopher P. Bidinosti , Robert H. Gulden , Christopher J. Henry

Recent advances of image-to-image translation focus on learning the one-to-many mapping from two aspects: multi-modal translation and multi-domain translation. However, the existing methods only consider one of the two perspectives, which…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Xiaoming Yu , Yuanqi Chen , Thomas Li , Shan Liu , Ge Li

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng

Consistency models have emerged as a promising alternative to diffusion models, offering high-quality generative capabilities through single-step sample generation. However, their application to multi-domain image translation tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Amil Bhagat , Milind Jain , A. V. Subramanyam

Text-to-image generation has recently witnessed remarkable achievements. We introduce a text-conditional image diffusion model, termed RAPHAEL, to generate highly artistic images, which accurately portray the text prompts, encompassing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Zeyue Xue , Guanglu Song , Qiushan Guo , Boxiao Liu , Zhuofan Zong , Yu Liu , Ping Luo

While recent advancements in generative modeling have significantly improved text-image alignment, some residual misalignment between text and image representations still remains. Some approaches address this issue by fine-tuning models in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Jaa-Yeon Lee , Byunghee Cha , Jeongsol Kim , Jong Chul Ye

In the field of computer vision, visible light images often exhibit low contrast in low-light conditions, presenting a significant challenge. While infrared imagery provides a potential solution, its utilization entails high costs and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yijia Chen , Pinghua Chen , Xiangxin Zhou , Yingtie Lei , Ziyang Zhou , Mingxian Li

We present an novel framework for efficiently and effectively extending the powerful continuous diffusion processes to discrete modeling. Previous approaches have suffered from the discrepancy between discrete data and continuous modeling.…

Machine Learning · Computer Science 2024-10-31 Yuxuan Gu , Xiaocheng Feng , Lei Huang , Yingsheng Wu , Zekun Zhou , Weihong Zhong , Kun Zhu , Bing Qin

In terms of Image-to-image translation, Generative Adversarial Networks (GANs) has achieved great success even when it is used in the unsupervised dataset. In this work, we aim to translate cartoon images to photo-realistic images using…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 K. M. Arefeen Sultan , Mohammad Imrul Jubair , MD. Nahidul Islam , Sayed Hossain Khan

I show that a one-dimensional (1D) conditional generative adversarial network (cGAN) with an adversarial training architecture is capable of unpaired signal-to-signal ("sig2sig") translation. Using a simplified CycleGAN model with 1D layers…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-11 Eric Easthope

Recent studies have shown remarkable success in image-to-image translation for two domains. However, existing approaches have limited scalability and robustness in handling more than two domains, since different models should be built…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Yunjey Choi , Minje Choi , Munyoung Kim , Jung-Woo Ha , Sunghun Kim , Jaegul Choo

Diffusion models are trained by learning a sequence of models that reverse each step of noise corruption. Typically, the model parameters are fully shared across multiple timesteps to enhance training efficiency. However, since the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Qianli Ma , Xuefei Ning , Dongrui Liu , Li Niu , Linfeng Zhang