English
Related papers

Related papers: CycleNet: Rethinking Cycle Consistency in Text-Gui…

200 papers

Diffusion models (DMs) excel in unconditional generation, as well as on applications such as image editing and restoration. The success of DMs lies in the iterative nature of diffusion: diffusion breaks down the complex process of mapping…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Beomsu Kim , Jaemin Kim , Jeongsol Kim , Jong Chul Ye

Unpaired image-to-image translation (I2I) is an ill-posed problem, as an infinite number of translation functions can map the source domain distribution to the target distribution. Therefore, much effort has been put into designing suitable…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yanwu Xu , Shaoan Xie , Wenhao Wu , Kun Zhang , Mingming Gong , Kayhan Batmanghelich

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao

Consistency models have emerged as a promising alternative to diffusion models, offering high-quality generative capabilities through single-step sample generation. However, their application to multi-domain image translation tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Amil Bhagat , Milind Jain , A. V. Subramanyam

Image co-segmentation is an active computer vision task that aims to segment the common objects from a set of images. Recently, researchers design various learning-based algorithms to undertake the co-segmentation task. The main difficulty…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Chi Zhang , Guankai Li , Guosheng Lin , Qingyao Wu , Rui Yao

Recently, diffusion models have been proven to perform remarkably well in text-to-image synthesis tasks in a number of studies, immediately presenting new study opportunities for image generation. Google's Imagen follows this research trend…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Ruijun Li , Weihua Li , Yi Yang , Hanyu Wei , Jianhua Jiang , Quan Bai

Unpaired image-to-image translation has seen significant progress since the introduction of CycleGAN. However, methods based on diffusion models or Schr\"odinger bridges have yet to be widely adopted in real-world applications due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Suhyeon Lee , Kwanyoung Kim , Jong Chul Ye

An unpaired image-to-image (I2I) translation technique seeks to find a mapping between two domains of data in a fully unsupervised manner. While initial solutions to the I2I problem were provided by generative adversarial neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Dmitrii Torbunov , Yi Huang , Huan-Hsin Tseng , Haiwang Yu , Jin Huang , Shinjae Yoo , Meifeng Lin , Brett Viren , Yihui Ren

Video synthesis has recently made remarkable strides benefiting from the rapid development of diffusion models. However, it still encounters challenges in terms of semantic accuracy, clarity and spatio-temporal continuity. They primarily…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Shiwei Zhang , Jiayu Wang , Yingya Zhang , Kang Zhao , Hangjie Yuan , Zhiwu Qin , Xiang Wang , Deli Zhao , Jingren Zhou

To enhance the controllability of text-to-image diffusion models, current ControlNet-like models have explored various control signals to dictate image attributes. However, existing methods either handle conditions inefficiently or use a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qingdong He , Jinlong Peng , Pengcheng Xu , Boyuan Jiang , Xiaobin Hu , Donghao Luo , Yong Liu , Yabiao Wang , Chengjie Wang , Xiangtai Li , Jiangning Zhang

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Recent breakthroughs of transformer-based diffusion models, particularly with Multimodal Diffusion Transformers (MMDiT) driven models like FLUX and Qwen Image, have facilitated thrilling experiences in text-to-image generation and editing.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Binglei Li , Mengping Yang , Zhiyu Tan , Junping Zhang , Hao Li

This work introduces Ui2i, a novel model for unpaired image-to-image translation, trained on content-wise unpaired datasets to enable style transfer across domains while preserving content. Building on CycleGAN, Ui2i incorporates key…

We introduce Seed-to-Seed Translation (StS), a novel approach for Image-to-Image Translation using diffusion models (DMs), aimed at translations that require close adherence to the structure of the source image. In contrast to existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Or Greenberg , Eran Kishon , Dani Lischinski

Image harmonization, which involves adjusting the foreground of a composite image to attain a unified visual consistency with the background, can be conceptualized as an image-to-image translation task. Diffusion models have recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Pengfei Zhou , Fangxiang Feng , Xiaojie Wang

Sketch-to-image (S2I) translation plays an important role in image synthesis and manipulation tasks, such as photo editing and colorization. Some specific S2I translation including sketch-to-photo and sketch-to-painting can be used as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Jialu Huang , Jing Liao , Zhifeng Tan , Sam Kwong

Image-to-image translation is a class of vision and graphics problems where the goal is to learn the mapping between an input image and an output image using a training set of aligned image pairs. However, for many tasks, paired training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jun-Yan Zhu , Taesung Park , Phillip Isola , Alexei A. Efros

Recently, diffusion models like StableDiffusion have achieved impressive image generation results. However, the generation process of such diffusion models is uncontrollable, which makes it hard to generate videos with continuous and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Zhihao Hu , Dong Xu

Text-to-image (T2I) models have significantly advanced the development of artificial intelligence, enabling the generation of high-quality images in diverse contexts based on specific text prompts. However, existing T2I-based methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Salaheldin Mohamed , Dong Han , Yong Li

Supervised Pix2Pix and unsupervised Cycle-consistency are two modes that dominate the field of medical image-to-image translation. However, neither modes are ideal. The Pix2Pix mode has excellent performance. But it requires paired and well…

Image and Video Processing · Electrical Eng. & Systems 2021-11-12 Lingke Kong , Chenyu Lian , Detian Huang , Zhenjiang Li , Yanle Hu , Qichao Zhou