English
Related papers

Related papers: ArtAdapter: Text-to-Image Style Transfer using Mul…

200 papers

Photorealistic style transfer is the task of transferring the artistic style of an image onto a content target, producing a result that is plausibly taken with a camera. Recent approaches, based on deep neural networks, produce impressive…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Xide Xia , Meng Zhang , Tianfan Xue , Zheng Sun , Hui Fang , Brian Kulis , Jiawen Chen

Over the past few years, image-to-image (I2I) translation methods have been proposed to translate a given image into diverse outputs. Despite the impressive results, they mainly focus on the I2I translation between two domains, so the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Somi Jeong , Jiyoung Lee , Kwanghoon Sohn

Given a random pair of images, an arbitrary style transfer method extracts the feel from the reference image to synthesize an output based on the look of the other content image. Recent arbitrary style transfer methods transfer second order…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Xueting Li , Sifei Liu , Jan Kautz , Ming-Hsuan Yang

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Ruyi Gan , Xiaojun Wu , Junyu Lu , Yuanhe Tian , Dixiang Zhang , Ziwei Wu , Renliang Sun , Chang Liu , Jiaxing Zhang , Pingjian Zhang , Yan Song

Text-to-image (T2I) diffusion models have drawn attention for their ability to generate high-quality images with precise text alignment. However, these models can also be misused to produce inappropriate content. Existing safety measures,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Hongxiang Zhang , Yifeng He , Hao Chen

Neural style transfer has drawn considerable attention from both academic and industrial field. Although visual effect and efficiency have been significantly improved, existing methods are unable to coordinate spatial distribution of visual…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Yuan Yao , Jianqiang Ren , Xuansong Xie , Weidong Liu , Yong-Jin Liu , Jun Wang

Recent thrilling progress in large-scale text-to-image (T2I) models has unlocked unprecedented synthesis quality of AI-generated content (AIGC) including image generation, 3D and video composition. Further, personalized techniques enable…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Yanbing Zhang , Mengping Yang , Qin Zhou , Zhe Wang

Unsupervised text attribute transfer automatically transforms a text to alter a specific attribute (e.g. sentiment) without using any parallel data, while simultaneously preserving its attribute-independent content. The dominant approaches…

Computation and Language · Computer Science 2019-12-13 Ke Wang , Hang Hua , Xiaojun Wan

Recent progress in text-to-image (T2I) models enables high-quality image generation with flexible textual control. To utilize the abundant visual priors in the off-the-shelf T2I models, a series of methods try to invert an image to proper…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Zijie Wu , Chaohui Yu , Zhen Zhu , Fan Wang , Xiang Bai

Text-to-music models allow users to generate nearly realistic musical audio with textual commands. However, editing music audios remains challenging due to the conflicting desiderata of performing fine-grained alterations on the audio while…

Sound · Computer Science 2024-07-25 Fang-Duo Tsai , Shih-Lun Wu , Haven Kim , Bo-Yu Chen , Hao-Chung Cheng , Yi-Hsuan Yang

With the development of generative technologies in deep learning, a large number of image-to-image translation and style transfer models have emerged at an explosive rate in recent years. These two technologies have made significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xiaoming Yu , Jie Tian , Zhenhua Hu

Unsupervised image-to-image translation methods aim to map images from one domain into plausible examples from another domain while preserving structures shared across two domains. In the many-to-many setting, an additional guidance example…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ben Usman , Dina Bashkirova , Kate Saenko

Text-to-image (T2I) models can effectively capture the content or style of reference images to perform high-quality customization. A representative technique for this is fine-tuning using low-rank adaptations (LoRA), which enables efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Geonhui Jang , Jin-Hwa Kim , Yong-Hyun Park , Junho Kim , Gayoung Lee , Yonghyun Jeong

The emergence of text-to-image models marks a significant milestone in the evolution of AI-generated images (AGIs), expanding their use in diverse domains like design, entertainment, and more. Despite these breakthroughs, the quality of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Benhao Huang

Recent advancements in text-to-image (T2I) diffusion models have demonstrated remarkable capabilities in generating high-fidelity images. However, these models often struggle to faithfully render complex user prompts, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Linqing Wang , Ximing Xing , Yiji Cheng , Zhiyuan Zhao , Donghao Li , Tiankai Hang , Jiale Tao , Qixun Wang , Ruihuang Li , Comi Chen , Xin Li , Mingrui Wu , Xinchi Deng , Shuyang Gu , Chunyu Wang , Qinglin Lu

Diffusion-based text-to-image generative models, e.g., Stable Diffusion, have revolutionized the field of content generation, enabling significant advancements in areas like image editing and video synthesis. Despite their formidable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yanyu Li , Xian Liu , Anil Kag , Ju Hu , Yerlan Idelbayev , Dhritiman Sagar , Yanzhi Wang , Sergey Tulyakov , Jian Ren

Our understanding of the visual world is centered around various concept axes, characterizing different aspects of visual entities. While different concept axes can be easily specified by language, e.g. color, the exact visual nuances along…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Sharon Lee , Yunzhi Zhang , Shangzhe Wu , Jiajun Wu

Text-to-image (T2I) diffusion models, with their impressive generative capabilities, have been adopted for image editing tasks, demonstrating remarkable efficacy. However, due to attention leakage and collision between the cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Xingxi Yin , Zhi Li , Jingfeng Zhang , Chenglin Li , Yin Zhang

Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Peter Schaldenbrand , Zhixuan Liu , Jean Oh

Image-to-image translation (I2I) aims at transferring the content representation from an input domain to an output one, bouncing along different target domains. Recent I2I generative models, which gain outstanding results in this task,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Eleonora Grassucci , Luigi Sigillo , Aurelio Uncini , Danilo Comminiello