English
Related papers

Related papers: ArtAdapter: Text-to-Image Style Transfer using Mul…

200 papers

We propose a novel solution for unpaired image-to-image (I2I) translation. To translate complex images with a wide range of objects to a different domain, recent approaches often use the object annotations to perform per-class…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Seokbeom Song , Suhyeon Lee , Hongje Seong , Kyoungwon Min , Euntai Kim

Modern Text-to-Image (T2I) Diffusion models have revolutionized image editing by enabling the generation of high-quality photorealistic images. While the de facto method for performing edits with T2I models is through text instructions,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Ashutosh Srivastava , Tarun Ram Menta , Abhinav Java , Avadhoot Jadhav , Silky Singh , Surgan Jandial , Balaji Krishnamurthy

Applying diffusion models to image-to-image translation (I2I) has recently received increasing attention due to its practical applications. Previous attempts inject information from the source image into each denoising step for an iterative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Mengfei Xia , Yu Zhou , Ran Yi , Yong-Jin Liu , Wenping Wang

With the growing popularity of personalized human content creation and sharing, there is a rising demand for advanced techniques in customized human image generation. However, current methods struggle to simultaneously maintain the fidelity…

Graphics · Computer Science 2025-02-21 Ye Wang , Xuping Xie , Lanjun Wang , Zili Yi , Rui Ma

The applicability of computer vision to real paintings and artworks has been rarely investigated, even though a vast heritage would greatly benefit from techniques which can understand and process data from the artistic domain. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Matteo Tomei , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

In the current research landscape, multimodal autoregressive (AR) models have shown exceptional capabilities across various domains, including visual understanding and generation. However, complex tasks such as style-aligned text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yi Wu , Lingting Zhu , Shengju Qian , Lei Liu , Wandi Qiao , Lequan Yu , Bin Li

Recent advances in image editing have shifted from manual pixel manipulation to employing deep learning methods like stable diffusion models, which now leverage cross-attention mechanisms for text-driven control. This transition has…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Linn Bieske , Carla Lorente

Neural style transfer has drawn broad attention in recent years. However, most existing methods aim to explicitly model the transformation between different styles, and the learned model is thus not generalizable to new styles. We here…

Computer Vision and Pattern Recognition · Computer Science 2018-09-25 Yexun Zhang , Ya Zhang , Wenbin Cai , Jie Chang

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

Our world is marked by unprecedented technological, global, and socio-political transformations, posing a significant challenge to text-to-image generative models. These models encode factual associations within their parameters that can…

Computation and Language · Computer Science 2024-05-08 Dana Arad , Hadas Orgad , Yonatan Belinkov

Generative text-to-image models are disrupting the lives of creative professionals. Specifically, illustrators are threatened by models that claim to extract and reproduce their style. Yet, research on style transfer has rarely focused on…

Human-Computer Interaction · Computer Science 2025-01-31 Julien Porquet , Sitong Wang , Lydia B. Chilton

The ability to fine-tune generative models for text-to-image generation tasks is crucial, particularly facing the complexity involved in accurately interpreting and visualizing textual inputs. While LoRA is efficient for language model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Mohan Zhou , Yalong Bai , Qing Yang , Tiejun Zhao

Ultra-high quality artistic style transfer refers to repainting an ultra-high quality content image using the style information learned from the style image. Existing artistic style transfer methods can be categorized into style…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhanjie Zhang , Ao Ma , Ke Cao , Jing Wang , Shanyuan Liu , Yuhang Ma , Bo Cheng , Dawei Leng , Yuhui Yin

Image-to-image translation (I2I), and particularly its subfield of appearance transfer, which seeks to alter the visual appearance between images while maintaining structural coherence, presents formidable challenges. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yuteng Ye , Guanwen Li , Hang Zhou , Cai Jiale , Junqing Yu , Yawei Luo , Zikai Song , Qilong Xing , Youjia Zhang , Wei Yang

The goal of image style transfer is to render an image with artistic features guided by a style reference while maintaining the original content. Owing to the locality in convolutional neural networks (CNNs), extracting and maintaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Yingying Deng , Fan Tang , Weiming Dong , Chongyang Ma , Xingjia Pan , Lei Wang , Changsheng Xu

Artistic style transfer is the problem of synthesizing an image with content similar to a given image and style similar to another. Although recent feed-forward neural networks can generate stylized images in real-time, these models produce…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Mohammad Babaeizadeh , Golnaz Ghiasi

Image style transfer occupies an important place in both computer graphics and computer vision. However, most current methods require reference to stylized images and cannot individually stylize specific objects. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Junhao Chen , Peng Rong , Jingbo Sun , Chao Li , Xiang Li , Hongwu Lv

Computer vision systems currently lack the ability to reliably recognize artistically rendered objects, especially when such data is limited. In this paper, we propose a method for recognizing objects in artistic modalities (such as…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Christopher Thomas , Adriana Kovashka

Generally, image-to-image translation (i2i) methods aim at learning mappings across domains with the assumption that the images used for translation share content (e.g., pose) but have their own domain-specific information (a.k.a. style).…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Mohamed Abid , Arman Afrasiyabi , Ihsen Hedhli , Jean-François Lalonde , Christian Gagné

Arbitrary style transfer is a significant topic with research value and application prospect. A desired style transfer, given a content image and referenced style painting, would render the content image with the color tone and vivid stroke…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Yingying Deng , Fan Tang , Weiming Dong , Wen Sun , Feiyue Huang , Changsheng Xu