English
Related papers

Related papers: DiffArtist: Towards Structure and Appearance Contr…

200 papers

Style control has been popular in video generation models. Existing methods often generate videos far from the given style, cause content leakage, and struggle to transfer one video to the desired style. Our first observation is that the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Zixuan Ye , Huijuan Huang , Xintao Wang , Pengfei Wan , Di Zhang , Wenhan Luo

Style transfer combines the content of one signal with the style of another. It supports applications such as data augmentation and scenario simulation, helping machine learning models generalize in data-scarce domains. While well developed…

The well-known technique outlined in the paper of Leon A. Gatys et al., A Neural Algorithm of Artistic Style, has become a trending topic both in academic literature and industrial applications. Neural Style Transfer (NST) constitutes an…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Maria Karatzoglidi , Georgios Felekis , Eleni Charou

Diffusion models have recently become the dominant paradigm for image generation, yet existing systems struggle to interpret and follow numeric instructions for adjusting semantic attributes. In real-world creative scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Die Chen , Zhongjie Duan , Zhiwen Li , Cen Chen , Daoyuan Chen , Yaliang Li , Yingda Chen

Text-driven style transfer aims to merge the style of a reference image with content described by a text prompt. Recent advancements in text-to-image models have improved the nuance of style transformations, yet significant challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Mingkun Lei , Xue Song , Beier Zhu , Hao Wang , Chi Zhang

Text-conditioned diffusion models can generate impressive images, but fall short when it comes to fine-grained control. Unlike direct-editing tools like Photoshop, text conditioned models require the artist to perform "prompt engineering,"…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Michelle Shu , Charles Herrmann , Richard Strong Bowen , Forrester Cole , Ramin Zabih

Despite the success achieved by existing image generation and editing methods, current models still struggle with complex problems including intricate text prompts, and the absence of verification and self-correction mechanisms makes the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Zhenyu Wang , Aoxue Li , Zhenguo Li , Xihui Liu

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Kunhee Kim , Sanghun Park , Eunyeong Jeon , Taehun Kim , Daijin Kim

Recent advances in generative models and adversarial training have enabled artificially generating artworks in various artistic styles. It is highly desirable to gain more control over the generated style in practice. However, artistic…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xin Miao , Huayan Wang , Jun Fu , Jiayi Liu , Shen Wang , Zhenyu Liao

Despite the burst of innovative methods for controlling the diffusion process, effectively controlling image styles in text-to-image generation remains a challenging task. Many adapter-based methods impose image representation conditions on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wen Li , Muyuan Fang , Cheng Zou , Biao Gong , Ruobing Zheng , Meng Wang , Jingdong Chen , Ming Yang

Style transfer enables the seamless integration of artistic styles from a style image into a content image, resulting in visually striking and aesthetically enriched outputs. Despite numerous advances in this field, existing methods did not…

Graphics · Computer Science 2025-02-21 Ye Wang , Tongyuan Bai , Xuping Xie , Zili Yi , Yilin Wang , Rui Ma

3D style transfer refers to the artistic stylization of 3D assets based on reference style images. Recently, 3DGS-based stylization methods have drawn considerable attention, primarily due to their markedly enhanced training and rendering…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yian Zhao , Rushi Ye , Ruochong Zheng , Zesen Cheng , Chaoran Feng , Jiashu Yang , Pengchong Qiao , Chang Liu , Jie Chen

With the growing success of text or image guided 3D generators, users demand more control over the generation process, appearance stylization being one of them. Given a reference image, this requires adapting the appearance of a generated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Ipek Oztas , Duygu Ceylan , Aysegul Dundar

We propose Neural Neighbor Style Transfer (NNST), a pipeline that offers state-of-the-art quality, generalization, and competitive efficiency for artistic style transfer. Our approach is based on explicitly replacing neural features…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Nicholas Kolkin , Michal Kucera , Sylvain Paris , Daniel Sykora , Eli Shechtman , Greg Shakhnarovich

Songs, as a central form of musical art, exemplify the richness of human intelligence and creativity. While recent advances in generative modeling have enabled notable progress in long-form song generation, current systems for full-length…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-25 Huakang Chen , Yuepeng Jiang , Guobin Ma , Chunbo Hao , Shuai Wang , Jixun Yao , Ziqian Ning , Meng Meng , Jian Luan , Lei Xie

Stylized Text-to-Image Generation (STIG) aims to generate images from text prompts and style reference images. In this paper, we present ArtWeaver, a novel framework that leverages pretrained Stable Diffusion (SD) to address challenges such…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Chengming Xu , Kai Hu , Qilin Wang , Donghao Luo , Jiangning Zhang , Xiaobin Hu , Yanwei Fu , Chengjie Wang

Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jay Whang , Mauricio Delbracio , Hossein Talebi , Chitwan Saharia , Alexandros G. Dimakis , Peyman Milanfar

Sculptors often deviate from geometric accuracy in order to enhance the appearance of their sculpture. These subtle stylizations may emphasize anatomy, draw the viewer's focus to characteristic features of the subject, or symbolize textures…

Graphics · Computer Science 2015-02-09 Jan Jachnik , Dan B Goldman , Linjie Luo , Andrew J. Davison

Maintaining stylistic consistency is crucial for the cohesion and aesthetic appeal of images, a fundamental requirement in effective image editing and inpainting. However, existing methods primarily focus on the semantic control of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Jianman Lin , Tianshui Chen , Chunmei Qing , Zhijing Yang , Shuangping Huang , Yuheng Ren , Liang Lin