English
Related papers

Related papers: Style Injection in Diffusion: A Training-free Appr…

200 papers

Many existing adversarial attacks generate $L_p$-norm perturbations on image RGB space. Despite some achievements in transferability and attack success rate, the crafted adversarial examples are easily perceived by human eyes. Towards…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jianqi Chen , Hao Chen , Keyan Chen , Yilan Zhang , Zhengxia Zou , Zhenwei Shi

Text style transfer aims to alter the style (e.g., sentiment) of a sentence while preserving its content. A common approach is to map a given sentence to content representation that is free of style, and the content representation is fed to…

Computation and Language · Computer Science 2021-08-03 Dongkyu Lee , Zhiliang Tian , Lanqing Xue , Nevin L. Zhang

Diffusion models have achieved remarkable progress in image and video stylization. However, most existing methods focus on single-style transfer, while video stylization involving multiple styles necessitates seamless transitions between…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Haoyu Zheng , Qifan Yu , Binghe Yu , Yang Dai , Wenqiao Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang

Diffusion-based video editing have reached impressive quality and can transform either the global style, local structure, and attributes of given video inputs, following textual edit prompts. However, such solutions typically incur heavy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Kumara Kahatapitiya , Adil Karjauv , Davide Abati , Fatih Porikli , Yuki M. Asano , Amirhossein Habibian

In this paper, we present DesignDiffusion, a simple yet effective framework for the novel task of synthesizing design images from textual descriptions. A primary challenge lies in generating accurate and style-consistent textual and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zhendong Wang , Jianmin Bao , Shuyang Gu , Dong Chen , Wengang Zhou , Houqiang Li

Arbitrary style transfer is the task of synthesis of an image that has never been seen before, using two given images: content image and style image. The content image forms the structure, the basic geometric lines and shapes of the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 S. A. Berezin , V. M. Volkova

We introduce precise object silhouette as a new form of user control in text-to-image diffusion models, which we dub Shape-Guided Diffusion. Our training-free method uses an Inside-Outside Attention mechanism during the inversion and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Dong Huk Park , Grace Luo , Clayton Toste , Samaneh Azadi , Xihui Liu , Maka Karalashvili , Anna Rohrbach , Trevor Darrell

Multiview diffusion models have rapidly emerged as a powerful tool for content creation with spatial consistency across viewpoints, offering rich visual realism without requiring explicit geometry and appearance representation. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Hubert Kompanowski , Varun Jampani , Aaryaman Vasishta , Binh-Son Hua

Diffusion probabilistic models have shown great success in generating high-quality images controllably, and researchers have tried to utilize this controllability into text generation domain. Previous works on diffusion-based language…

Computation and Language · Computer Science 2023-06-13 Yiwei Lyu , Tiange Luo , Jiacheng Shi , Todd C. Hollon , Honglak Lee

Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although text-to-music generation is getting largely adopted by the…

Sound · Computer Science 2024-08-02 Nils Demerlé , Philippe Esling , Guillaume Doras , David Genova

Diffusion models are able to generate photorealistic images in arbitrary scenes. However, when applying diffusion models to image translation, there exists a trade-off between maintaining spatial structure and high-quality content. Besides,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Shiqi Sun , Shancheng Fang , Qian He , Wei Liu

Numerous recent techniques for text style transfer characterize their approaches as variants of reinforcement learning and preference optimization. In this work, we consider the relationship between these approaches and a class of…

Computation and Language · Computer Science 2024-07-30 Shuai Liu , Jonathan May

Diffusion models are proficient at generating high-quality images. They are however effective only when operating at the resolution used during training. Inference at a scaled resolution leads to repetitive patterns and structural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Haosen Yang , Adrian Bulat , Isma Hadji , Hai X. Pham , Xiatian Zhu , Georgios Tzimiropoulos , Brais Martinez

Modern diffusion models have set the state-of-the-art in AI image generation. Their success is due, in part, to training on Internet-scale data which often includes copyrighted work. This prompts questions about the extent to which these…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Stephen Casper , Zifan Guo , Shreya Mogulothu , Zachary Marinov , Chinmay Deshpande , Rui-Jie Yew , Zheng Dai , Dylan Hadfield-Menell

The stylization of 3D scenes is an increasingly attractive topic in 3D vision. Although image style transfer has been extensively researched with promising results, directly applying 2D style transfer methods to 3D scenes often fails to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yushen Zuo , Jun Xiao , Kin-Chung Chan , Rongkang Dong , Cuixin Yang , Zongqi He , Hao Xie , Kin-Man Lam

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Artistic style transfer is the problem of synthesizing an image with content similar to a given image and style similar to another. Although recent feed-forward neural networks can generate stylized images in real-time, these models produce…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Mohammad Babaeizadeh , Golnaz Ghiasi

Diffusion models have been successfully adapted to text generation tasks by mapping the discrete text into the continuous space. However, there exist nonnegligible gaps between training and inference, owing to the absence of the forward…

Computation and Language · Computer Science 2023-05-09 Zecheng Tang , Pinzheng Wang , Keyan Zhou , Juntao Li , Ziqiang Cao , Min Zhang

This paper introduces a novel method by reshuffling deep features (i.e., permuting the spacial locations of a feature map) of the style image for arbitrary style transfer. We theoretically prove that our new style loss based on reshuffle…

Computer Vision and Pattern Recognition · Computer Science 2018-06-21 Shuyang Gu , Congliang Chen , Jing Liao , Lu Yuan

Contemporary diffusion models built upon U-Net or Diffusion Transformer (DiT) architectures have revolutionized image generation through transformer-based attention mechanisms. The prevailing paradigm has commonly employed self-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 ZiYi Dong , Chengxing Zhou , Weijian Deng , Pengxu Wei , Xiangyang Ji , Liang Lin