English
Related papers

Related papers: StyleDiffusion: Controllable Disentangled Style Tr…

200 papers

The Stable Diffusion model is a prominent text-to-image generation model that relies on a text prompt as its input, which is encoded using the Contrastive Language-Image Pre-Training (CLIP). However, text prompts have limitations when it…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Yuxuan Ding , Chunna Tian , Haoxuan Ding , Lingqiao Liu

Cross-modal garment synthesis and manipulation will significantly benefit the way fashion designers generate garments and modify their designs via flexible linguistic interfaces.Current approaches follow the general text-to-image paradigm…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xujie Zhang , Binbin Yang , Michael C. Kampffmeyer , Wenqing Zhang , Shiyue Zhang , Guansong Lu , Liang Lin , Hang Xu , Xiaodan Liang

Despite the remarkable success of Self-Supervised Learning (SSL), its generalization is fundamentally hindered by Shortcut Learning, where models exploit superficial features like texture instead of intrinsic structure. We experimentally…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Siming Fu , Sijun Dong , Xiaoliang Meng

Text-driven style transfer aims to merge the style of a reference image with content described by a text prompt. Recent advancements in text-to-image models have improved the nuance of style transformations, yet significant challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Mingkun Lei , Xue Song , Beier Zhu , Hao Wang , Chi Zhang

Diffusion models have demonstrated remarkable capability in generating high-quality visual content from textual descriptions. However, since these models are trained on large-scale internet data, they inevitably learn undesirable concepts,…

Machine Learning · Computer Science 2025-02-18 Anh Bui , Khanh Doan , Trung Le , Paul Montague , Tamas Abraham , Dinh Phung

Recently, style transfer has received a lot of attention. While much of this research has aimed at speeding up processing, the approaches are still lacking from a principled, art historical standpoint: a style is more than just a single…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Artsiom Sanakoyeu , Dmytro Kotovenko , Sabine Lang , Björn Ommer

Multimodal and multi-domain stylization are two important problems in the field of image style transfer. Currently, there are few methods that can perform both multimodal and multi-domain stylization simultaneously. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Minxuan Lin , Fan Tang , Weiming Dong , Xiao Li , Chongyang Ma , Changsheng Xu

In this work we propose a photorealistic style transfer method for image and video that is based on vision science principles and on a recent mathematical formulation for the deterministic decoupling of sample statistics. The novel aspects…

Image and Video Processing · Electrical Eng. & Systems 2023-04-11 Trevor D. Canham , Adrián Martín , Marcelo Bertalmío , Javier Portilla

Image stitching from different captures often results in non-rectangular boundaries, which is often considered unappealing. To solve non-rectangular boundaries, current solutions involve cropping, which discards image content, inpainting,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Tianhao Zhou , Haipeng Li , Ziyi Wang , Ao Luo , Chen-Lin Zhang , Jiajun Li , Bing Zeng , Shuaicheng Liu

3D asset generation plays a pivotal role in fields such as gaming and virtual reality, enabling the rapid synthesis of high-fidelity 3D objects from a single or multiple images. Building on this capability, enabling style-controllable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yiran Qiao , Yiren Lu , Yunlai Zhou , Disheng Liu , Linlin Hou , Rui Yang , Yu Yin , Jing Ma

We make the distinction between (i) style transfer, in which a source image is manipulated to match the textures and colors of a target image, and (ii) essence transfer, in which one edits the source image to include high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Hila Chefer , Sagie Benaim , Roni Paiss , Lior Wolf

Training visual reinforcement learning (RL) in practical scenarios presents a significant challenge, $\textit{i.e.,}$ RL agents suffer from low sample efficiency in environments with variations. While various approaches have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Qi Wang , Zhipeng Zhang , Baao Xie , Xin Jin , Yunbo Wang , Shiyu Wang , Liaomo Zheng , Xiaokang Yang , Wenjun Zeng

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

We address the task of video style transfer with diffusion models, where the goal is to preserve the context of an input video while rendering it in a target style specified by a text prompt. A major challenge is the lack of paired video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Soroush Mehraban , Vida Adeli , Jacob Rommann , Babak Taati , Kyryl Truskovskyi

While diffusion models have achieved remarkable progress in style transfer tasks, existing methods typically rely on fine-tuning or optimizing pre-trained models during inference, leading to high computational costs and challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Bo Huang , Wenlun Xu , Qizhuo Han , Haodong Jing , Ying Li

Diffusion-based generative models have exhibited powerful generative performance in recent years. However, as many attributes exist in the data distribution and owing to several limitations of sharing the model parameters across all levels…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-26 Ha-Yeong Choi , Sang-Hoon Lee , Seong-Whan Lee

Large pre-trained models have had a significant impact on computer vision by enabling multi-modal learning, where the CLIP model has achieved impressive results in image classification, object detection, and semantic segmentation. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Sitian Shen , Zilin Zhu , Linqian Fan , Harry Zhang , Xinxiao Wu

Universal style transfer aims to transfer arbitrary visual styles to content images. Existing feed-forward based methods, while enjoying the inference efficiency, are mainly limited by inability of generalizing to unseen styles or…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Yijun Li , Chen Fang , Jimei Yang , Zhaowen Wang , Xin Lu , Ming-Hsuan Yang

Text-guided generative diffusion models unlock powerful image creation and editing tools. While these have been extended to video generation, current approaches that edit the content of existing footage while retaining structure require…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Patrick Esser , Johnathan Chiu , Parmida Atighehchian , Jonathan Granskog , Anastasis Germanidis

Artistic style transfer aims to use a style image and a content image to synthesize a target image that retains the same artistic expression as the style image while preserving the basic content of the content image. Many recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Kunxiao Liu , Guowu Yuan , Hao Wu , Wenhua Qian