English
Related papers

Related papers: Sem-CS: Semantic CLIPStyler for Text-Based Image S…

200 papers

We present a method for transferring the style from a set of images to a 3D object. The texture appearance of an asset is optimized with a differentiable renderer in a pipeline based on losses using pretrained deep neural networks. More…

Graphics · Computer Science 2022-08-10 Shailesh Mishra , Jonathan Granskog

Recently, style transfer has received a lot of attention. While much of this research has aimed at speeding up processing, the approaches are still lacking from a principled, art historical standpoint: a style is more than just a single…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Artsiom Sanakoyeu , Dmytro Kotovenko , Sabine Lang , Björn Ommer

Owing to the power of vision-language foundation models, e.g., CLIP, the area of image synthesis has seen recent important advances. Particularly, for style transfer, CLIP enables transferring more general and abstract styles without…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zipeng Xu , Songlong Xing , Enver Sangineto , Nicu Sebe

Semantic segmentation models trained on synthetic data often perform poorly on real-world images due to domain gaps, particularly in adverse conditions where labeled data is scarce. Yet, recent foundation models enable to generate realistic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Estelle Chigot , Dennis G. Wilson , Meriem Ghrib , Thomas Oberlin

Remote sensing image change captioning (RSICC) aims to articulate the changes in objects of interest within bi-temporal remote sensing images using natural language. Given the limitations of current RSICC methods in expressing general…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yongshuo Zhu , Lu Li , Keyan Chen , Chenyang Liu , Fugen Zhou , Zhenwei Shi

Image style transfer aims to manipulate the appearance of a source image, or "content" image, to share similar texture and colors of a target "style" image. Ideally, the style transfer manipulation should also preserve the semantic content…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Mahmoud Afifi , Abdullah Abuolaim , Mostafa Hussien , Marcus A. Brubaker , Michael S. Brown

We present a method for semantically transferring the visual appearance of one natural image to another. Specifically, our goal is to generate an image in which objects in a source structure image are "painted" with the visual appearance of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Narek Tumanyan , Omer Bar-Tal , Shai Bagon , Tali Dekel

Until recently, the general corpus of CLIP-type fundamental models has widely explored either the retrieval of short descriptions or the classification of objects in the scene as SINGLE-object image classification task. The same holds for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Advik Sinha , Saurabh Atreya , Aashutosh A , Sk Aziz Ali , Abhijit Das

This paper explores the possibilities of image style transfer applied to text maintaining the original transcriptions. Results on different text domains (scene text, machine printed text and handwritten text) and cross modal results…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Raul Gomez , Ali Furkan Biten , Lluis Gomez , Jaume Gibert , Marçal Rusiñol , Dimosthenis Karatzas

Cloth-changing person re-identification aims at recognizing the same person with clothing changes across non-overlapping cameras. Advanced methods either resort to identity-related auxiliary modalities (e.g., sketches, silhouettes, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Qizao Wang , Xuelin Qian , Bin Li , Lifeng Chen , Yanwei Fu , Xiangyang Xue

Text-conditioned style transfer enables users to communicate their desired artistic styles through text descriptions, offering a new and expressive means of achieving stylization. In this work, we evaluate the text-conditioned image editing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Silky Singh , Surgan Jandial , Simra Shahid , Abhinav Java

Diffusion-based image translation guided by semantic texts or a single target image has enabled flexible style transfer which is not limited to the specific domains. Unfortunately, due to the stochastic nature of diffusion models, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Gihyun Kwon , Jong Chul Ye

Attention-based arbitrary style transfer methods, including CNN-based, Transformer-based, and Diffusion-based, have flourished and produced high-quality stylized images. However, they perform poorly on the content and style images with the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Chunnan Shang , Zhizhong Wang , Hongwei Wang , Xiangming Meng

Despite the progress made in the style transfer task, most previous work focus on transferring only relatively simple features like color or texture, while missing more abstract concepts such as overall art expression or painter-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Zipeng Xu , Enver Sangineto , Nicu Sebe

We propose a new algorithm for color transfer between images that have perceptually similar semantic structures. We aim to achieve a more accurate color transfer that leverages semantically-meaningful dense correspondence between images. To…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Mingming He , Jing Liao , Dongdong Chen , Lu Yuan , Pedro V. Sander

In this pioneering study, we introduce StyleWallfacer, a groundbreaking unified training and inference framework, which not only addresses various issues encountered in the style transfer process of traditional methods but also unifies the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Gary Song Yan , Yusen Zhang , Jinyu Zhao , Hao Zhang , Zhangping Yang , Guanye Xiong , Yanfei Liu , Tao Zhang , Yujie He , Siyuan Tian , Yao Gou , Min Li

Text style transfer aims to alter the style of a sentence while preserving its content. Due to the lack of parallel corpora, most recent work focuses on unsupervised methods and often uses cycle construction to train models. Since cycle…

Computation and Language · Computer Science 2022-12-20 Kangchen Zhu , Zhiliang Tian , Ruifeng Luo , Xiaoguang Mao

Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Peter Schaldenbrand , Zhixuan Liu , Jean Oh

Most existing CNN-based salient object detection methods can identify local segmentation details like hair and animal fur, but often misinterpret the real saliency due to the lack of global contextual information caused by the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Bo Xu , Guanze Liu , Han Huang , Cheng Lu , Yandong Guo

We propose ObjMST, an object-focused multimodal style transfer framework that provides separate style supervision for salient objects and surrounding elements while addressing alignment issues in multimodal representation learning. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Chanda Grover Kamra , Indra Deep Mastan , Debayan Gupta