English
Related papers

Related papers: SEM-CS: Semantic CLIPStyler for Text-Based Image S…

200 papers

We present a novel algorithm for transferring artistic styles of semantically meaningful local regions of an image onto local regions of a target video while preserving its photorealism. Local regions may be selected either fully…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Xide Xia , Tianfan Xue , Wei-sheng Lai , Zheng Sun , Abby Chang , Brian Kulis , Jiawen Chen

Semantic image synthesis aims to generate photo realistic images given a semantic segmentation map. Despite much recent progress, training them still requires large datasets of images annotated with per-pixel label maps that are extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Marlène Careil , Jakob Verbeek , Stéphane Lathuilière

In this paper, we introduces a new type of line-shaped image representation, named semantic line segment (Sem-LS) and focus on solving its detection problem. Sem-LS contains high-level semantics and is a compact scene representation where…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Yi Sun , Xushen Han , Kai Sun , Boren Li , Yongjiang Chen , Mingyang Li

This paper proposes a novel knowledge-Base (KB) assisted semantic communication framework for image transmission. At the receiver, a Facebook AI Similarity Search (FAISS) based vector database is constructed by extracting semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chongyang Li , Yanmei He , Tianqian Zhang , Mingjian He , Shouyin Liu

This paper creates a novel method of deep neural style transfer by generating style images from freeform user text input. The language model and style transfer model form a seamless pipeline that can create output images with similar losses…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Tejas Santanam , Mengyang Liu , Jiangyue Yu , Zhaodong Yang

Despite the impressive results of arbitrary image-guided style transfer methods, text-driven image stylization has recently been proposed for transferring a natural image into a stylized one according to textual descriptions of the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Nisha Huang , Yuxin Zhang , Fan Tang , Chongyang Ma , Haibin Huang , Yong Zhang , Weiming Dong , Changsheng Xu

Semantic segmentation has made tremendous progress in recent years. However, satisfying performance highly depends on a large number of pixel-level annotations. Therefore, in this paper, we focus on the semi-supervised segmentation problem…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Xin Lai , Zhuotao Tian , Li Jiang , Shu Liu , Hengshuang Zhao , Liwei Wang , Jiaya Jia

We propose a way of learning disentangled content-style representation of image, allowing us to extrapolate images to any style as well as interpolate between any pair of styles. By augmenting data set in a supervised setting and imposing…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sailun Xu , Jiazhi Zhang , Jiamei Liu

Image style transfer has attracted widespread attention in the past few years. Despite its remarkable results, it requires additional style images available as references, making it less flexible and inconvenient. Using text is the most…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Zhi-Song Liu , Li-Wen Wang , Jun Xiao , Vicky Kalogeiton

Text-driven style transfer aims to merge the style of a reference image with content described by a text prompt. Recent advancements in text-to-image models have improved the nuance of style transformations, yet significant challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Mingkun Lei , Xue Song , Beier Zhu , Hao Wang , Chi Zhang

Style transfer is the task of transferring an attribute of a sentence (e.g., formality) while maintaining its semantic content. The key challenge in style transfer is to strike a balance between the competing goals, one to preserve meaning…

Computation and Language · Computer Science 2018-09-18 Shrimai Prabhumoye , Yulia Tsvetkov , Alan W Black , Ruslan Salakhutdinov

In recent years, arbitrary image style transfer has attracted more and more attention. Given a pair of content and style images, a stylized one is hoped that retains the content from the former while catching style patterns from the latter.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Chiyu Zhang , Jun Yang , Zaiyan Dai , Peng Cao

In this paper, we aim to devise a universally versatile style transfer method capable of performing artistic, photo-realistic, and video style transfer jointly, without seeing videos during training. Previous single-frame methods assume a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Zijie Wu , Zhen Zhu , Junping Du , Xiang Bai

We introduce a new task, Contextual Text Style Transfer - translating a sentence into a desired style with its surrounding context taken into account. This brings two key challenges to existing style transfer approaches: ($i$) how to…

Computation and Language · Computer Science 2020-05-04 Yu Cheng , Zhe Gan , Yizhe Zhang , Oussama Elachqar , Dianqi Li , Jingjing Liu

We propose a new technique for visual attribute transfer across images that may have very different appearance but have perceptually similar semantic structure. By visual attribute transfer, we mean transfer of visual information (such as…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Jing Liao , Yuan Yao , Lu Yuan , Gang Hua , Sing Bing Kang

Despite the success of style transfer in image processing, it has seen limited progress in natural language generation. Part of the problem is that content is not as easily decoupled from style in the text domain. Curiously, in the field of…

Computation and Language · Computer Science 2019-11-11 Katy Gero , Chris Kedzie , Jonathan Reeve , Lydia Chilton

In this work, we introduce an important but still unexplored research task -- image sentiment transfer. Compared with other related tasks that have been well-studied, such as image-to-image translation and image style transfer, transferring…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Tianlang Chen , Wei Xiong , Haitian Zheng , Jiebo Luo

While many image colorization algorithms have recently shown the capability of producing plausible color versions from gray-scale photographs, they still suffer from limited semantic understanding. To address this shortcoming, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2019-02-11 Jiaojiao Zhao , Jungong Han , Ling Shao , Cees G. M. Snoek

Visual transfer learning for unseen categories presents an active research topic yet a challenging task, due to the inherent conflict between preserving category-specific representations and acquiring transferable knowledge. Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Xiao Shi , Yangjun Ou , Zhenzhong Chen

End-users, without knowledge in photography, desire to beautify their photos to have a similar color style as a well-retouched reference. However, the definition of style in recent image style transfer works is inappropriate. They usually…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Man M. Ho , Jinjia Zhou