English
Related papers

Related papers: Controllable Segmentation-Based Text-Guided Style …

200 papers

This paper explores the possibilities of image style transfer applied to text maintaining the original transcriptions. Results on different text domains (scene text, machine printed text and handwritten text) and cross modal results…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Raul Gomez , Ali Furkan Biten , Lluis Gomez , Jaume Gibert , Marçal Rusiñol , Dimosthenis Karatzas

We present a novel algorithm for transferring artistic styles of semantically meaningful local regions of an image onto local regions of a target video while preserving its photorealism. Local regions may be selected either fully…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Xide Xia , Tianfan Xue , Wei-sheng Lai , Zheng Sun , Abby Chang , Brian Kulis , Jiawen Chen

We tackle the task of stylizing video objects in an intuitive and semantic manner following a user-specified text prompt. This is a challenging task as the resulting video must satisfy multiple properties: (1) it has to be temporally…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Sebastian Loeschcke , Serge Belongie , Sagie Benaim

Recently, attentional arbitrary style transfer methods have been proposed to achieve fine-grained results, which manipulates the point-wise similarity between content and style features for stylization. However, the attention mechanism…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Xuan Luo , Zhen Han , Lingkang Yang , Lingling Zhang

Text style transfer aims to modify the style of a sentence while keeping its content unchanged. Recent style transfer systems often fail to faithfully preserve the content after changing the style. This paper proposes a structured content…

Computation and Language · Computer Science 2018-11-02 Youzhi Tian , Zhiting Hu , Zhou Yu

Unsupervised text style transfer task aims to rewrite a text into target style while preserving its main content. Traditional methods rely on the use of a fixed-sized vector to regulate text style, which is difficult to accurately convey…

Computation and Language · Computer Science 2023-06-16 Yazheng Yang , Zhou Zhao , Qi Liu

Despite the success of style transfer in image processing, it has seen limited progress in natural language generation. Part of the problem is that content is not as easily decoupled from style in the text domain. Curiously, in the field of…

Computation and Language · Computer Science 2019-11-11 Katy Gero , Chris Kedzie , Jonathan Reeve , Lydia Chilton

Text-driven 3D stylization is a complex and crucial task in the fields of computer vision (CV) and computer graphics (CG), aimed at transforming a bare mesh to fit a target text. Prior methods adopt text-independent multilayer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Yiwei Ma , Xiaioqing Zhang , Xiaoshuai Sun , Jiayi Ji , Haowei Wang , Guannan Jiang , Weilin Zhuang , Rongrong Ji

Vision-language segmentation models have recently achieved strong performance by leveraging high-level semantic object categories expressed in natural language. However, this semantic dependence limits their ability to reason about…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Corentin Seutin , Mohamed Amine Ettaki , Michaël Clément , Pierrick Coupé , Rémi Giraud

Transformer-based Large Language Models (LLMs) have shown exceptional language generation capabilities in response to text-based prompts. However, controlling the direction of generation via textual prompts has been challenging, especially…

Computation and Language · Computer Science 2024-04-09 Rohan Deepak Ajwani , Zining Zhu , Jonathan Rose , Frank Rudzicz

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an intuitive editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jooyoung Choi , Yunjey Choi , Yunji Kim , Junho Kim , Sungroh Yoon

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

We propose a weakly-supervised approach for conditional image generation of complex scenes where a user has fine control over objects appearing in the scene. We exploit sparse semantic maps to control object shapes and classes, as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Dario Pavllo , Aurelien Lucchi , Thomas Hofmann

We propose a controllable style transfer framework based on Implicit Neural Representation that pixel-wisely controls the stylized output via test-time training. Unlike traditional image optimization methods that often suffer from unstable…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Sunwoo Kim , Youngjo Min , Younghun Jung , Seungryong Kim

Most text-to-image customization techniques fine-tune models on a small set of \emph{personal concept} images captured in minimal contexts. This often results in the model becoming overfitted to these training images and unable to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Taewook Kim , Wei Chen , Qiang Qiu

Image style transfer is a challenging task in computational vision. Existing algorithms transfer the color and texture of style images by controlling the neural network's feature layers. However, they fail to control the strength of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Junjie Kang , Jinsong Wu , Shiqi Jiang

This paper presents a novel framework termed Cut-and-Paste for real-word semantic video editing under the guidance of text prompt and additional reference image. While the text-driven video editing has demonstrated remarkable ability to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Zhichao Zuo , Zhao Zhang , Yan Luo , Yang Zhao , Haijun Zhang , Yi Yang , Meng Wang

Style transfer deals with the algorithms to transfer the stylistic properties of a piece of text into that of another while ensuring that the core content is preserved. There has been a lot of interest in the field of text style transfer…

Computation and Language · Computer Science 2020-05-12 Abhilasha Sancheti , Kundan Krishna , Balaji Vasan Srinivasan , Anandhavelu Natarajan

We present StyleBlit---an efficient example-based style transfer algorithm that can deliver high-quality stylized renderings in real-time on a single-core CPU. Our technique is especially suitable for style transfer applications that use…

Graphics · Computer Science 2018-07-10 Daniel Sýkora , Ondřej Jamriška , Jingwan Lu , Eli Shechtman

Manipulating visual attributes of images through human-written text is a very challenging task. On the one hand, models have to learn the manipulation without the ground truth of the desired output. On the other hand, models have to deal…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Yahui Liu , Marco De Nadai , Deng Cai , Huayang Li , Xavier Alameda-Pineda , Nicu Sebe , Bruno Lepri