English
Related papers

Related papers: Soulstyler: Using Large Language Model to Guide Im…

200 papers

Text style transfer involves rewriting the content of a source sentence in a target style. Despite there being a number of style tasks with available data, there has been limited systematic discussion of how text style datasets relate to…

Computation and Language · Computer Science 2021-08-19 Stephanie Schoch , Wanyu Du , Yangfeng Ji

As large-scale text-to-image generation models have made remarkable progress in the field of text-to-image generation, many fine-tuning methods have been proposed. However, these models often struggle with novel objects, especially with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jianxiang Lu , Cong Xie , Hui Guo

Text style transfer task requires the model to transfer a sentence of one style to another style while retaining its original content meaning, which is a challenging problem that has long suffered from the shortage of parallel data. In this…

Computation and Language · Computer Science 2019-09-26 Mingyue Shang , Piji Li , Zhenxin Fu , Lidong Bing , Dongyan Zhao , Shuming Shi , Rui Yan

The ability to fine-tune generative models for text-to-image generation tasks is crucial, particularly facing the complexity involved in accurately interpreting and visualizing textual inputs. While LoRA is efficient for language model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Mohan Zhou , Yalong Bai , Qing Yang , Tiejun Zhao

We make the distinction between (i) style transfer, in which a source image is manipulated to match the textures and colors of a target image, and (ii) essence transfer, in which one edits the source image to include high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Hila Chefer , Sagie Benaim , Roni Paiss , Lior Wolf

Arbitrary image style transfer is a challenging task which aims to stylize a content image conditioned on arbitrary style images. In this task the feature-level content-style transformation plays a vital role for proper fusion of features.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Siyu Huang , Haoyi Xiong , Tianyang Wang , Bihan Wen , Qingzhong Wang , Zeyu Chen , Jun Huan , Dejing Dou

Universal style transfer aims to transfer arbitrary visual styles to content images. Existing feed-forward based methods, while enjoying the inference efficiency, are mainly limited by inability of generalizing to unseen styles or…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Yijun Li , Chen Fang , Jimei Yang , Zhaowen Wang , Xin Lu , Ming-Hsuan Yang

Despite the burst of innovative methods for controlling the diffusion process, effectively controlling image styles in text-to-image generation remains a challenging task. Many adapter-based methods impose image representation conditions on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wen Li , Muyuan Fang , Cheng Zou , Biao Gong , Ruobing Zheng , Meng Wang , Jingdong Chen , Ming Yang

Transferring the style from one image onto another is a popular and widely studied task in computer vision. Yet, style transfer in the 3D setting remains a largely unexplored problem. To our knowledge, we propose the first learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Mattia Segu , Margarita Grinvald , Roland Siegwart , Federico Tombari

Large-scale noisy web image-text datasets have been proven to be efficient for learning robust vision-language models. However, when transferring them to the task of video retrieval, models still need to be fine-tuned on hand-curated paired…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Nina Shvetsova , Anna Kukleva , Bernt Schiele , Hilde Kuehne

Subject-driven text-to-image diffusion models empower users to tailor the model to new concepts absent in the pre-training dataset using a few sample images. However, prevalent subject-driven models primarily rely on single-concept input…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Junjie Shentu , Matthew Watson , Noura Al Moubayed

We address the problem of unpaired geometric image-to-image translation. Rather than transferring the style of an image as a whole, our goal is to translate the geometry of an object as depicted in different domains while preserving its…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Kaili Wang , Liqian Ma , Jose Oramas , Luc Van Gool , Tinne Tuytelaars

Recent advances in style and appearance transfer are impressive, but most methods isolate global style and local appearance transfer, neglecting semantic correspondence. Additionally, image and video tasks are typically handled in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Huiang He , Minghui Hu , Chuanxia Zheng , Chaoyue Wang , Tat-Jen Cham

Color transfer between images uses the statistics information of image effectively. We present a novel approach of local color transfer between images based on the simple statistics and locally linear embedding. A sketching interface is…

Computer Vision and Pattern Recognition · Computer Science 2016-12-30 Asad Khan , Luo Jiang , Wei Li , Ligang Liu

Style transfer is the task of transferring an attribute of a sentence (e.g., formality) while maintaining its semantic content. The key challenge in style transfer is to strike a balance between the competing goals, one to preserve meaning…

Computation and Language · Computer Science 2018-09-18 Shrimai Prabhumoye , Yulia Tsvetkov , Alan W Black , Ruslan Salakhutdinov

Image-to-image (I2I) translation is a challenging topic in computer vision. We divide this problem into three tasks: strongly constrained translation, normally constrained translation, and weakly constrained translation. The constraint here…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Weichen Fan , Jinghuan Chen , Jiabin Ma , Jun Hou , Shuai Yi

Image style transfer has attracted widespread attention in the past few years. Despite its remarkable results, it requires additional style images available as references, making it less flexible and inconvenient. Using text is the most…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zhi-Song Liu , Li-Wen Wang , Wan-Chi Siu , Vicky Kalogeiton

While many recent any-to-any voice conversion models succeed in transferring some target speech's style information to the converted speech, they still lack the ability to faithfully reproduce the speaking style of the target speaker. In…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Hyungseob Lim , Kyungguen Byun , Sunkuk Moon , Erik Visser

Artistic style transfer aims to use a style image and a content image to synthesize a target image that retains the same artistic expression as the style image while preserving the basic content of the content image. Many recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Kunxiao Liu , Guowu Yuan , Hao Wu , Wenhua Qian

In this paper, we introduce MRStyle, a comprehensive framework that enables color style transfer using multi-modality reference, including image and text. To achieve a unified style feature space for both modalities, we first develop a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jiancheng Huang , Yu Gao , Zequn Jie , Yujie Zhong , Xintong Han , Lin Ma