English
Related papers

Related papers: MegaStyle: Constructing Diverse and Scalable Style…

200 papers

The diffusion model has shown exceptional capabilities in controlled image generation, which has further fueled interest in image style transfer. Existing works mainly focus on training free-based methods (e.g., image inversion) due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Peng Xing , Haofan Wang , Yanpeng Sun , Qixun Wang , Xu Bai , Hao Ai , Renyuan Huang , Zechao Li

Style transfer is an inventive process designed to create an image that maintains the essence of the original while embracing the visual style of another. Although diffusion models have demonstrated impressive generative power in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Haofan Wang , Peng Xing , Renyuan Huang , Hao Ai , Qixun Wang , Xu Bai

3D content creation via text-driven stylization has played a fundamental challenge to multimedia and graphics community. Recent advances of cross-modal foundation models (e.g., CLIP) have made this problem feasible. Those approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Tao Mei

Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Peter Schaldenbrand , Zhixuan Liu , Jean Oh

Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mengyao Cui , Zhe Zhu , Shao-Ping Lu , Yulu Yang

Image style transfer occupies an important place in both computer graphics and computer vision. However, most current methods require reference to stylized images and cannot individually stylize specific objects. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Junhao Chen , Peng Rong , Jingbo Sun , Chao Li , Xiang Li , Hongwu Lv

Automatic font generation is an imitation task, which aims to create a font library that mimics the style of reference images while preserving the content from source images. Although existing font generation methods have achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Zhenhua Yang , Dezhi Peng , Yuxin Kong , Yuyi Zhang , Cong Yao , Lianwen Jin

Multi-Style Transfer (MST) intents to capture the high-level visual vocabulary of different styles and expresses these vocabularies in a joint model to transfer each specific style. Recently, Style Embedding Learning (SEL) based methods…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Hongmin Xu , Qiang Li , Wenbo Zhang , Wen Zheng

Stylized text-to-image generation focuses on creating images from textual descriptions while adhering to a style specified by a few reference images. However, subtle style variations within different reference images can hinder the model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Xing Cui , Zekun Li , Pei Pei Li , Huaibo Huang , Xuannan Liu , Zhaofeng He

Text style transfer aims to alter the style of a sentence while preserving its content. Due to the lack of parallel corpora, most recent work focuses on unsupervised methods and often uses cycle construction to train models. Since cycle…

Computation and Language · Computer Science 2022-12-20 Kangchen Zhu , Zhiliang Tian , Ruifeng Luo , Xiaoguang Mao

We present StyleText, a large-scale dataset and benchmark for localized scene-text inpainting with style preservation. StyleText contains 28,518 image-mask-prompt triplets grouped into 9,932 scene families, enabling controlled evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Aleksandr Simonyan , Nipun Jindal

Stylistic text generation plays a vital role in enhancing communication by reflecting the nuances of individual expression. This paper presents a novel approach for generating text in a specific speaker's style across different languages.…

Computation and Language · Computer Science 2025-01-23 Karishma Thakrar , Katrina Lawrence , Kyle Howard

Autoregressive transformers are spectacular models for short sequences but scale poorly to long sequences such as high-resolution images, podcasts, code, or books. We proposed Megabyte, a multi-scale decoder architecture that enables…

Machine Learning · Computer Science 2023-05-23 Lili Yu , Dániel Simig , Colin Flaherty , Armen Aghajanyan , Luke Zettlemoyer , Mike Lewis

In the current research landscape, multimodal autoregressive (AR) models have shown exceptional capabilities across various domains, including visual understanding and generation. However, complex tasks such as style-aligned text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yi Wu , Lingting Zhu , Shengju Qian , Lei Liu , Wandi Qiao , Lequan Yu , Bin Li

Discovering meaningful directions in the latent space of GANs to manipulate semantic attributes typically requires large amounts of labeled data. Recent work aims to overcome this limitation by leveraging the power of Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Umut Kocasari , Alara Dirik , Mert Tiftikci , Pinar Yanardag

Unsupervised text style transfer task aims to rewrite a text into target style while preserving its main content. Traditional methods rely on the use of a fixed-sized vector to regulate text style, which is difficult to accurately convey…

Computation and Language · Computer Science 2023-06-16 Yazheng Yang , Zhou Zhao , Qi Liu

Text style transfer is an exciting task within the field of natural language generation that is often plagued by the need for high-quality paired datasets. Furthermore, training a model for multi-attribute text style transfer requires…

Computation and Language · Computer Science 2023-05-26 Debarati Das , David Ma , Dongyeop Kang

With recent advancements in diffusion models, users can generate high-quality images by writing text prompts in natural language. However, generating images with desired details requires proper prompts, and it is often unclear how a model…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Zijie J. Wang , Evan Montoya , David Munechika , Haoyang Yang , Benjamin Hoover , Duen Horng Chau

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Ruyi Gan , Xiaojun Wu , Junyu Lu , Yuanhe Tian , Dixiang Zhang , Ziwei Wu , Renliang Sun , Chang Liu , Jiaxing Zhang , Pingjian Zhang , Yan Song

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu