English
Related papers

Related papers: ScriptViT: Vision Transformer-Based Personalized H…

200 papers

Personalized text-to-image generation aims to create images tailored to user-defined concepts and textual descriptions. Balancing the fidelity of the learned concept with its ability for generation in various contexts presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Vera Soboleva , Maksim Nakhodnov , Aibek Alanov

Stylized Text-to-Image Generation (STIG) aims to generate images from text prompts and style reference images. In this paper, we present ArtWeaver, a novel framework that leverages pretrained Stable Diffusion (SD) to address challenges such…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Chengming Xu , Kai Hu , Qilin Wang , Donghao Luo , Jiangning Zhang , Xiaobin Hu , Yanwei Fu , Chengjie Wang

Existing handwritten text generation methods often require more than ten handwriting samples as style references. However, in practical applications, users tend to prefer a handwriting generation model that operates with just a single…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Gang Dai , Yifan Zhang , Quhui Ke , Qiangya Guo , Shuangping Huang

Handwriting stroke generation is crucial for improving the performance of tasks such as handwriting recognition and writers order recovery. In handwriting stroke generation, it is significantly important to imitate the sample calligraphic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Sidra Hanif , Longin Jan Latecki

Text style transfer is the task of transferring the style of text having certain stylistic attributes, while preserving non-stylistic or content information. In this work we introduce the Generative Style Transformer (GST) - a new approach…

Computation and Language · Computer Science 2019-08-27 Akhilesh Sudhakar , Bhargav Upadhyay , Arjun Maheswaran

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Jindong Jiang , Di Liu , Licheng Yu , Xiaoliang Dai , Ankit Ramchandani , Guan Pang , Dimitris N. Metaxas , Praveen Krishnan

Visual Story-Telling is the process of forming a multi-sentence story from a set of images. Appropriately including visual variation and contextual information captured inside the input images is one of the most challenging aspects of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Zainy M. Malakan , Ghulam Mubashar Hassan , Ajmal Mian

This work focuses on generating high-quality images with specific style of reference images and content of provided textual descriptions. Current leading algorithms, i.e., DreamBooth and LoRA, require fine-tuning for each style, leading to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Zhouxia Wang , Xintao Wang , Liangbin Xie , Zhongang Qi , Ying Shan , Wenping Wang , Ping Luo

The Transformer architecture is shown to provide a powerful machine transduction framework for online handwritten gestures corresponding to glyph strokes of natural language sentences. The attention mechanism is successfully used to create…

Computation and Language · Computer Science 2023-05-08 G. C. M. Silvestre , F. Balado , O. Akinremi , M. Ramo

We build on the Visual Autoregressive Modeling (VAR) framework and formulate style transfer as conditional discrete sequence modeling in a learned latent space. Images are decomposed into multi-scale representations and tokenized into…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Liqi Jing , Dingming Zhang , Peinian Li , Lichen Zhu , Yang Xu , Hanyu Xing

Existing handwritten text generation methods primarily focus on isolated words. However, realistic handwritten text demands attention not only to individual words but also to the relationships between them, such as vertical alignment and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Gang Dai , Yifan Zhang , Yutao Qin , Qiangya Guo , Shuangping Huang , Shuicheng Yan

Generative AI is transforming image synthesis, enabling the creation of high-quality, diverse, and photorealistic visuals across industries like design, media, healthcare, and autonomous systems. Advances in techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Fouad Bousetouane

Generative adversarial networks (GANs) have proven hugely successful in variety of applications of image processing. However, generative adversarial networks for handwriting is relatively rare somehow because of difficulty of handling…

Machine Learning · Computer Science 2020-02-28 Bo Ji , Tianyi Chen

Most people think that their handwriting is unique and cannot be imitated by machines, especially not using completely new content. Current cursive handwriting synthesis is visually limited or needs user interaction. We show that…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Martin Mayr , Martin Stumpf , Anguelos Nicolaou , Mathias Seuret , Andreas Maier , Vincent Christlein

Referring image segmentation is a fundamental vision-language task that aims to segment out an object referred to by a natural language expression from an image. One of the key challenges behind this task is leveraging the referring…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Text-driven style transfer aims to merge the style of a reference image with content described by a text prompt. Recent advancements in text-to-image models have improved the nuance of style transformations, yet significant challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Mingkun Lei , Xue Song , Beier Zhu , Hao Wang , Chi Zhang

Image generation based on text-to-image generation models is a task with practical application scenarios that fine-grained styles cannot be precisely described and controlled in natural language, while the guidance information of stylized…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Shuochen Chang

Although diffusion models exhibit impressive generative capabilities, existing methods for stylized image generation based on these models often require textual inversion or fine-tuning with style images, which is time-consuming and limits…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xin Ma , Yaohui Wang , Xinyuan Chen , Tien-Tsin Wong , Cunjian Chen

Previous works on font generation mainly focus on the standard print fonts where character's shape is stable and strokes are clearly separated. There is rare research on brush handwriting font generation, which involves holistic structure…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Shaozu Yuan , Ruixue Liu , Meng Chen , Baoyang Chen , Zhijie Qiu , Xiaodong He

Fingerspelling in sign language has been the means of communicating technical terms and proper nouns when they do not have dedicated sign language gestures. Automatic recognition of fingerspelling can help resolve communication barriers…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Kamala Gajurel , Cuncong Zhong , Guanghui Wang