English
Related papers

Related papers: Font Style Interpolation with Diffusion Models

200 papers

Conditional diffusion models can create unseen images in various settings, aiding image interpolation. Interpolation in latent spaces is well-studied, but interpolation with specific conditions like text or poses is less understood. Simple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Qiyuan He , Jinghao Wang , Ziwei Liu , Angela Yao

This study proposes a UI interface generation method based on a diffusion model, aiming to achieve high-quality, diversified, and personalized interface design through generative artificial intelligence technology. The diffusion model is…

Human-Computer Interaction · Computer Science 2025-03-27 Yifei Duan , Liuqingqing Yang , Tong Zhang , Zhijun Song , Fenghua Shao

In order to generate novel 3D shapes with machine learning, one must allow for interpolation. The typical approach for incorporating this creative process is to interpolate in a learned latent space so as to avoid the problem of generating…

Graphics · Computer Science 2020-01-28 Austin Dill , Songwei Ge , Eunsu Kang , Chun-Liang Li , Barnabas Poczos

Diffusion models have become the go-to method for many generative tasks, particularly for image-to-image generation tasks such as super-resolution and inpainting. Current diffusion-based methods do not provide statistical guarantees…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Eliahu Horwitz , Yedid Hoshen

Chinese, Japanese, and Korean (CJK), with a vast number of native speakers, have profound influence on society and culture. The typesetting of CJK languages carries a wide range of requirements due to the complexity of their scripts and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yingtao Tian

Object tracking is a fundamental task in computer vision, requiring the localization of objects of interest across video frames. Diffusion models have shown remarkable capabilities in visual generation, making them well-suited for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Pha Nguyen , Ngan Le , Jackson Cothren , Alper Yilmaz , Khoa Luu

In this study, we aim to enhance the capabilities of diffusion-based text-to-image (T2I) generation models by integrating diverse modalities beyond textual descriptions within a unified framework. To this end, we categorize widely used…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Sungnyun Kim , Junsoo Lee , Kibeom Hong , Daesik Kim , Namhyuk Ahn

Handwritten Text Generation (HTG) conditioned on text and style is a challenging task due to the variability of inter-user characteristics and the unlimited combinations of characters that form new words unseen during training. Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Konstantina Nikolaidou , George Retsinas , Giorgos Sfikas , Marcus Liwicki

Our goal is to generate fonts with specific impressions, by training a generative adversarial network with a font dataset with impression labels. The main difficulty is that font impression is ambiguous and the absence of an impression…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Seiya Matsuda , Akisato Kimura , Seiichi Uchida

Creating visually appealing composites requires optimizing both text and background for compatibility. Previous methods have focused on simple design strategies, such as changing text color or adding background shapes for contrast. These…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Marian Lupascu , Ionut Mironica , Mihai-Sorin Stupariu

Handwriting stroke generation is crucial for improving the performance of tasks such as handwriting recognition and writers order recovery. In handwriting stroke generation, it is significantly important to imitate the sample calligraphic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Sidra Hanif , Longin Jan Latecki

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

Machine Learning · Statistics 2025-06-13 Justin Le

Image interpolation based on diffusion models is promising in creating fresh and interesting images. Advanced interpolation methods mainly focus on spherical linear interpolation, where images are encoded into the noise space and then…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 PengFei Zheng , Yonggang Zhang , Zhen Fang , Tongliang Liu , Defu Lian , Bo Han

Diffusion models have shown great promise in synthesizing visually appealing images. However, it remains challenging to condition the synthesis at a fine-grained level, for instance, synthesizing image pixels following some generic color…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ka Chun Shum , Binh-Son Hua , Duc Thanh Nguyen , Sai-Kit Yeung

Recent diffusion-based generative models show promise in their ability to generate text images, but limitations in specifying the styles of the generated texts render them insufficient in the realm of typographic design. This paper proposes…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 KhayTze Peong , Seiichi Uchida , Daichi Haraguchi

Synthesizing visually impressive images that seamlessly align both text prompts and specific artistic styles remains a significant challenge in Text-to-Image (T2I) diffusion models. This paper introduces StyleBlend, a method designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Zichong Chen , Shijin Wang , Yang Zhou

In this paper, we propose Calliffusion, a system for generating high-quality Chinese calligraphy using diffusion models. Our model architecture is based on DDPM (Denoising Diffusion Probabilistic Models), and it is capable of generating…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Qisheng Liao , Gus Xia , Zhinuo Wang

Typography is a ubiquitous art form that affects our understanding, perception, and trust in what we read. Thousands of different font-faces have been created with enormous variations in the characters. In this paper, we learn the style of…

Computer Vision and Pattern Recognition · Computer Science 2016-03-15 Shumeet Baluja

Cross-Modal learning tasks have picked up pace in recent times. With plethora of applications in diverse areas, generation of novel content using multiple modalities of data has remained a challenging problem. To address the same, various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Nikhil Verma

Scene text editing is a challenging task that involves modifying or inserting specified texts in an image while maintaining its natural and realistic appearance. Most previous approaches to this task rely on style-transfer models that crop…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jiabao Ji , Guanhua Zhang , Zhaowen Wang , Bairu Hou , Zhifei Zhang , Brian Price , Shiyu Chang