English
Related papers

Related papers: Text-Conditioned Diffusion Model for High-Fidelity…

200 papers

Diffusion models have become a new generative paradigm for text generation. Considering the discrete categorical nature of text, in this paper, we propose GlyphDiffusion, a novel diffusion approach for text generation via text-guided image…

Computation and Language · Computer Science 2023-05-09 Junyi Li , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Automatic font generation is an imitation task, which aims to create a font library that mimics the style of reference images while preserving the content from source images. Although existing font generation methods have achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Zhenhua Yang , Dezhi Peng , Yuxin Kong , Yuyi Zhang , Cong Yao , Lianwen Jin

Automatic font generation remains a challenging research issue, primarily due to the vast number of Chinese characters, each with unique and intricate structures. Our investigation of previous studies reveals inherent bias capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Mobai Xue , Jun Du , Zhenrong Zhang , Jiefeng Ma , Qikai Chang , Pengfei Hu , Jianshu Zhang , Yu Hu

The generation of Chinese fonts has a wide range of applications. The currently predominated methods are mainly based on deep generative models, especially the generative adversarial networks (GANs). However, existing GAN-based models…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Jinshan Zeng , Yefei Wang , Qi Chen , Yunxin Liu , Mingwen Wang , Yuan Yao

In this paper, we propose and end-to-end deep Chinese font generation system. This system can generate new style fonts by interpolation of latent style-related embeding variables that could achieve smooth transition between different style.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Fenxi Xiao , Bo Huang , Xia Wu

This paper presents a GAN for generating images of handwritten lines conditioned on arbitrary text and latent style vectors. Unlike prior work, which produce stroke points or single-word images, this model generates entire lines of offline…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Brian Davis , Chris Tensmeyer , Brian Price , Curtis Wigington , Bryan Morse , Rajiv Jain

Talking Face Generation (TFG) strives to create realistic and emotionally expressive digital faces. While previous TFG works have mastered the creation of naturalistic facial movements, they typically express a fixed target emotion in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hao Yang , Yanyan Zhao , Tian Zheng , Hongbo Zhang , Bichen Wang , Di Wu , Xing Fu , Xuda Zhi , Yongbo Huang , Hao He

Generative models now produce images with such stunning realism that they can easily deceive the human eye. While this progress unlocks vast creative potential, it also presents significant risks, such as the spread of misinformation.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Yichi Zhang , Xiaogang Xu

The current state-of-the-art Diffusion model has demonstrated excellent results in generating images. However, the images are monotonous and are mostly the result of the distribution of images of people in the training set, making it…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Tianyu Chen

Developing generative models to create or conditionally create symbolic music presents unique challenges due to the combination of limited data availability and the need for high precision in note pitch. To address these challenges, we…

Sound · Computer Science 2025-06-09 Tingyu Zhu , Haoyu Liu , Ziyu Wang , Zhimin Jiang , Zeyu Zheng

We present a new multi-modal face image generation method that converts a text prompt and a visual input, such as a semantic mask or scribble map, into a photo-realistic face image. To do this, we combine the strengths of Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Jihyun Kim , Changjae Oh , Hoseok Do , Soohyun Kim , Kwanghoon Sohn

Chinese character style transfer is a very challenging problem because of the complexity of the glyph shapes or underlying structures and large numbers of existed characters, when comparing with English letters. Moreover, the handwriting of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Qi Wen , Shuang Li , Bingfeng Han , Yi Yuan

Few-shot font generation is challenging, as it needs to capture the fine-grained stroke styles from a limited set of reference glyphs, and then transfer to other characters, which are expected to have similar styles. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Mingshuai Yao , Yabo Zhang , Xianhui Lin , Xiaoming Li , Wangmeng Zuo

Facial attribute editing aims to modify target attributes while preserving attribute-irrelevant content and overall image fidelity. Existing GAN-based methods provide favorable controllability, but often suffer from weak alignment between…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Wenmin Huang , Weiqi Luo , Xiaochun Cao , Jiwu Huang

The generation of stylish Chinese fonts is an important problem involved in many applications. Most of existing generation methods are based on the deep generative models, particularly, the generative adversarial networks (GAN) based…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Jinshan Zeng , Qi Chen , Yunxin Liu , Mingwen Wang , Yuan Yao

Text-conditioned molecular generation aims to translate natural-language descriptions into chemical structures, enabling scientists to specify functional groups, scaffolds, and physicochemical constraints without handcrafted rules.…

Machine Learning · Computer Science 2025-11-18 Lingxiao Li , Haobo Zhang , Bin Chen , Jiayu Zhou

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Conversion of one font to another font is very useful in real life applications. In this paper, we propose a Convolutional Recurrent Generative model to solve the word level font transfer problem. Our network is able to convert the font…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Ankan Kumar Bhunia , Ayan Kumar Bhunia , Prithaj Banerjee , Aishik Konwer , Abir Bhowmick , Partha Pratim Roy , Umapada Pal

Diffusion models have shown promising results for a wide range of generative tasks with continuous data, such as image and audio synthesis. However, little progress has been made on using diffusion models to generate discrete symbolic music…

Sound · Computer Science 2023-10-24 Jincheng Zhang , György Fazekas , Charalampos Saitis

Recently, GAN based speech synthesis methods, such as MelGAN, have become very popular. Compared to conventional autoregressive based methods, parallel structures based generators make waveform generation process fast and stable. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Qiao Tian , Yi Chen , Zewang Zhang , Heng Lu , Linghui Chen , Lei Xie , Shan Liu