English
Related papers

Related papers: One-Shot Diffusion Mimicker for Handwritten Text G…

200 papers

Diffusion models have emerged as the leading approach for text-to-image generation. However, their iterative sampling process, which gradually morphs random noise into coherent images, introduces significant latency that limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Peijie Qiu , Hariharan Ramshankar , Arnau Ramisa , René Vidal , Amit Kumar K C , Vamsi Salaka , Rahul Bhagat

Diffusion models have significantly advanced the fields of image, audio, and video generation, but they depend on an iterative sampling process that causes slow generation. To overcome this limitation, we propose consistency models, a new…

Machine Learning · Computer Science 2023-06-01 Yang Song , Prafulla Dhariwal , Mark Chen , Ilya Sutskever

Diffusion models (DMs) have demonstrated advantageous potential on generative tasks. Widespread interest exists in incorporating DMs into downstream applications, such as producing or editing photorealistic images. However, practical…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yunqing Zhao , Tianyu Pang , Chao Du , Xiao Yang , Ngai-Man Cheung , Min Lin

Diffusion models have demonstrated remarkable synthesis quality and diversity in generating co-speech gestures. However, the computationally intensive sampling steps associated with diffusion models hinder their practicality in real-world…

Graphics · Computer Science 2025-03-24 Yongkang Cheng , Shaoli Huang , Xuelin Chen , Jifeng Ning , Mingming Gong

Few-shot font generation (FFG), which aims to generate a new font with a few examples, is gaining increasing attention due to the significant reduction in labor cost. A typical FFG pipeline considers characters in a standard font library as…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Licheng Tang , Yiyang Cai , Jiaming Liu , Zhibin Hong , Mingming Gong , Minhu Fan , Junyu Han , Jingtuo Liu , Errui Ding , Jingdong Wang

Diffusion models excel in high-quality generation but suffer from slow inference due to iterative sampling. While recent methods have successfully transformed diffusion models into one-step generators, they neglect model size reduction,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Yuanzhi Zhu , Xingchao Liu , Qiang Liu

Text-to-image diffusion models pre-trained on billions of image-text pairs have recently enabled 3D content creation by optimizing a randomly initialized differentiable 3D representation with score distillation. However, the optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Yukun Huang , Jianan Wang , Yukai Shi , Boshi Tang , Xianbiao Qi , Lei Zhang

Text-to-image generation models can create high-quality images from input prompts. However, they struggle to support the consistent generation of identity-preserving requirements for storytelling. Existing approaches to this problem…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Tao Liu , Kai Wang , Senmao Li , Joost van de Weijer , Fahad Shahbaz Khan , Shiqi Yang , Yaxing Wang , Jian Yang , Ming-Ming Cheng

We present a new method for making diffusion models faster to sample. The method distills many-step diffusion models into few-step models by matching conditional expectations of the clean data given noisy data along the sampling trajectory.…

Machine Learning · Computer Science 2024-06-07 Tim Salimans , Thomas Mensink , Jonathan Heek , Emiel Hoogeboom

One-step generators distilled from Masked Diffusion Models (MDMs) compress multiple sampling steps into a single forward pass, enabling efficient text and image synthesis. However, they suffer two key limitations: they inherit modeling bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

Training machines to synthesize diverse handwritings is an intriguing task. Recently, RNN-based methods have been proposed to generate stylized online Chinese characters. However, these methods mainly focus on capturing a person's overall…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Gang Dai , Yifan Zhang , Qingfeng Wang , Qing Du , Zhuliang Yu , Zhuoman Liu , Shuangping Huang

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

Diffusion models, praised for their success in generative tasks, are increasingly being applied to robotics, demonstrating exceptional performance in behavior cloning. However, their slow generation process stemming from iterative denoising…

Few-step generation has been a long-standing goal, with recent one-step generation methods exemplified by MeanFlow achieving remarkable results. Existing research on MeanFlow primarily focuses on class-to-image generation. However, an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenxi Zhao , Chen Zhu , Xiaokun Feng , Aiming Hao , Jiashu Zhu , Jiachen Lei , Jiahong Wu , Xiangxiang Chu , Jufeng Yang

Face sketch synthesis is a technique aimed at converting face photos into sketches. Existing face sketch synthesis research mainly relies on training with numerous photo-sketch sample pairs from existing datasets. However, these large-scale…

Graphics · Computer Science 2025-06-19 Han Wu , Junyao Li , Kangbo Zhao , Sen Zhang , Yukai Shi , Liang Lin

This paper introduces a discrete diffusion model (DDM) framework for text-aligned speech tokenization and reconstruction. By replacing the auto-regressive speech decoder with a discrete diffusion counterpart, our model achieves…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Pin-Jui Ku , He Huang , Jean-Marie Lemercier , Subham Sekhar Sahoo , Zhehuai Chen , Ante Jukić

Diffusion-based Handwritten Text Generation (HTG) approaches achieve impressive results on frequent, in-vocabulary words observed at training time and on regular styles. However, they are prone to memorizing training samples and often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Konstantina Nikolaidou , George Retsinas , Giorgos Sfikas , Silvia Cascianelli , Rita Cucchiara , Marcus Liwicki

Diffusion models have revolutionized text-to-image generation with its exceptional quality and creativity. However, its multi-step sampling process is known to be slow, often requiring tens of inference steps to obtain satisfactory results.…

Machine Learning · Computer Science 2024-03-26 Xingchao Liu , Xiwen Zhang , Jianzhu Ma , Jian Peng , Qiang Liu

The primary goal of this work is to systematically evaluate the intra-finger variability of synthetic fingerprints (particularly latent prints) generated using a state-of-the-art diffusion model. Specifically, we focus on enhancing the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Noor Hussein , Anil K. Jain , Karthik Nandakumar

Layout generation aims to synthesize realistic graphic scenes consisting of elements with different attributes including category, size, position, and between-element relation. It is a crucial task for reducing the burden on heavy-duty…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Mude Hui , Zhizheng Zhang , Xiaoyi Zhang , Wenxuan Xie , Yuwang Wang , Yan Lu