English
Related papers

Related papers: AmbiGen: Generating Ambigrams from Pre-trained Dif…

200 papers

Diffusion models have become a new generative paradigm for text generation. Considering the discrete categorical nature of text, in this paper, we propose GlyphDiffusion, a novel diffusion approach for text generation via text-guided image…

Computation and Language · Computer Science 2023-05-09 Junyi Li , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

The emergence of Large Language Models (LLMs) has unified language generation tasks and revolutionized human-machine interaction. However, in the realm of image generation, a unified model capable of handling various tasks within a single…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Shitao Xiao , Yueze Wang , Junjie Zhou , Huaying Yuan , Xingrun Xing , Ruiran Yan , Chaofan Li , Shuting Wang , Tiejun Huang , Zheng Liu

Handwriting stroke generation is crucial for improving the performance of tasks such as handwriting recognition and writers order recovery. In handwriting stroke generation, it is significantly important to imitate the sample calligraphic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Sidra Hanif , Longin Jan Latecki

Large-scale text-to-image models that can generate high-quality and diverse images based on textual prompts have shown remarkable success. These models aim ultimately to create complex scenes, and addressing the challenge of multi-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Barak Battash , Amit Rozner , Lior Wolf , Ofir Lindenbaum

Image compression technology eliminates redundant information to enable efficient transmission and storage of images, serving both machine vision and human visual perception. For years, image coding focused on human perception has been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Takahiro Shindo , Yui Tatsumi , Taiju Watanabe , Hiroshi Watanabe

Diffusion-based Handwritten Text Generation (HTG) approaches achieve impressive results on frequent, in-vocabulary words observed at training time and on regular styles. However, they are prone to memorizing training samples and often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Konstantina Nikolaidou , George Retsinas , Giorgos Sfikas , Silvia Cascianelli , Rita Cucchiara , Marcus Liwicki

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo

Recent advancements in text-to-image models, particularly diffusion models, have shown significant promise. However, compositional text-to-image models frequently encounter difficulties in generating high-quality images that accurately…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Song Wen , Guian Fang , Renrui Zhang , Peng Gao , Hao Dong , Dimitris Metaxas

Collective insights from a group of experts have always proven to outperform an individual's best diagnostic for clinical tasks. For the task of medical image segmentation, existing research on AI-based alternatives focuses more on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Aimon Rahman , Jeya Maria Jose Valanarasu , Ilker Hacihaliloglu , Vishal M Patel

Recent data-driven image colorization methods have enabled automatic or reference-based colorization, while still suffering from unsatisfactory and inaccurate object-level color control. To address these issues, we propose a new method…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Jianxin Lin , Peng Xiao , Yijun Wang , Rongju Zhang , Xiangxiang Zeng

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

Generating high-quality labeled image datasets is crucial for training accurate and robust machine learning models in the field of computer vision. However, the process of manually labeling real images is often time-consuming and costly. To…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Michael Shenoda , Edward Kim

Text-to-image diffusion models exhibit remarkable generative capabilities, but lack precise control over object counts and spatial arrangements. This work introduces a two-stage system to address these compositional limitations. The first…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jan-Hendrik Koch , Jonas Krumme , Konrad Gadzicki

Recent diffusion and flow matching models have demonstrated strong capabilities in image generation and editing by progressively removing noise through iterative sampling. While this enables flexible inversion for semantic-preserving edits,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yasong Dai , Zeeshan Hayder , David Ahmedt-Aristizabal , Hongdong Li

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

EasyRead pictograms are simple, visually clear images that represent specific concepts and support comprehension for people with intellectual disabilities, low literacy, or language barriers. The large-scale production of EasyRead content…

Human-Computer Interaction · Computer Science 2026-03-17 Nicolas Dickenmann , Yanis Merzouki , Sonia Laguna , Thy Nowak-Tran , Emanuele Palumbo , Julia E. Vogt , Gerda Binder

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

Homonyms are words with identical spelling but distinct meanings, which pose challenges for many generative models. When a homonym appears in a prompt, diffusion models may generate multiple senses of the word simultaneously, which is known…

Computation and Language · Computer Science 2025-09-30 Evgeny Kaskov , Elizaveta Petrova , Petr Surovtsev , Anna Kostikova , Ilya Mistiurin , Alexander Kapitanov , Alexander Nagaev

Text-to-image diffusion models have demonstrated remarkable capabilities in transforming textual prompts into coherent images, yet the computational cost of their inference remains a persistent challenge. To address this issue, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yanwu Xu , Yang Zhao , Zhisheng Xiao , Tingbo Hou