English
Related papers

Related papers: Training-Free Sketch-Guided Diffusion with Latent …

200 papers

Recent text-to-image (T2I) diffusion models show outstanding performance in generating high-quality images conditioned on textual prompts. However, they fail to semantically align the generated images with the prompts due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ruichen Wang , Zekang Chen , Chen Chen , Jian Ma , Haonan Lu , Xiaodong Lin

Recent progress in text-to-3D generation has been achieved through the utilization of score distillation methods: they make use of the pre-trained text-to-image (T2I) diffusion models by distilling via the diffusion model training…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Kyungmin Lee , Kihyuk Sohn , Jinwoo Shin

Text-to-image (T2I) diffusion models have demonstrated impressive performance in generating high-fidelity images, largely enabled by text-guided inference. However, this advantage often comes with a critical drawback: limited diversity, as…

Graphics · Computer Science 2026-03-17 Byungjun Kim , Soobin Um , Jong Chul Ye

Current text-to-image generation models often struggle to follow textual instructions, especially the ones requiring spatial reasoning. On the other hand, Large Language Models (LLMs), such as GPT-4, have shown remarkable precision in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Tianjun Zhang , Yi Zhang , Vibhav Vineet , Neel Joshi , Xin Wang

Diffusion models have demonstrated remarkable performance in text-to-image synthesis, producing realistic and high resolution images that faithfully adhere to the corresponding text-prompts. Despite their great success, they still fall…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Ilias Mitsouras , Eleftherios Tsonis , Paraskevi Tzouveli , Athanasios Voulodimos

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Jindong Jiang , Di Liu , Licheng Yu , Xiaoliang Dai , Ankit Ramchandani , Guan Pang , Dimitris N. Metaxas , Praveen Krishnan

Text-to-image generation has evolved beyond single monolithic models to complex multi-component pipelines. These combine fine-tuned generators, adapters, upscaling blocks and even editing steps, leading to significant improvements in image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Uri Gadot , Rinon Gal , Yftah Ziser , Gal Chechik , Shie Mannor

Recent diffusion-based generative models show promise in their ability to generate text images, but limitations in specifying the styles of the generated texts render them insufficient in the realm of typographic design. This paper proposes…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 KhayTze Peong , Seiichi Uchida , Daichi Haraguchi

Controllable image generation has always been one of the core demands in image generation, aiming to create images that are both creative and logical while satisfying additional specified conditions. In the post-AIGC era, controllable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Guandong Li

Topology optimization (TO) is employed in engineering to optimize structural performance while maximizing material efficiency. However, traditional TO methods incur significant computational and time costs. Although research has leveraged…

Human-Computer Interaction · Computer Science 2026-03-20 Shuyue Feng , Cedric Caremel , Yoshihiro Kawahara

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

Integrating motion into static images not only enhances visual expressiveness but also creates a sense of immersion and temporal depth, establishing it as a longstanding and impactful theme in artistic expression. Fluid elements such as…

Graphics · Computer Science 2025-10-21 Hao Jin , Haoran Xie

With the advent of diffusion models, Text-to-Image (T2I) generation has seen substantial advancements. Current T2I models allow users to specify object colors using linguistic color names, and some methods aim to personalize color-object…

Graphics · Computer Science 2025-08-13 Qianru Qiu , Jiafeng Mao , Xueting Wang

Controllable image synthesis with user scribbles has gained huge public interest with the recent advent of text-conditioned latent diffusion models. The user scribbles control the color composition while the text prompt provides control…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jaskirat Singh , Stephen Gould , Liang Zheng

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

Recently, diffusion models have made remarkable progress in text-to-image (T2I) generation, synthesizing images with high fidelity and diverse contents. Despite this advancement, latent space smoothness within diffusion models remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jiayi Guo , Xingqian Xu , Yifan Pu , Zanlin Ni , Chaofei Wang , Manushree Vasu , Shiji Song , Gao Huang , Humphrey Shi

As recent advances in large-scale Text-to-Image (T2I) diffusion models have yielded remarkable high-quality image generation, diverse downstream Image-to-Image (I2I) applications have emerged. Despite the impressive results achieved by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Geonung Kim , Beomsu Kim , Eunhyeok Park , Sunghyun Cho

Text-to-image (TTI) diffusion models have demonstrated impressive results in generating high-resolution images of complex and imaginative scenes. Recent approaches have further extended these methods with personalization techniques that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Tanzila Rahman , Shweta Mahajan , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Leonid Sigal

Flow matching and diffusion models have shown impressive results in text-to-image generation, producing photorealistic images through an iterative denoising process. A common strategy to speed up synthesis is to perform early denoising at…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Jyun-Ze Tang , Chih-Fan Hsu , Jeng-Lin Li , Ming-Ching Chang , Wei-Chao Chen

There has been tremendous progress in large-scale text-to-image synthesis driven by diffusion models enabling versatile downstream applications such as 3D object synthesis from texts, image editing, and customized generation. We present a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ting-Hsuan Liao , Songwei Ge , Yiran Xu , Yao-Chih Lee , Badour AlBahar , Jia-Bin Huang