English
Related papers

Related papers: Accelerating Text-to-Image Editing via Cache-Enabl…

200 papers

Diffusion models have demonstrated outstanding performance in generative tasks, making them ideal candidates for image editing. Recent studies highlight their ability to apply desired edits effectively by following textual instructions, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Mohammadreza Samadi , Fred X. Han , Mohammad Salameh , Hao Wu , Fengyu Sun , Chunhua Zhou , Di Niu

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han

Image diffusion models have been utilized in various tasks, such as text-to-image generation and controllable image synthesis. Recent research has introduced tuning methods that make subtle adjustments to the original models, yielding…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zeyinzi Jiang , Chaojie Mao , Yulin Pan , Zhen Han , Jingfeng Zhang

Diffusion models represent a powerful family of generative models widely used for image and video generation. However, the time-consuming deployment, long inference time, and requirements on large memory hinder their applications on…

Machine Learning · Computer Science 2025-04-18 Kafeng Wang , Jianfei Chen , He Li , Zhenpeng Mi , Jun Zhu

In this paper, we address the limitations of existing text-to-image diffusion models in generating demographically fair results when given human-related descriptions. These models often struggle to disentangle the target language context…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Jia Li , Lijie Hu , Jingfeng Zhang , Tianhang Zheng , Hua Zhang , Di Wang

Generative image editing using diffusion models has become a prevalent application in today's AI cloud services. In production environments, image editing typically involves a mask that specifies the regions of an image template to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Xiaoxiao Jiang , Suyi Li , Lingyun Yang , Tianyu Feng , Zhipeng Di , Weiyi Lu , Guoxuan Zhu , Xiu Lin , Kan Liu , Yinghao Yu , Tao Lan , Guodong Yang , Lin Qu , Liping Zhang , Wei Wang

One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yifan Gong , Zheng Zhan , Qing Jin , Yanyu Li , Yerlan Idelbayev , Xian Liu , Andrey Zharkov , Kfir Aberman , Sergey Tulyakov , Yanzhi Wang , Jian Ren

Text-guided image editing on real or synthetic images, given only the original image itself and the target text prompt as inputs, is a very general and challenging task. It requires an editing model to estimate by itself which part of the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Shiwen Zhang , Shuai Xiao , Weilin Huang

Autoregressive and diffusion models drive the recent breakthroughs on text-to-image generation. Despite their huge success of generating high-realistic images, a common shortcoming of these models is their high inference latency -…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Zhangyin Feng , Runyi Hu , Liangxin Liu , Fan Zhang , Duyu Tang , Yong Dai , Xiaocheng Feng , Jiwei Li , Bing Qin , Shuming Shi

Text-to-Image Diffusion Models such as Stable-Diffusion and Imagen have achieved unprecedented quality of photorealism with state-of-the-art FID scores on MS-COCO and other generation benchmarks. Given a caption, image generation requires…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Samyadeep Basu , Nanxuan Zhao , Vlad Morariu , Soheil Feizi , Varun Manjunatha

In recent years, there has been significant progress in the development of text-to-image generative models. Evaluating the quality of the generative models is one essential step in the development process. Unfortunately, the evaluation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Lin Zhao , Tianchen Zhao , Zinan Lin , Xuefei Ning , Guohao Dai , Huazhong Yang , Yu Wang

Currently, personalized image generation methods mostly require considerable time to finetune and often overfit the concept resulting in generated images that are similar to custom concepts but difficult to edit by prompts. We propose an…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuxuan Zhang , Yiren Song , Jinpeng Yu , Han Pan , Zhongliang Jing

Diffusion-based models have achieved state-of-the-art performance on text-to-image synthesis tasks. However, one critical limitation of these models is the low fidelity of generated images with respect to the text description, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Qiucheng Wu , Yujian Liu , Handong Zhao , Trung Bui , Zhe Lin , Yang Zhang , Shiyu Chang

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an intuitive editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jooyoung Choi , Yunjey Choi , Yunji Kim , Junho Kim , Sungroh Yoon

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Robin Zbinden

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

Recent advancements in diffusion-based generative image editing have sparked a profound revolution, reshaping the landscape of image outpainting and inpainting tasks. Despite these strides, the field grapples with inherent challenges,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yuxi Ren , Jie Wu , Yanzuo Lu , Huafeng Kuang , Xin Xia , Xionghui Wang , Qianqian Wang , Yixing Zhu , Pan Xie , Shiyin Wang , Xuefeng Xiao , Yitong Wang , Min Zheng , Lean Fu

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

Graphics · Computer Science 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He