中文
相关论文

相关论文: Null-text Inversion for Editing Real Images using …

200 篇论文

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

机器学习 · 计算机科学 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

多媒体 · 计算机科学 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

Diffusion-based Image Editing (DIE) is an emerging research hot-spot, which often applies a semantic mask to control the target area for diffusion-based editing. However, most existing solutions obtain these masks via manual operations or…

计算机视觉与模式识别 · 计算机科学 2024-01-24 Siyu Zou , Jiji Tang , Yiyi Zhou , Jing He , Chaoyi Zhao , Rongsheng Zhang , Zhipeng Hu , Xiaoshuai Sun

Recent strides in the development of diffusion models, exemplified by advancements such as Stable Diffusion, have underscored their remarkable prowess in generating visually compelling images. However, the imperative of achieving a seamless…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Xiefan Guo , Jinlin Liu , Miaomiao Cui , Jiankai Li , Hongyu Yang , Di Huang

Recent advancements in text-to-image diffusion models have demonstrated remarkable success, yet they often struggle to fully capture the user's intent. Existing approaches using textual inputs combined with bounding boxes or region masks…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Seonho Lee , Jiho Choi , Seohyun Lim , Jiwook Kim , Hyunjung Shim

Large-scale text-to-image generative models have shown remarkable ability to synthesize diverse and high-quality images. However, it is still challenging to directly apply these models for editing real images for two reasons. First, it is…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Syed Muhmmad Israr , Feng Zhao

Diffusion models have achieved remarkable success in image generation and editing tasks. Inversion within these models aims to recover the latent noise representation for a real or generated image, enabling reconstruction, editing, and…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Zixiang Li , Haoyu Wang , Wei Wang , Chuangchuang Tan , Yunchao Wei , Yao Zhao

Diffusion model based language-guided image editing has achieved great success recently. However, existing state-of-the-art diffusion models struggle with rendering correct text and text style during generation. To tackle this problem, we…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Haoxing Chen , Zhuoer Xu , Zhangxuan Gu , Jun Lan , Xing Zheng , Yaohui Li , Changhua Meng , Huijia Zhu , Weiqiang Wang

Recent advances in generative AI have significantly enhanced image and video editing, particularly in the context of text prompt control. State-of-the-art approaches predominantly rely on diffusion models to accomplish these tasks. However,…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Haoyu Ma , Shahin Mahdizadehaghdam , Bichen Wu , Zhipeng Fan , Yuchao Gu , Wenliang Zhao , Lior Shapira , Xiaohui Xie

Large-scale text-to-image diffusion models achieve unprecedented success in image generation and editing. However, how to extend such success to video editing is unclear. Recent initial attempts at video editing require significant…

计算机视觉与模式识别 · 计算机科学 2024-01-05 Wen Wang , Yan Jiang , Kangyang Xie , Zide Liu , Hao Chen , Yue Cao , Xinlong Wang , Chunhua Shen

This paper proposes a novel and physically interpretable method for face editing based on arbitrary text prompts. Different from previous GAN-inversion-based face editing methods that manipulate the latent space of GANs, or diffusion-based…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Yapeng Meng , Songru Yang , Xu Hu , Rui Zhao , Lincheng Li , Zhenwei Shi , Zhengxia Zou

Diffusion models have revolutionized the field of content synthesis and editing. Recent models have replaced the traditional UNet architecture with the Diffusion Transformer (DiT), and employed flow-matching for improved training and…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Omri Avrahami , Or Patashnik , Ohad Fried , Egor Nemchinov , Kfir Aberman , Dani Lischinski , Daniel Cohen-Or

The recent success of text-to-image generation diffusion models has also revolutionized semantic image editing, enabling the manipulation of images based on query/target texts. Despite these advancements, a significant challenge lies in the…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Zuopeng Yang , Tianshu Chu , Xin Lin , Erdun Gao , Daqing Liu , Jie Yang , Chaoyue Wang

Image inversion is a fundamental task in generative models, aiming to map images back to their latent representations to enable downstream applications such as editing, restoration, and style transfer. This paper provides a comprehensive…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Yinan Chen , Jiangning Zhang , Yali Bi , Xiaobin Hu , Teng Hu , Zhucun Xue , Ran Yi , Yong Liu , Ying Tai

Diffusion probabilistic models (DPMs) are a key component in modern generative models. DPM-solvers have achieved reduced latency and enhanced quality significantly, but have posed challenges to find the exact inverse (i.e., finding the…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Seongmin Hong , Kyeonghyun Lee , Suh Yoon Jeon , Hyewon Bae , Se Young Chun

Recovering degraded low-resolution text images is challenging, especially for Chinese text images with complex strokes and severe degradation in real-world scenarios. Ensuring both text fidelity and style realness is crucial for…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Yuzhe Zhang , Jiawei Zhang , Hao Li , Zhouxia Wang , Luwei Hou , Dongqing Zou , Liheng Bian

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Image inpainting aims to fill in the missing pixels with visually coherent and semantically plausible content. Despite the great progress brought from deep generative models, this task still suffers from i. the difficulties in large-scale…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Siyuan Yang , Lu Zhang , Liqian Ma , Yu Liu , JingJing Fu , You He

Diffusion models gain increasing popularity for their generative capabilities. Recently, there have been surging needs to generate customized images by inverting diffusion models from exemplar images, and existing inversion methods mainly…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Ziqi Huang , Tianxing Wu , Yuming Jiang , Kelvin C. K. Chan , Ziwei Liu

Recent advances in diffusion models have enabled high-quality image generation, leading to increasing demand for post-generation editing that modifies local regions while preserving global structure. Achieving such flexible and precise…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Hanyi Wang , Han Fang , Zheng Wang , Shilin Wang , Ee-Chien Chang