English
Related papers

Related papers: Latent Inversion with Timestep-aware Sampling for …

200 papers

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jaeseok Lee , Jaekoo Lee

Despite the impressive generative capabilities of diffusion models, existing diffusion model-based style transfer methods require inference-stage optimization (e.g. fine-tuning or textual inversion of style) which is time-consuming, or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jiwoo Chung , Sangeek Hyun , Jae-Pil Heo

Text-to-3D with diffusion models has achieved remarkable progress in recent years. However, existing methods either rely on score distillation-based optimization which suffer from slow inference, low diversity and Janus problems, or are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jiahao Li , Hao Tan , Kai Zhang , Zexiang Xu , Fujun Luan , Yinghao Xu , Yicong Hong , Kalyan Sunkavalli , Greg Shakhnarovich , Sai Bi

In layout-to-image (L2I) synthesis, controlled complex scenes are generated from coarse information like bounding boxes. Such a task is exciting to many downstream applications because the input layouts offer strong guidance to the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruyu Wang , Xuefeng Hou , Sabrina Schmedding , Marco F. Huber

Tuning-free diffusion-based models have demonstrated significant potential in the realm of image personalization and customization. However, despite this notable progress, current models continue to grapple with several complex challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Haofan Wang , Matteo Spinelli , Qixun Wang , Xu Bai , Zekui Qin , Anthony Chen

Text-to-Image editing using diffusion models faces challenges in balancing content preservation with edit application and handling real-image editing. To address these, we propose LAMS-Edit, leveraging intermediate states from the inversion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wingwa Fu , Takayuki Okatani

Scene text editing aims to modify text in a target region of an image while preserving surrounding background style and texture. Existing methods rely solely on image background information while neglecting the visual details of target…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Hongxi Li , Tong Wang , Chengjing Wu , Tianbao Liu , Jiangtao Yao , Xiaochao Qu , Xinxiao Wu , Luoqi Liu , Ting Liu

The diffusion-based generative models have achieved remarkable success in text-based image generation. However, since it contains enormous randomness in generation progress, it is still challenging to apply such models for real-world visual…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Chenyang Qi , Xiaodong Cun , Yong Zhang , Chenyang Lei , Xintao Wang , Ying Shan , Qifeng Chen

The reliance on implicit point matching via attention has become a core bottleneck in drag-based editing, resulting in a fundamental compromise on weakened inversion strength and costly test-time optimization (TTO). This compromise severely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Zixin Yin , Xili Dai , Duomin Wang , Xianfang Zeng , Lionel M. Ni , Gang Yu , Heung-Yeung Shum

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Image enhancement finds wide-ranging applications in real-world scenarios due to complex environments and the inherent limitations of imaging devices. Recent diffusion-based methods yield promising outcomes but necessitate prolonged and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yixuan Zhu , Haolin Wang , Ao Li , Wenliang Zhao , Yansong Tang , Jingxuan Niu , Lei Chen , Jie Zhou , Jiwen Lu

Diffusion models are able to generate photorealistic images in arbitrary scenes. However, when applying diffusion models to image translation, there exists a trade-off between maintaining spatial structure and high-quality content. Besides,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Shiqi Sun , Shancheng Fang , Qian He , Wei Liu

This paper proposes Instruct 4D-to-4D that achieves 4D awareness and spatial-temporal consistency for 2D diffusion models to generate high-quality instruction-guided dynamic scene editing results. Traditional applications of 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Linzhan Mou , Jun-Kun Chen , Yu-Xiong Wang

Robust invisible watermarking aims to embed hidden messages into images such that they survive various manipulations while remaining imperceptible. However, powerful diffusion-based image generation and editing models now enable realistic…

Cryptography and Security · Computer Science 2025-11-11 Wenkai Fu , Finn Carter , Yue Wang , Emily Davis , Bo Zhang

The artistic style within a painting is the means of expression, which includes not only the painting material, colors, and brushstrokes, but also the high-level attributes including semantic elements, object shapes, etc. Previous arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yuxin Zhang , Nisha Huang , Fan Tang , Haibin Huang , Chongyang Ma , Weiming Dong , Changsheng Xu

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

We introduce precise object silhouette as a new form of user control in text-to-image diffusion models, which we dub Shape-Guided Diffusion. Our training-free method uses an Inside-Outside Attention mechanism during the inversion and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Dong Huk Park , Grace Luo , Clayton Toste , Samaneh Azadi , Xihui Liu , Maka Karalashvili , Anna Rohrbach , Trevor Darrell

Diffusion models have emerged as the leading approach for image synthesis, demonstrating exceptional photorealism and diversity. However, training diffusion models at high resolutions remains computationally prohibitive, and existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Tobias Vontobel , Seyedmorteza Sadat , Farnood Salehi , Romann M. Weber

As research on image inversion advances, the process is generally divided into two stages. The first step is Image Embedding, involves using an encoder or optimization procedure to embed an image and obtain its corresponding latent code.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Xuekun Zhao , Pu Cao , Xiaoya Yang , Mingjian Zhang , Lu Yang , Qing Song

Recent advancements in diffusion models have significantly broadened the possibilities for editing images of real-world objects. However, performing non-rigid transformations, such as changing the pose of objects or image-based…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Potito Aghilar , Vito Walter Anelli , Michelantonio Trizio , Tommaso Di Noia