中文
相关论文

相关论文: Neutral Editing Framework for Diffusion-based Vide…

200 篇论文

While Unified Vision-Language Models promise to synergistically combine the high-level semantic understanding of vision-language models with the generative fidelity of diffusion models, current editing methodologies remain fundamentally…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Chengyu Bai , Jintao Chen , Xiang Bai , Yilong Chen , Qi She , Ming Lu , Shanghang Zhang

Diffusion models have achieved significant success in image and video generation. This motivates a growing interest in video editing tasks, where videos are edited according to provided text descriptions. However, most existing approaches…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Zhen Xing , Qi Dai , Zihao Zhang , Hui Zhang , Han Hu , Zuxuan Wu , Yu-Gang Jiang

Natural language offers a highly intuitive interface for image editing. In this paper, we introduce the first solution for performing local (region-based) edits in generic natural images, based on a natural language description along with…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Omri Avrahami , Dani Lischinski , Ohad Fried

Point-based image editing enables accurate and flexible control through content dragging. However, the role of text embedding during the editing process has not been thoroughly investigated. A significant aspect that remains unexplored is…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Gayoon Choi , Taejin Jeong , Sujung Hong , Seong Jae Hwang

Instruction-based image editing aims to modify specific content within existing images according to user-provided instructions while preserving non-target regions. Beyond traditional object- and style-centric manipulation, text-centric…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Hui Zhang , Juntao Liu , Zongkai Liu , Liqiang Niu , Fandong Meng , Zuxuan Wu , Yu-Gang Jiang

In this report, we present MagicEdit, a surprisingly simple yet effective solution to the text-guided video editing task. We found that high-fidelity and temporally coherent video-to-video translation can be achieved by explicitly…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Jun Hao Liew , Hanshu Yan , Jianfeng Zhang , Zhongcong Xu , Jiashi Feng

Text-to-image (T2I) diffusion models, with their impressive generative capabilities, have been adopted for image editing tasks, demonstrating remarkable efficacy. However, due to attention leakage and collision between the cross-attention…

计算机视觉与模式识别 · 计算机科学 2025-05-01 Xingxi Yin , Zhi Li , Jingfeng Zhang , Chenglin Li , Yin Zhang

With recent advances in Multimodal Large Language Models (MLLMs) showing strong visual understanding and reasoning, interest is growing in using them to improve the editing performance of diffusion models. Despite rapid progress, most…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Chong Mou , Qichao Sun , Yanze Wu , Pengze Zhang , Xinghui Li , Fulong Ye , Songtao Zhao , Qian He

Recent diffusion-based image editing approaches have exhibited impressive editing capabilities in images with simple compositions. However, localized editing in complex scenarios has not been well-studied in the literature, despite its…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Qi Mao , Lan Chen , Yuchao Gu , Zhen Fang , Mike Zheng Shou

Large-scale pre-trained diffusion models empower users to edit images through text guidance. However, existing methods often over-align with target prompts while inadequately preserving source image semantics. Such approaches generate…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Jianda Mao , Kaibo Wang , Yang Xiang , Kani Chen

Generating novel views of an object from a single image is a challenging task. It requires an understanding of the underlying 3D structure of the object from an image and rendering high-quality, spatially consistent new views. While recent…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Jeong-gi Kwak , Erqun Dong , Yuhe Jin , Hanseok Ko , Shweta Mahajan , Kwang Moo Yi

Video face swapping is becoming increasingly popular across various applications, yet existing methods primarily focus on static images and struggle with video face swapping because of temporal consistency and complex scenarios. In this…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Hao Shao , Shulun Wang , Yang Zhou , Guanglu Song , Dailan He , Shuo Qin , Zhuofan Zong , Bingqi Ma , Yu Liu , Hongsheng Li

The rapid advancement in visual generation, particularly the emergence of pre-trained text-to-image and text-to-video models, has catalyzed growing interest in training-free video editing research. Mirroring training-free image editing…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Lianghan Zhu , Yanqi Bao , Jing Huo , Jing Wu , Yu-Kun Lai , Wenbin Li , Yang Gao

Pose and body shape editing in a human image has received increasing attention. However, current methods often struggle with dataset biases and deteriorate realism and the person's identity when users make large edits. We propose a one-shot…

计算机视觉与模式识别 · 计算机科学 2024-01-09 Yuta Okuyama , Yuki Endo , Yoshihiro Kanamori

Text-guided image editing aims to modify specific regions according to the target prompt while preserving the identity of the source image. Recent methods exploit explicit binary masks to constrain editing, but hard mask boundaries…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Yongwen Lai , Chaoqun Wang , Shaobo Min

Diffusion models are capable of generating impressive images conditioned on text descriptions, and extensions of these models allow users to edit images at a relatively coarse scale. However, the ability to precisely edit the layout,…

计算机视觉与模式识别 · 计算机科学 2024-02-01 Daniel Geng , Andrew Owens

Object-level manipulation, relocating or reorienting objects in images or videos while preserving scene realism, is central to film post-production, AR, and creative editing. Yet existing methods struggle to jointly achieve three core…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Penghui Ruan , Bojia Zi , Xianbiao Qi , Youze Huang , Rong Xiao , Pichao Wang , Jiannong Cao , Yuhui Shi

Recent advances in image editing have been driven by the development of denoising diffusion models, marking a significant leap forward in this field. Despite these advances, the generalization capabilities of recent image editing approaches…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Zichong Meng , Changdi Yang , Jun Liu , Hao Tang , Pu Zhao , Yanzhi Wang

We address the task of multi-view image editing from sparse input views, where the inputs can be seen as a mix of images capturing the scene from different viewpoints. The goal is to modify the scene according to a textual instruction while…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Daniel Gilo , Or Litany

Instruction-based image editing enables precise modifications via natural language prompts, but existing methods face a precision-efficiency tradeoff: fine-tuning demands massive datasets (>10M) and computational resources, while…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Zechuan Zhang , Ji Xie , Yu Lu , Zongxin Yang , Yi Yang