中文
相关论文

相关论文: Neutral Editing Framework for Diffusion-based Vide…

200 篇论文

Despite recent progress in diffusion-based video editing, existing methods are limited to short-length videos due to the contradiction between long-range consistency and frame-wise editing. Prior attempts to address this challenge by…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Jia-Wei Liu , Yan-Pei Cao , Jay Zhangjie Wu , Weijia Mao , Yuchao Gu , Rui Zhao , Jussi Keppo , Ying Shan , Mike Zheng Shou

Image editing has advanced significantly with the development of diffusion models using both inversion-based and instruction-based methods. However, current inversion-based approaches struggle with big modifications (e.g., adding or…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Yaowei Li , Yuxuan Bian , Xuan Ju , Zhaoyang Zhang , Junhao Zhuang , Ying Shan , Yuexian Zou , Qiang Xu

Recent endeavors in video editing have showcased promising results in single-attribute editing or style transfer tasks, either by training text-to-video (T2V) models on text-video data or adopting training-free methods. However, when…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Hyeonho Jeong , Jong Chul Ye

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges emerge especially…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Rui Jiang , Xinghe Fu , Guangcong Zheng , Teng Li , Taiping Yao , Xi Li

Face editing modifies the appearance of face, which plays a key role in customization and enhancement of personal images. Although much work have achieved remarkable success in text-driven face editing, they still face significant…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Xin Zhang , Siting Huang , Xiangyang Luo , Yifan Xie , Weijiang Yu , Heng Chang , Fei Ma , Fei Yu

Research in vision-language models has seen rapid developments off-late, enabling natural language-based interfaces for image generation and manipulation. Many existing text guided manipulation techniques are restricted to specific classes…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Paramanand Chandramouli , Kanchana Vaishnavi Gandikota

Diffusion models have demonstrated remarkable capabilities in text-to-image and text-to-video generation, opening up possibilities for video editing based on textual input. However, the computational cost associated with sequential sampling…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Youyuan Zhang , Xuan Ju , James J. Clark

Diffusion-based video editing have reached impressive quality and can transform either the global style, local structure, and attributes of given video inputs, following textual edit prompts. However, such solutions typically incur heavy…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Kumara Kahatapitiya , Adil Karjauv , Davide Abati , Fatih Porikli , Yuki M. Asano , Amirhossein Habibian

3D object editing is essential for interactive content creation in gaming, animation, and robotics, yet current approaches remain inefficient, inconsistent, and often fail to preserve unedited regions. Most methods rely on editing…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Junliang Ye , Shenghao Xie , Ruowen Zhao , Zhengyi Wang , Hongyu Yan , Wenqiang Zu , Lei Ma , Jun Zhu

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

The text-driven image and video diffusion models have achieved unprecedented success in generating realistic and diverse content. Recently, the editing and variation of existing images and videos in diffusion-based generative models have…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Yuyang Zhao , Enze Xie , Lanqing Hong , Zhenguo Li , Gim Hee Lee

In image editing, it is essential to incorporate a context image to convey the user's precise requirements, such as subject appearance or image style. Existing training-based visual context-aware editing methods incur data collection effort…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Rui Song , Guo-Hua Wang , Qing-Guo Chen , Weihua Luo , Tongda Xu , Zhening Liu , Yan Wang , Zehong Lin , Jun Zhang

Reconstructing 3D scenes and synthesizing novel views from sparse input views is a highly challenging task. Recent advances in video diffusion models have demonstrated strong temporal reasoning capabilities, making them a promising tool for…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Yuqi Zhang , Guanying Chen , Jiaxing Chen , Chuanyu Fu , Chuan Huang , Shuguang Cui

With the rapid development of generative technology, current generative models can generate high-fidelity digital content and edit it in a controlled manner. However, there is a risk that malicious individuals might misuse these…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Junjie Cao , Kaizhou Li , Xinchun Yu , Hongxiang Li , Xiaoping Zhang

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Diffusion models have made significant advances in text-guided synthesis tasks. However, editing user-provided images remains challenging, as the high dimensional noise input space of diffusion models is not naturally suited for image…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Jiteng Mu , Michaël Gharbi , Richard Zhang , Eli Shechtman , Nuno Vasconcelos , Xiaolong Wang , Taesung Park

Although powerful for image generation, consistent and controllable video is a longstanding problem for diffusion models. Video models require extensive training and computational resources, leading to high costs and large environmental…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Muhammad Haaris Khan , Hadrien Reynaud , Bernhard Kainz

Despite the ability of existing large-scale text-to-image (T2I) models to generate high-quality images from detailed textual descriptions, they often lack the ability to precisely edit the generated or real images. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Text-guided video-to-video stylization transforms the visual appearance of a source video to a different appearance guided on textual prompts. Existing text-guided image diffusion models can be extended for stylized video synthesis.…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Minshan Xie , Hanyuan Liu , Chengze Li , Tien-Tsin Wong