English
Related papers

Related papers: Drag-A-Video: Non-rigid Video Editing with Point-b…

200 papers

Text-based video editing has recently attracted considerable interest in changing the style or replacing the objects with a similar structure. Beyond this, we demonstrate that properties such as shape, size, location, motion, etc., can also…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yue Ma , Xiaodong Cun , Sen Liang , Jinbo Xing , Yingqing He , Chenyang Qi , Siran Chen , Qifeng Chen

In this paper, we propose a novel diffusion-based multi-condition controllable framework for video head swapping, which seamlessly transplant a human head from a static image into a dynamic video, while preserving the original body and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Chaonan Ji , Jinwei Qi , Peng Zhang , Bang Zhang , Liefeng Bo

Large-scale text-to-video models have shown remarkable abilities, but their direct application in video editing remains challenging due to limited available datasets. Current video editing methods commonly require per-video fine-tuning of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Zhenghao Zhang , Zuozhuo Dai , Long Qin , Weizhi Wang

Drag-based editing allows precise object manipulation through point-based control, offering user convenience. However, current methods often suffer from a geometric inconsistency problem by focusing exclusively on matching user-defined…

Graphics · Computer Science 2025-07-14 Gwanhyeong Koo , Sunjae Yoon , Younghwan Lee , Ji Woo Hong , Chang D. Yoo

The text-driven image and video diffusion models have achieved unprecedented success in generating realistic and diverse content. Recently, the editing and variation of existing images and videos in diffusion-based generative models have…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yuyang Zhao , Enze Xie , Lanqing Hong , Zhenguo Li , Gim Hee Lee

This paper presents a novel framework termed Cut-and-Paste for real-word semantic video editing under the guidance of text prompt and additional reference image. While the text-driven video editing has demonstrated remarkable ability to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Zhichao Zuo , Zhao Zhang , Yan Luo , Yang Zhao , Haijun Zhang , Yi Yang , Meng Wang

Instruction-based video editing aims to modify an input video according to a natural-language instruction while preserving content fidelity and temporal coherence. However, existing diffusion-based approaches are often trained on paired…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Xiaoyan Cong , Haotian Yang , Angtian Wang , Yizhi Wang , Yiding Yang , Canyu Zhang , Chongyang Ma

We study object motion path editing in videos, where the goal is to alter a target object's trajectory while preserving the original scene content. Unlike prior video editing methods that primarily manipulate appearance or rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Quynh Phung , Long Mai , Cusuh Ham , Feng Liu , Jia-Bin Huang , Aniruddha Mahapatra

Existing diffusion-based video editing models have made gorgeous advances for editing attributes of a source video over time but struggle to manipulate the motion information while preserving the original protagonist's appearance and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Shuyuan Tu , Qi Dai , Zhi-Qi Cheng , Han Hu , Xintong Han , Zuxuan Wu , Yu-Gang Jiang

Inspired by the impressive performance of recent face image editing methods, several studies have been naturally proposed to extend these methods to the face video editing task. One of the main challenges here is temporal consistency among…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Gyeongman Kim , Hajin Shim , Hyunsu Kim , Yunjey Choi , Junho Kim , Eunho Yang

Diffusion models have revolutionized text-driven video editing. However, applying these methods to real-world editing encounters two significant challenges: (1) the rapid increase in GPU memory demand as the number of frames grows, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shuzhou Yang , Chong Mou , Jiwen Yu , Yuhan Wang , Xiandong Meng , Jian Zhang

The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Michal Geyer , Omer Bar-Tal , Shai Bagon , Tali Dekel

Editing videos with textual guidance has garnered popularity due to its streamlined process which mandates users to solely edit the text prompt corresponding to the source video. Recent studies have explored and exploited large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuanzhi Wang , Yong Li , Mengyi Liu , Xiaoya Zhang , Xin Liu , Zhen Cui , Antoni B. Chan

Despite recent progress in diffusion-based video editing, existing methods are limited to short-length videos due to the contradiction between long-range consistency and frame-wise editing. Prior attempts to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Jia-Wei Liu , Yan-Pei Cao , Jay Zhangjie Wu , Weijia Mao , Yuchao Gu , Rui Zhao , Jussi Keppo , Ying Shan , Mike Zheng Shou

Synthesizing visual content that meets users' needs often requires flexible and precise controllability of the pose, shape, expression, and layout of the generated objects. Existing approaches gain controllability of generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xingang Pan , Ayush Tewari , Thomas Leimkühler , Lingjie Liu , Abhimitra Meka , Christian Theobalt

Drag-based editing within pretrained diffusion model provides a precise and flexible way to manipulate foreground objects. Traditional methods optimize the input feature obtained from DDIM inversion directly, adjusting them iteratively to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Siwei Xia , Li Sun , Tiantian Sun , Qingli Li

We present a novel task called online video editing, which is designed to edit \textbf{streaming} frames while maintaining temporal consistency. Unlike existing offline video editing assuming all frames are pre-established and accessible,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Feng Chen , Zhen Yang , Bohan Zhuang , Qi Wu

Diffusion models have recently advanced video editing, yet controllable editing remains challenging due to the need for precise manipulation of diverse object properties. Current methods require different control signal for diverse editing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yuqing Chen , Junjie Wang , Lin Liu , Ruihang Chu , Xiaopeng Zhang , Qi Tian , Yujiu Yang

Creating 3D textured meshes using generative artificial intelligence has garnered significant attention recently. While existing methods support text-based generative texture generation or editing on 3D meshes, they often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yudi Zhang , Qi Xu , Lei Zhang

Drag-based image editing has emerged as a powerful paradigm for intuitive image manipulation. However, existing approaches predominantly rely on manipulating the latent space of generative models, leading to limited precision, delayed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Jingyi Lu , Kai Han