English
Related papers

Related papers: Videoshop: Localized Semantic Video Editing with N…

200 papers

Video colour editing is a crucial task for content creation, yet existing solutions either require painstaking frame-by-frame manipulation or produce unrealistic results with temporal artefacts. We present a practical, training-free…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Chaitat Utintu , Pinaki Nath Chowdhury , Aneeshan Sain , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

Recently, diffusion-based generative models have achieved remarkable success for image generation and edition. However, existing diffusion-based video editing approaches lack the ability to offer precise control over generated content that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Paul Couairon , Clément Rambour , Jean-Emmanuel Haugeard , Nicolas Thome

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

We propose an automatic approach that extracts editing styles in a source video and applies the edits to matched footage for video creation. Our Computer Vision based techniques considers framing, content type, playback speed, and lighting…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Nathan Frey , Peggy Chi , Weilong Yang , Irfan Essa

We introduce InstructVid2Vid, an end-to-end diffusion-based methodology for video editing guided by human language instructions. Our approach empowers video manipulation guided by natural language directives, eliminating the need for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Bosheng Qin , Juncheng Li , Siliang Tang , Tat-Seng Chua , Yueting Zhuang

Video generation has made remarkable progress in recent years, especially since the advent of the video diffusion models. Many video generation models can produce plausible synthetic videos, e.g., Stable Video Diffusion (SVD). However, most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shaoshu Yang , Yong Zhang , Xiaodong Cun , Ying Shan , Ran He

Artificial Intelligence Generated Content (AIGC) has advanced significantly, particularly with the development of video generation models such as text-to-video (T2V) models and image-to-video (I2V) models. However, like other AIGC types,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Runyi Hu , Jie Zhang , Yiming Li , Jiwei Li , Qing Guo , Han Qiu , Tianwei Zhang

Natural language offers a highly intuitive interface for image editing. In this paper, we introduce the first solution for performing local (region-based) edits in generic natural images, based on a natural language description along with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Omri Avrahami , Dani Lischinski , Ohad Fried

Video editing is a creative and complex endeavor and we believe that there is potential for reimagining a new video editing interface to better support the creative and exploratory nature of video editing. We take inspiration from latent…

Human-Computer Interaction · Computer Science 2024-06-26 David Chuan-En Lin , Fabian Caba Heilbron , Joon-Young Lee , Oliver Wang , Nikolas Martelaro

We present a novel, training-free approach for textual editing of real images using diffusion models. Unlike prior methods that rely on computationally expensive finetuning, our approach leverages LAtent SPatial Alignment (LASPA) to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yazeed Alharbi , Peter Wonka

Machine learning is transforming the video editing industry. Recent advances in computer vision have leveled-up video editing tasks such as intelligent reframing, rotoscoping, color grading, or applying digital makeups. However, most of the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Dawit Mureja Argaw , Fabian Caba Heilbron , Joon-Young Lee , Markus Woodson , In So Kweon

In this era of videos, automatic video editing techniques attract more and more attention from industry and academia since they can reduce workloads and lower the requirements for human editors. Existing automatic editing systems are mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Panwen Hu , Nan Xiao , Feifei Li , Yongquan Chen , Rui Huang

Automatic video editing involving at least the steps of selecting the most valuable footage from points of view of visual quality and the importance of action filmed; and cutting the footage into a brief and coherent visual story that would…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Sergey Podlesnyy

Generative methods for image and video editing use generative models as priors to perform edits despite incomplete information, such as changing the composition of 3D objects shown in a single image. Recent methods have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Juil Koo , Paul Guerrero , Chun-Hao Paul Huang , Duygu Ceylan , Minhyuk Sung

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han

Generating free-viewpoint videos is critical for immersive VR/AR experience but recent neural advances still lack the editing ability to manipulate the visual perception for large dynamic scenes. To fill this gap, in this paper we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Jiakai Zhang , Xinhang Liu , Xinyi Ye , Fuqiang Zhao , Yanshun Zhang , Minye Wu , Yingliang Zhang , Lan Xu , Jingyi Yu

This paper proposes a video editor based on OpenShot with several state-of-the-art facial video editing algorithms as added functionalities. Our editor provides an easy-to-use interface to apply modern lip-syncing algorithms interactively.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Anchit Gupta , Faizan Farooq Khan , Rudrabha Mukhopadhyay , Vinay P. Namboodiri , C. V. Jawahar

Long-form video editing poses unique challenges due to the exponential increase in the computational cost from joint editing and Denoising Diffusion Implicit Models (DDIM) inversion across extended sequences. To address these limitations,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Mustafa Munir , Md Mostafijur Rahman , Kartikeya Bhardwaj , Paul Whatmough , Radu Marculescu

Text-driven diffusion-based video editing presents a unique challenge not encountered in image editing literature: establishing real-world motion. Unlike existing video editing approaches, here we focus on score distillation sampling to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Hyeonho Jeong , Jinho Chang , Geon Yeong Park , Jong Chul Ye

This paper introduces V$^2$Edit, a novel training-free framework for instruction-guided video and 3D scene editing. Addressing the critical challenge of balancing original content preservation with editing task fulfillment, our approach…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yanming Zhang , Jun-Kun Chen , Jipeng Lyu , Yu-Xiong Wang