中文
相关论文

相关论文: Video Frame Interpolation via Generalized Deformab…

200 篇论文

We present a method for generating video sequences with coherent motion between a pair of input key frames. We adapt a pretrained large-scale image-to-video diffusion model (originally trained to generate videos moving forward in time from…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Xiaojuan Wang , Boyang Zhou , Brian Curless , Ira Kemelmacher-Shlizerman , Aleksander Holynski , Steven M. Seitz

Convolutional networks optimized for accuracy on challenging, dense prediction tasks are prohibitively slow to run on each frame in a video. The spatial similarity of nearby video frames, however, suggests opportunity to reuse computation.…

计算机视觉与模式识别 · 计算机科学 2018-11-27 Samvit Jain , Joseph E. Gonzalez

Video frame interpolation is a challenging problem because there are different scenarios for each video depending on the variety of foreground and background motion, frame rate, and occlusion. It is therefore difficult for a single network…

计算机视觉与模式识别 · 计算机科学 2020-04-03 Myungsub Choi , Janghoon Choi , Sungyong Baik , Tae Hyun Kim , Kyoung Mu Lee

The problem of video frame interpolation is to increase the temporal resolution of a low frame-rate video, by interpolating novel frames between existing temporally sparse frames. This paper presents a self-supervised approach to video…

计算机视觉与模式识别 · 计算机科学 2022-04-22 Ziang Cheng , Shihao Jiang , Hongdong Li

Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on bilateral motion…

计算机视觉与模式识别 · 计算机科学 2020-07-27 Junheum Park , Keunsoo Ko , Chul Lee , Chang-Su Kim

Video frame interpolation aims to generate high-quality intermediate frames from boundary frames and increase frame rate. While existing linear, symmetric and nonlinear models are used to bridge the gap from the lack of inter-frame motion,…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Chenyang Shi , Hanxiao Liu , Jing Jin , Wenzhuo Li , Yuzhen Li , Boyi Wei , Yibo Zhang

Most deep learning methods for video frame interpolation consist of three main components: feature extraction, motion estimation, and image synthesis. Existing approaches are mainly distinguishable in terms of how these modules are…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Moritz Nottebaum , Stefan Roth , Simone Schaub-Meyer

Video Frame Interpolation (VFI) is a crucial technique in various applications such as slow-motion generation, frame rate conversion, video frame restoration etc. This paper introduces an efficient video frame interpolation framework that…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Tong Shen , Dong Li , Ziheng Gao , Lu Tian , Emad Barsoum

In this paper, we propose an algorithm to interpolate between a pair of images of a dynamic scene. While in the past years significant progress in frame interpolation has been made, current approaches are not able to handle images with…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Pedro Figueirêdo , Avinash Paliwal , Nima Khademi Kalantari

Models optimized for accuracy on single images are often prohibitively slow to run on each frame in a video. Recent work exploits the use of optical flow to warp image features forward from select keyframes, as a means to conserve…

计算机视觉与模式识别 · 计算机科学 2018-10-10 Samvit Jain , Joseph E. Gonzalez

Dynamic vision sensors or event cameras provide rich complementary information for video frame interpolation. Existing state-of-the-art methods follow the paradigm of combining both synthesis-based and warping networks. However, few of…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Jiaben Chen , Yichen Zhu , Dongze Lian , Jiaqi Yang , Yifu Wang , Renrui Zhang , Xinhang Liu , Shenhan Qian , Laurent Kneip , Shenghua Gao

Video Frame Interpolation (VFI) aims to synthesize intermediate frames between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works have employed generative…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Jaihyun Lew , Jooyoung Choi , Chaehun Shin , Dahuin Jung , Sungroh Yoon

Video frame interpolation (VFI) is the task that synthesizes the intermediate frame given two consecutive frames. Most of the previous studies have focused on appropriate frame warping operations and refinement modules for the warped…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Sangjin Lee , Hyeongmin Lee , Chajin Shin , Hanbin Son , Sangyoun Lee

Motion estimation (ME) and motion compensation (MC) have been widely used for classical video frame interpolation systems over the past decades. Recently, a number of data-driven frame interpolation methods based on convolutional neural…

计算机视觉与模式识别 · 计算机科学 2019-09-06 Wenbo Bao , Wei-Sheng Lai , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Video frame interpolation (VFI) aims to synthesize an intermediate frame between two consecutive frames. State-of-the-art approaches usually adopt a two-step solution, which includes 1) generating locally-warped pixels by flow-based motion…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Chengxu Liu , Huan Yang , Jianlong Fu , Xueming Qian

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few methods that employ…

计算机视觉与模式识别 · 计算机科学 2022-10-06 Qiqi Hou , Abhijay Ghildyal , Feng Liu

Video Frame Interpolation (VFI) aims to synthesize non-existent intermediate frames between existent frames. Flow-based VFI algorithms estimate intermediate motion fields to warp the existent frames. Real-world motions' complexity and the…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Chang Zhou , Jie Liu , Jie Tang , Gangshan Wu

Recent advances in high refresh rate displays as well as the increased interest in high rate of slow motion and frame up-conversion fuel the demand for efficient and cost-effective multi-frame video interpolation solutions. To that regard,…

计算机视觉与模式识别 · 计算机科学 2021-01-12 Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Juwei Lu , Jin Tang , Konstantinos N Plataniotis

Inter prediction is an important module in video coding for temporal redundancy removal, where similar reference blocks are searched from previously coded frames and employed to predict the block to be coded. Although traditional video…

计算机视觉与模式识别 · 计算机科学 2019-05-17 Jiaying Liu , Sifeng Xia , Wenhan Yang

Recent progress in large-scale text-to-video (T2V) and image-to-video (I2V) diffusion models has greatly enhanced video generation, especially in terms of keyframe interpolation. However, current image-to-video diffusion models, while…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Serin Yang , Taesung Kwon , Jong Chul Ye