English
Related papers

Related papers: Video Frame Interpolation via Adaptive Convolution

200 papers

The problem of video inter-frame interpolation is an essential task in the field of image processing. Correctly increasing the number of frames in the recording while maintaining smooth movement allows to improve the quality of played video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Malwina Kubas , Grzegorz Sarwas

Guided upsampling is an effective approach for accelerating high-resolution image processing. In this paper, we propose a simple yet effective guided upsampling method. Each pixel in the high-resolution image is represented as a linear…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Shuangbing Song , Fan Zhong , Tianju Wang , Xueying Qin , Changhe Tu

In this work, we propose a new diffusion-based method for video frame interpolation (VFI), in the context of traditional hand-made animation. We introduce three main contributions: The first is that we explicitly handle the interpolation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Victor Fonte Chavez , Claudia Esteves , Jean-Bernard Hayet

Existing video frame interpolation (VFI) methods blindly predict where each object is at a specific timestep t ("time indexing"), which struggles to predict precise object movements. Given two images of a baseball, there are infinitely many…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhihang Zhong , Yiming Zhang , Wei Wang , Xiao Sun , Yu Qiao , Gurunandan Krishnan , Sizhuo Ma , Jian Wang

Prediction and interpolation for long-range video data involves the complex task of modeling motion trajectories for each visible object, occlusions and dis-occlusions, as well as appearance changes due to viewpoint and lighting. Optical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Kevin J. Shih , Aysegul Dundar , Animesh Garg , Robert Pottorf , Andrew Tao , Bryan Catanzaro

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mehdi S. M. Sajjadi , Raviteja Vemulapalli , Matthew Brown

Flow-guided synthesis provides a common framework for frame interpolation, where optical flow is estimated to guide the synthesis of intermediate frames between consecutive inputs. In this paper, we present UPR-Net, a novel Unified Pyramid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Xin Jin , Longhai Wu , Jie Chen , Youxin Chen , Jayoon Koo , Cheul-hee Hahm

Video frame interpolation (VFI) aims to improve the temporal resolution of a video sequence. Most of the existing deep learning based VFI methods adopt off-the-shelf optical flow algorithms to estimate the bidirectional flows and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tao Yang , Peiran Ren , Xuansong Xie , Xiansheng Hua , Lei Zhang

Existing works address the problem of generating high frame-rate sharp videos by separately learning the frame deblurring and frame interpolation modules. Most of these approaches have a strong prior assumption that all the input frames are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Akash Gupta , Abhishek Aich , Amit K. Roy-Chowdhury

In video super-resolution, it is common to use a frame-wise alignment to support the propagation of information over time. The role of alignment is well-studied for low-level enhancement in video, but existing works overlook a critical step…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Kai Xu , Ziwei Yu , Xin Wang , Michael Bi Mi , Angela Yao

In this paper, a macroblock classification method is proposed for various video processing applications involving motions. Based on the analysis of the Motion Vector field in the compressed video, we propose to classify Macroblocks of each…

Multimedia · Computer Science 2016-11-17 Weiyao Lin , Ming-Ting Sun , Hongxiang Li , Zhenzhong Chen , Wei Li , Bing Zhou

Video frame interpolation is a classic and challenging low-level computer vision task. Recently, deep learning based methods have achieved impressive results, and it has been proven that optical flow based methods can synthesize frames with…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinfeng Liu , Lingtong Kong , Jie Yang

Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Dahyeon Kye , Changhyun Roh , Sukhun Ko , Chanho Eom , Jihyong Oh

We study the problem of synthesizing a number of likely future frames from a single input image. In contrast to traditional methods that have tackled this problem in a deterministic or non-parametric way, we propose to model future frames…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Tianfan Xue , Jiajun Wu , Katherine L. Bouman , William T. Freeman

Video Frame Interpolation (VFI) aims to synthesize intermediate frames between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works have employed generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaihyun Lew , Jooyoung Choi , Chaehun Shin , Dahuin Jung , Sungroh Yoon

Effectively extracting inter-frame motion and appearance information is important for video frame interpolation (VFI). Previous works either extract both types of information in a mixed way or elaborate separate modules for each type of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Guozhen Zhang , Yuhan Zhu , Haonan Wang , Youxin Chen , Gangshan Wu , Limin Wang

Learned B-frame video compression aims to adopt bi-directional motion estimation and motion compensation (MEMC) coding for middle frame reconstruction. However, previous learned approaches often directly extend neural P-frame codecs to…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Chenming Xu , Meiqin Liu , Chao Yao , Weisi Lin , Yao Zhao

Researches in novel viewpoint synthesis majorly focus on interpolation from multi-view input images. In this paper, we focus on a more challenging and ill-posed problem that is to synthesize novel viewpoints from one single input image. To…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Xiaodong Cun , Feng Xu , Chi-Man Pun , Hao Gao

This work aims to provide a deep-learning solution for the motion interpolation task. Previous studies solve it with geometric weight functions. Some other works propose neural networks for different problem settings with consecutive pose…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Shuo Huang , Jia Jia , Zongxin Yang , Wei Wang , Haozhe Wu , Yi Yang , Junliang Xing

In this paper, we propose a novel motion-compensated frame rate up-conversion (MC-FRUC) algorithm. The proposed algorithm creates interpolated frames by first estimating motion vectors using unilateral (jointing forward and backward) and…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Hanieh Naderi , Mohammad Rahmati