English
Related papers

Related papers: Softmax Splatting for Video Frame Interpolation

200 papers

Video frame interpolation is a challenging problem because there are different scenarios for each video depending on the variety of foreground and background motion, frame rate, and occlusion. It is therefore difficult for a single network…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Myungsub Choi , Janghoon Choi , Sungyong Baik , Tae Hyun Kim , Kyoung Mu Lee

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Junheum Park , Chul Lee , Chang-Su Kim

Convolutional networks optimized for accuracy on challenging, dense prediction tasks are prohibitively slow to run on each frame in a video. The spatial similarity of nearby video frames, however, suggests opportunity to reuse computation.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Samvit Jain , Joseph E. Gonzalez

Video frame interpolation aims to synthesize realistic intermediate frames between given endpoints while adhering to specific motion semantics. While recent generative models have improved visual fidelity, they predominantly operate in a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Lingyu Liu , Yaxiong Wang , Li Zhu , Zhedong Zheng

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Feng Huang , Xin Zhang , Yixuan Xu , Xuesong Wang , Xianyu Wu

Video frame interpolation(VFI) has witnessed great progress in recent years. While existing VFI models still struggle to achieve a good trade-off between accuracy and efficiency: fast models often have inferior accuracy; accurate models…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Ban Chen , Xin Jin , Youxin Chen , Longhai Wu , Jie Chen , Jayoon Koo , Cheul-hee Hahm

In recent years, visual SLAM has achieved great progress and development in different scenes, however, there are still many problems to be solved. The SLAM system is not only restricted by the external scenes but is also affected by its…

Robotics · Computer Science 2021-10-25 Zhenkun Zhu , Jikai Wang

Video Frame Interpolation synthesizes non-existent images between adjacent frames, with the aim of providing a smooth and consistent visual experience. Two approaches for solving this challenging task are optical flow based and kernel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xi Li , Meng Cao , Yingying Tang , Scott Johnston , Zhendong Hong , Huimin Ma , Jiulong Shan

Video frame interpolation (VFI) works generally predict intermediate frame(s) by first estimating the motion between inputs and then warping the inputs to the target time with the estimated motion. This approach, however, is not optimal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Dawit Mureja Argaw , In So Kweon

We address the problem of synthesizing new video frames in an existing video, either in-between existing frames (interpolation), or subsequent to them (extrapolation). This problem is challenging because video appearance and motion can be…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Ziwei Liu , Raymond A. Yeh , Xiaoou Tang , Yiming Liu , Aseem Agarwala

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mart Kartašev , Carlo Rapisarda , Dominik Fay

Models optimized for accuracy on single images are often prohibitively slow to run on each frame in a video. Recent work exploits the use of optical flow to warp image features forward from select keyframes, as a means to conserve…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Samvit Jain , Joseph E. Gonzalez

The problem of video inter-frame interpolation is an essential task in the field of image processing. Correctly increasing the number of frames in the recording while maintaining smooth movement allows to improve the quality of played video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Malwina Kubas , Grzegorz Sarwas

High-refresh rate displays have become very popular in recent years due to the need for superior visual quality in gaming, professional displays and specialized applications like medical imaging. However, high-refresh rate displays alone do…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Akanksha Dixit , Smruti R. Sarangi

In recent years, consumer-level depth cameras have been adopted for various applications. However, they often produce depth maps at only a moderately high frame rate (approximately 30 frames per second), preventing them from being used for…

Graphics · Computer Science 2018-11-06 Ming-Ze Yuan , Lin Gao , Hongbo Fu , Shihong Xia

Dynamic vision sensors or event cameras provide rich complementary information for video frame interpolation. Existing state-of-the-art methods follow the paradigm of combining both synthesis-based and warping networks. However, few of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jiaben Chen , Yichen Zhu , Dongze Lian , Jiaqi Yang , Yifu Wang , Renrui Zhang , Xinhang Liu , Shenhan Qian , Laurent Kneip , Shenghua Gao

Abrupt motion of camera or objects in a scene result in a blurry video, and therefore recovering high quality video requires two types of enhancements: visual enhancement and temporal upsampling. A broad range of research attempted to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Dawit Mureja Argaw , Junsik Kim , Francois Rameau , In So Kweon

The problem of video frame interpolation is to increase the temporal resolution of a low frame-rate video, by interpolating novel frames between existing temporally sparse frames. This paper presents a self-supervised approach to video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Ziang Cheng , Shihao Jiang , Hongdong Li

Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on bilateral motion…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Junheum Park , Keunsoo Ko , Chul Lee , Chang-Su Kim

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Qiqi Hou , Abhijay Ghildyal , Feng Liu