English
Related papers

Related papers: Video Frame Interpolation with Many-to-many Splatt…

200 papers

Motion estimation (ME) and motion compensation (MC) have been widely used for classical video frame interpolation systems over the past decades. Recently, a number of data-driven frame interpolation methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Wenbo Bao , Wei-Sheng Lai , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Many methods exist for frame synthesis in image sequences but can be broadly categorised into frame interpolation and view synthesis techniques. Fundamentally, both frame interpolation and view synthesis tackle the same task, interpolating…

Image and Video Processing · Electrical Eng. & Systems 2025-09-19 Conall Daly , Anil Kokaram

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

Video frame interpolation task has recently become more and more prevalent in the computer vision field. At present, a number of researches based on deep learning have achieved great success. Most of them are either based on optical flow…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Haoyue Tian , Pan Gao , Xiaojiang Peng

Most deep learning methods for video frame interpolation consist of three main components: feature extraction, motion estimation, and image synthesis. Existing approaches are mainly distinguishable in terms of how these modules are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Moritz Nottebaum , Stefan Roth , Simone Schaub-Meyer

Video stabilization is a fundamental and important technique for higher quality videos. Prior works have extensively explored video stabilization, but most of them involve cropping of the frame boundaries and introduce moderate levels of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Jinsoo Choi , In So Kweon

Video frame interpolation is an increasingly important research task with several key industrial applications in the video coding, broadcast and production sectors. Recently, transformers have been introduced to the field resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Issa Khalifeh , Luka Murn , Marta Mrak , Ebroul Izquierdo

Convolutional networks optimized for accuracy on challenging, dense prediction tasks are prohibitively slow to run on each frame in a video. The spatial similarity of nearby video frames, however, suggests opportunity to reuse computation.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Samvit Jain , Joseph E. Gonzalez

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

Multi-frame image super-resolution (MISR) aims to fuse information in low-resolution (LR) image sequence to compose a high-resolution (HR) one, which is applied extensively in many areas recently. Different with single image…

Computer Vision and Pattern Recognition · Computer Science 2017-10-16 Longguang Wang , Zaiping Lin , Xinpu Deng , Wei An

Video frame interpolation (VFI) works generally predict intermediate frame(s) by first estimating the motion between inputs and then warping the inputs to the target time with the estimated motion. This approach, however, is not optimal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Dawit Mureja Argaw , In So Kweon

Multiscale mixed methods based on non-overlapping domain decompositions can efficiently handle the solution of significant subsurface flow problems in very heterogeneous formations of interest to the industry, especially when implemented on…

Numerical Analysis · Mathematics 2025-02-25 Dilong Zhou , Rafael Guiraldello , Felipe Pereira

Video frame interpolation (VFI) is currently a very active research topic, with applications spanning computer vision, post production and video encoding. VFI can be extremely challenging, particularly in sequences containing large motions,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Duolikun Danier , Fan Zhang , David Bull

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mart Kartašev , Carlo Rapisarda , Dominik Fay

The problem of video inter-frame interpolation is an essential task in the field of image processing. Correctly increasing the number of frames in the recording while maintaining smooth movement allows to improve the quality of played video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Malwina Kubas , Grzegorz Sarwas

Large motion poses a critical challenge in Video Frame Interpolation (VFI) task. Existing methods are often constrained by limited receptive fields, resulting in sub-optimal performance when handling scenarios with large motion. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Chunxu Liu , Guozhen Zhang , Rui Zhao , Limin Wang

Inter-frame modeling is pivotal in generating intermediate frames for video frame interpolation (VFI). Current approaches predominantly rely on convolution or attention-based models, which often either lack sufficient receptive fields or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Guozhen Zhang , Chunxu Liu , Yutao Cui , Xiaotong Zhao , Kai Ma , Limin Wang

We present All-Pairs Multi-Field Transforms (AMT), a new network architecture for video frame interpolation. It is based on two essential designs. First, we build bidirectional correlation volumes for all pairs of pixels, and use the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Zhen Li , Zuo-Liang Zhu , Ling-Hao Han , Qibin Hou , Chun-Le Guo , Ming-Ming Cheng

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Junheum Park , Chul Lee , Chang-Su Kim

We propose Framer for interactive frame interpolation, which targets producing smoothly transitioning frames between two images as per user creativity. Concretely, besides taking the start and end frames as inputs, our approach supports…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Wen Wang , Qiuyu Wang , Kecheng Zheng , Hao Ouyang , Zhekai Chen , Biao Gong , Hao Chen , Yujun Shen , Chunhua Shen