English
Related papers

Related papers: Deep Frame Interpolation

200 papers

Large motion poses a critical challenge in Video Frame Interpolation (VFI) task. Existing methods are often constrained by limited receptive fields, resulting in sub-optimal performance when handling scenarios with large motion. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Chunxu Liu , Guozhen Zhang , Rui Zhao , Limin Wang

Learned frame prediction is a current problem of interest in computer vision and video compression. Although several deep network architectures have been proposed for learned frame prediction, to the best of our knowledge, there is no work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 M. Akın Yılmaz , A. Murat Tekalp

Image matting is a fundamental computer vision problem and has many applications. Previous algorithms have poor performance when an image has similar foreground and background colors or complicated textures. The main reasons are prior…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Ning Xu , Brian Price , Scott Cohen , Thomas Huang

Deep convolutional neural networks achieve excellent image up-sampling performance. However, CNN-based methods tend to restore high-resolution results highly depending on traditional interpolations (e.g. bicubic). In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Bolun Cai , Xiangmin Xu , Kailing Guo , Kui Jia , Dacheng Tao

Recently, single-image super-resolution has made great progress owing to the development of deep convolutional neural networks (CNNs). The vast majority of CNN-based models use a pre-defined upsampling operator, such as bicubic…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Xin Yang , Haiyang Mei , Jiqing Zhang , Ke Xu , Baocai Yin , Qiang Zhang , Xiaopeng Wei

Video frame interpolation (VFI) is a fundamental vision task that aims to synthesize several frames between two consecutive original video images. Most algorithms aim to accomplish VFI by using only keyframes, which is an ill-posed problem…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Onur Selim Kılıç , Ahmet Akman , A. Aydın Alatan

Differentiable image sampling in the form of backward warping has seen broad adoption in tasks like depth estimation and optical flow prediction. In contrast, how to perform forward warping has seen less attention, partly due to additional…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Simon Niklaus , Feng Liu

We present, AdaFNIO - Adaptive Fourier Neural Interpolation Operator, a neural operator-based architecture to perform video frame interpolation. Current deep learning based methods rely on local convolutions for feature learning and suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Hrishikesh Viswanath , Md Ashiqur Rahman , Rashmi Bhaskara , Aniket Bera

Video frame interpolation and prediction aim to synthesize frames in-between and subsequent to existing frames, respectively. Despite being closely-related, these two tasks are traditionally studied with different model architectures, or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xin Jin , Longhai Wu , Jie Chen , Ilhyun Cho , Cheul-Hee Hahm

Due to strong learning abilities of convolutional neural networks (CNNs), they have become mainstream methods for image super-resolution. However, there are big differences of different deep learning methods with different types. There is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Chunwei Tian , Mingjian Song , Wangmeng Zuo , Bo Du , Yanning Zhang , Shichao Zhang

Inter-frame Coding plays significant role for video Compression and Computer Vision. Computer vision systems have been incorporated in many real life applications (e.g. surveillance systems, medical imaging, robot navigation and identity…

Computer Vision and Pattern Recognition · Computer Science 2014-05-20 Shraddha Mehta , Vaishali Kalariya

Many methods exist for frame synthesis in image sequences but can be broadly categorised into frame interpolation and view synthesis techniques. Fundamentally, both frame interpolation and view synthesis tackle the same task, interpolating…

Image and Video Processing · Electrical Eng. & Systems 2025-09-19 Conall Daly , Anil Kokaram

Learning to predict future images from a video sequence involves the construction of an internal representation that models the image evolution accurately, and therefore, to some degree, its content and dynamics. This is why pixel-space…

Machine Learning · Computer Science 2016-03-01 Michael Mathieu , Camille Couprie , Yann LeCun

In this work, we propose a new diffusion-based method for video frame interpolation (VFI), in the context of traditional hand-made animation. We introduce three main contributions: The first is that we explicitly handle the interpolation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Victor Fonte Chavez , Claudia Esteves , Jean-Bernard Hayet

Image Inpainting is one of the very popular tasks in the field of image processing with broad applications in computer vision. In various practical applications, images are often deteriorated by noise due to the presence of corrupted, lost,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Harsh Patel , Amey Kulkarni , Shivam Sahni , Udit Vyas

Video Frame Interpolation (VFI) is a crucial technique in various applications such as slow-motion generation, frame rate conversion, video frame restoration etc. This paper introduces an efficient video frame interpolation framework that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Tong Shen , Dong Li , Ziheng Gao , Lu Tian , Emad Barsoum

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

Stable Diffusion (SD) has evolved DDPM (Denoising Diffusion Probabilistic Model) based image generation significantly by denoising in latent space instead of feature space. This popularized DDPM-based image generation as the cost and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Md Abu Obaida Zishan , Jannatun Noor , Annajiat Alim Rasel

Recent co-part segmentation methods mostly operate in a supervised learning setting, which requires a large amount of annotated data for training. To overcome this limitation, we propose a self-supervised deep learning method for co-part…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Aliaksandr Siarohin , Subhankar Roy , Stéphane Lathuilière , Sergey Tulyakov , Elisa Ricci , Nicu Sebe

Standard video codecs rely on optical flow to guide inter-frame prediction: pixels from reference frames are moved via motion vectors to predict target video frames. We propose to learn binary motion codes that are encoded based on an input…

Image and Video Processing · Electrical Eng. & Systems 2019-12-12 André Nortje , Herman A. Engelbrecht , Herman Kamper