English
Related papers

Related papers: PDWN: Pyramid Deformable Warping Network for Video…

200 papers

This work presents a supervised learning based approach to the computer vision problem of frame interpolation. The presented technique could also be used in the cartoon animations since drawing each individual frame consumes a noticeable…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Vladislav Samsonov

Video frame interpolation is an increasingly important research task with several key industrial applications in the video coding, broadcast and production sectors. Recently, transformers have been introduced to the field resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Issa Khalifeh , Luka Murn , Marta Mrak , Ebroul Izquierdo

Video Frame Interpolation synthesizes non-existent images between adjacent frames, with the aim of providing a smooth and consistent visual experience. Two approaches for solving this challenging task are optical flow based and kernel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xi Li , Meng Cao , Yingying Tang , Scott Johnston , Zhendong Hong , Huimin Ma , Jiulong Shan

Interlacing is a widely used technique, for television broadcast and video recording, to double the perceived frame rate without increasing the bandwidth. But it presents annoying visual artifacts, such as flickering and silhouette…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Haichao Zhu , Xueting Liu , Xiangyu Mao , Tien-Tsin Wong

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mart Kartašev , Carlo Rapisarda , Dominik Fay

This paper considers the challenging task of long-term video interpolation. Unlike most existing methods that only generate few intermediate frames between existing adjacent ones, we attempt to speculate or imagine the procedure of an…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Xiongtao Chen , Wenmin Wang , Jinzhuo Wang , Weimian Li , Baoyang Chen

Traditional approaches to interpolate/extrapolate frames in a video sequence require accurate pixel correspondences between images, e.g., using optical flow. Their results stem on the accuracy of optical flow estimation, and could generate…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Zhe Hu , Yinglan Ma , Lizhuang Ma

Video frame interpolation has been actively studied with the development of convolutional neural networks. However, due to the intrinsic limitations of kernel weight sharing in convolution, the interpolated frame generated by it may lose…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Pan Gao , Haoyue Tian , Jie Qin

Generating high-dimensional visual modalities is a computationally intensive task. A common solution is progressive generation, where the outputs are synthesized in a coarse-to-fine spectral autoregressive manner. While diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Moayed Haji-Ali , Willi Menapace , Ivan Skorokhodov , Arpit Sahni , Sergey Tulyakov , Vicente Ordonez , Aliaksandr Siarohin

Video frame interpolation is one of the most challenging tasks in video processing research. Recently, many studies based on deep learning have been suggested. Most of these methods focus on finding locations with useful information to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hyeongmin Lee , Taeoh Kim , Tae-young Chung , Daehyun Pak , Yuseok Ban , Sangyoun Lee

Generating non-existing frames from a consecutive video sequence has been an interesting and challenging problem in the video processing field. Typical kernel-based interpolation methods predict pixels with a single convolution process that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Xianhang Cheng , Zhenzhong Chen

Video frame interpolation is the task of creating an interframe between two adjacent frames along the time axis. So, instead of simply averaging two adjacent frames to create an intermediate image, this operation should maintain semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Saem Park , Donghoon Han , Nojun Kwak

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

Video frame interpolation aims to synthesize one or multiple frames between two consecutive frames in a video. It has a wide range of applications including slow-motion video generation, frame-rate up-scaling and developing video codecs.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Saikat Dutta , Arulkumar Subramaniam , Anurag Mittal

The versatility of recent machine learning approaches makes them ideal for improvement of next generation video compression solutions. Unfortunately, these approaches typically bring significant increases in computational complexity and are…

Image and Video Processing · Electrical Eng. & Systems 2021-06-18 Luka Murn , Saverio Blasi , Alan F. Smeaton , Marta Mrak

Diffractive deep neural networks (D2NNs) are composed of successive transmissive layers optimized using supervised deep learning to all-optically implement various computational tasks between an input and output field-of-view (FOV). Here,…

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

Video frame interpolation (VFI), which aims to synthesize intermediate frames of a video, has made remarkable progress with development of deep convolutional networks over past years. Existing methods built upon convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Liying Lu , Ruizheng Wu , Huaijia Lin , Jiangbo Lu , Jiaya Jia

Video frame interpolation (VFI) aims to synthesize an intermediate frame between two consecutive frames. State-of-the-art approaches usually adopt a two-step solution, which includes 1) generating locally-warped pixels by flow-based motion…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Chengxu Liu , Huan Yang , Jianlong Fu , Xueming Qian

Frame interpolation is an essential video processing technique that adjusts the temporal resolution of an image sequence. While deep learning has brought great improvements to the area of video frame interpolation, techniques that make use…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Simon Niklaus , Ping Hu , Jiawen Chen