English
Related papers

Related papers: PDWN: Pyramid Deformable Warping Network for Video…

200 papers

We present a novel simple yet effective algorithm for motion-based video frame interpolation. Existing motion-based interpolation methods typically rely on a pre-trained optical flow model or a U-Net based pyramid network for motion…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Xin Jin , Longhai Wu , Guotao Shen , Youxin Chen , Jie Chen , Jayoon Koo , Cheul-hee Hahm

Motion-based video frame interpolation (VFI) methods have made remarkable progress with the development of deep convolutional networks over the past years. While their performance is often jeopardized by the inaccuracy of flow map…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Pengcheng Lei , Faming Fang , Guixu Zhang

Recently proposed pyramidal models decompose the conventional forward and backward diffusion processes into multiple stages operating at varying resolutions. These models handle inputs with higher noise levels at lower resolutions, while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Denis Korzhenkov , Adil Karjauv , Animesh Karnewar , Mohsen Ghafoorian , Amirhossein Habibian

We propose a novel DNN based framework called the Enhanced Correlation Matching based Video Frame Interpolation Network to support high resolution like 4K, which has a large scale of motion and occlusion. Considering the extensibility of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Sungho Lee , Narae Choi , Woong Il Choi

Video frame interpolation aims to synthesize nonexistent frames in-between the original frames. While significant advances have been made from the recent deep convolutional neural networks, the quality of interpolation is often reduced due…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Wenbo Bao , Wei-Sheng Lai , Chao Ma , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Zhihao Shi , Xiaohong Liu , Kangdi Shi , Linhui Dai , Jun Chen

Video frame interpolation methodologies endeavor to create novel frames betwixt extant ones, with the intent of augmenting the video's frame frequency. However, current methods are prone to image blurring and spurious artifacts in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Pengfei Han , Fuhua Zhang , Bin Zhao , Xuelong Li

State-of-the-art neural network models estimate large displacement optical flow in multi-resolution and use warping to propagate the estimation between two resolutions. Despite their impressive results, it is known that there are two…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Yao Lu , Jack Valmadre , Heng Wang , Juho Kannala , Mehrtash Harandi , Philip H. S. Torr

Video frame interpolation algorithms typically estimate optical flow or its variations and then use it to guide the synthesis of an intermediate frame between two consecutive original frames. To handle challenges like occlusion,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Simon Niklaus , Feng Liu

This paper presents a new deformable convolution-based video frame interpolation (VFI) method, using a coarse to fine 3D CNN to enhance the multi-flow prediction. This model first extracts spatio-temporal features at multiple scales using a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Duolikun Danier , Fan Zhang , David Bull

Deep Neural Networks are increasingly used in video frame interpolation tasks such as frame rate changes as well as generating fake face videos. Our project aims to apply recent advances in Deep video interpolation to increase the temporal…

Image and Video Processing · Electrical Eng. & Systems 2020-05-15 Rohit Saha , Abenezer Teklemariam , Ian Hsu , Alan M. Moses

Prevailing video frame interpolation algorithms, that generate the intermediate frames from consecutive inputs, typically rely on complex model architectures with heavy parameters or large delay, hindering them from diverse real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Xiaoming Huang , Ying Tai , Chengjie Wang , Jie Yang

Flow-guided synthesis provides a common framework for frame interpolation, where optical flow is estimated to guide the synthesis of intermediate frames between consecutive inputs. In this paper, we present UPR-Net, a novel Unified Pyramid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Xin Jin , Longhai Wu , Jie Chen , Youxin Chen , Jayoon Koo , Cheul-hee Hahm

Learned frame prediction is a current problem of interest in computer vision and video compression. Although several deep network architectures have been proposed for learned frame prediction, to the best of our knowledge, there is no work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 M. Akın Yılmaz , A. Murat Tekalp

Video frame interpolation involves the synthesis of new frames from existing ones. Convolutional neural networks (CNNs) have been at the forefront of the recent advances in this field. One popular CNN-based approach involves the application…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Issa Khalifeh , Marc Gorriz Blanch , Ebroul Izquierdo , Marta Mrak

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

We present a compact but effective CNN model for optical flow, called PWC-Net. PWC-Net has been designed according to simple and well-established principles: pyramidal processing, warping, and the use of a cost volume. Cast in a learnable…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Deqing Sun , Xiaodong Yang , Ming-Yu Liu , Jan Kautz

Recently, flow-based frame interpolation methods have achieved great success by first modeling optical flow between target and input frames, and then building synthesis network for target frame generation. However, above cascaded…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jinfeng Liu , Jie Yang

Video frame interpolation task has recently become more and more prevalent in the computer vision field. At present, a number of researches based on deep learning have achieved great success. Most of them are either based on optical flow…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Haoyue Tian , Pan Gao , Xiaojiang Peng
‹ Prev 1 2 3 10 Next ›