English
Related papers

Related papers: IFRNet: Intermediate Feature Refine Network for Ef…

200 papers

Video frame interpolation (VFI) aims to synthesize an intermediate frame between two consecutive frames. State-of-the-art approaches usually adopt a two-step solution, which includes 1) generating locally-warped pixels by flow-based motion…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Chengxu Liu , Huan Yang , Jianlong Fu , Xueming Qian

Video frame interpolation (VFI) is the task that synthesizes the intermediate frame given two consecutive frames. Most of the previous studies have focused on appropriate frame warping operations and refinement modules for the warped…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sangjin Lee , Hyeongmin Lee , Chajin Shin , Hanbin Son , Sangyoun Lee

LiDAR point cloud frame interpolation, which synthesizes the intermediate frame between the captured frames, has emerged as an important issue for many applications. Especially for reducing the amounts of point cloud transmission, it is by…

Image and Video Processing · Electrical Eng. & Systems 2021-10-14 Lili Zhao , Zezhi Zhu , Xuhu Lin , Xuezhou Guo , Qian Yin , Wenyi Wang , Jianwen Chen

In this paper, we firstly present a dataset (X4K1000FPS) of 4K videos of 1000 fps with the extreme motion to the research community for video frame interpolation (VFI), and propose an extreme VFI network, called XVFI-Net, that first handles…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Hyeonjun Sim , Jihyong Oh , Munchurl Kim

Graphics rendering applications increasingly leverage neural networks in tasks such as denoising, supersampling, and frame extrapolation to improve image quality while maintaining frame rates. The temporal coherence inherent in these tasks…

Graphics · Computer Science 2025-06-18 Lufei Liu , Tor M. Aamodt

Video frame interpolation is the task of creating an interframe between two adjacent frames along the time axis. So, instead of simply averaging two adjacent frames to create an intermediate image, this operation should maintain semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Saem Park , Donghoon Han , Nojun Kwak

Video object detection is more challenging compared to image object detection. Previous works proved that applying object detector frame by frame is not only slow but also inaccurate. Visual clues get weakened by defocus and motion blur,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Congrui Hetang , Hongwei Qin , Shaohui Liu , Junjie Yan

Video frame interpolation(VFI) has witnessed great progress in recent years. While existing VFI models still struggle to achieve a good trade-off between accuracy and efficiency: fast models often have inferior accuracy; accurate models…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Ban Chen , Xin Jin , Youxin Chen , Longhai Wu , Jie Chen , Jayoon Koo , Cheul-hee Hahm

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

Video frame interpolation involves the synthesis of new frames from existing ones. Convolutional neural networks (CNNs) have been at the forefront of the recent advances in this field. One popular CNN-based approach involves the application…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Issa Khalifeh , Marc Gorriz Blanch , Ebroul Izquierdo , Marta Mrak

Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation. However, few studies have approached the joint video enhancement problem, namely synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Wang Shen , Wenbo Bao , Guangtao Zhai , Li Chen , Xiongkuo Min , Zhiyong Gao

Despite the remarkable progress of deep learning in stereo matching, there exists a gap in accuracy between real-time models and slower state-of-the-art models which are suitable for practical applications. This paper presents an iterative…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Kumail Raza , René Schuster , Didier Stricker

Video Frame Interpolation synthesizes non-existent images between adjacent frames, with the aim of providing a smooth and consistent visual experience. Two approaches for solving this challenging task are optical flow based and kernel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xi Li , Meng Cao , Yingying Tang , Scott Johnston , Zhendong Hong , Huimin Ma , Jiulong Shan

We present a method that synthesizes novel views of complex scenes by interpolating a sparse set of nearby views. The core of our method is a network architecture that includes a multilayer perceptron and a ray transformer that estimates…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Qianqian Wang , Zhicheng Wang , Kyle Genova , Pratul Srinivasan , Howard Zhou , Jonathan T. Barron , Ricardo Martin-Brualla , Noah Snavely , Thomas Funkhouser

Although recent works based on deep learning have made progress in improving recognition accuracy on scene text recognition, how to handle low-quality text images in end-to-end deep networks remains a research challenge. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Zhiwei Jia , Shugong Xu , Shiyi Mu , Yue Tao , Shan Cao , Zhiyong Chen

Recent works have shown the ability of Implicit Neural Representations (INR) to carry meaningful representations of signal derivatives. In this work, we leverage this property to perform Video Frame Interpolation (VFI) by explicitly…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Weihao Zhuang , Tristan Hascoet , Ryoichi Takashima , Tetsuya Takiguchi

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

We present All-Pairs Multi-Field Transforms (AMT), a new network architecture for video frame interpolation. It is based on two essential designs. First, we build bidirectional correlation volumes for all pairs of pixels, and use the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Zhen Li , Zuo-Liang Zhu , Ling-Hao Han , Qibin Hou , Chun-Le Guo , Ming-Ming Cheng

Dynamic vision sensors or event cameras provide rich complementary information for video frame interpolation. Existing state-of-the-art methods follow the paradigm of combining both synthesis-based and warping networks. However, few of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jiaben Chen , Yichen Zhu , Dongze Lian , Jiaqi Yang , Yifu Wang , Renrui Zhang , Xinhang Liu , Shenhan Qian , Laurent Kneip , Shenghua Gao

Video stabilization is a fundamental and important technique for higher quality videos. Prior works have extensively explored video stabilization, but most of them involve cropping of the frame boundaries and introduce moderate levels of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Jinsoo Choi , In So Kweon