English
Related papers

Related papers: Time Lens++: Event-based Frame Interpolation with …

200 papers

Video frame interpolation (VFI) is the task that synthesizes the intermediate frame given two consecutive frames. Most of the previous studies have focused on appropriate frame warping operations and refinement modules for the warped…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sangjin Lee , Hyeongmin Lee , Chajin Shin , Hanbin Son , Sangyoun Lee

Generating non-existing frames from a consecutive video sequence has been an interesting and challenging problem in the video processing field. Typical kernel-based interpolation methods predict pixels with a single convolution process that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Xianhang Cheng , Zhenzhong Chen

We present a unifying framework to solve several computer vision problems with event cameras: motion, depth and optical flow estimation. The main idea of our framework is to find the point trajectories on the image plane that are best…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Guillermo Gallego , Henri Rebecq , Davide Scaramuzza

Recently, flow-based frame interpolation methods have achieved great success by first modeling optical flow between target and input frames, and then building synthesis network for target frame generation. However, above cascaded…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jinfeng Liu , Jie Yang

Video Frame Interpolation (VFI) aims to synthesize non-existent intermediate frames between existent frames. Flow-based VFI algorithms estimate intermediate motion fields to warp the existent frames. Real-world motions' complexity and the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Chang Zhou , Jie Liu , Jie Tang , Gangshan Wu

Video frame interpolation (VFI) is currently a very active research topic, with applications spanning computer vision, post production and video encoding. VFI can be extremely challenging, particularly in sequences containing large motions,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Duolikun Danier , Fan Zhang , David Bull

Video frame interpolation (VFI) aims to generate predictive frames by warping learnable motions from the bidirectional historical references. Most existing works utilize spatio-temporal semantic information extractor to realize motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meiqin Liu , Chenming Xu , Chao Yao , Chunyu Lin , Yao Zhao

Making line segment detectors more reliable under motion blurs is one of the most important challenges for practical applications, such as visual SLAM and 3D reconstruction. Existing line segment detection methods face severe performance…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Huai Yu , Hao Li , Wen Yang , Lei Yu , Gui-Song Xia

While recent camera-only 3D detection methods leverage multiple timesteps, the limited history they use significantly hampers the extent to which temporal fusion can improve object perception. Observing that existing works' fusion of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Jinhyung Park , Chenfeng Xu , Shijia Yang , Kurt Keutzer , Kris Kitani , Masayoshi Tomizuka , Wei Zhan

Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation. However, few studies have approached the joint video enhancement problem, namely synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Wang Shen , Wenbo Bao , Guangtao Zhai , Li Chen , Xiongkuo Min , Zhiyong Gao

Prevailing video frame interpolation algorithms, that generate the intermediate frames from consecutive inputs, typically rely on complex model architectures with heavy parameters or large delay, hindering them from diverse real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Xiaoming Huang , Ying Tai , Chengjie Wang , Jie Yang

Previous methods for Video Frame Interpolation (VFI) have encountered challenges, notably the manifestation of blur and ghosting effects. These issues can be traced back to two pivotal factors: unavoidable motion errors and misalignment in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Guangyang Wu , Xin Tao , Changlin Li , Wenyi Wang , Xiaohong Liu , Qingqing Zheng

In general, deep learning-based video frame interpolation (VFI) methods have predominantly focused on estimating motion vectors between two input frames and warping them to the target time. While this approach has shown impressive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jaemin Lee , Minseok Seo , Sangwoo Lee , Hyobin Park , Dong-Geol Choi

Multi-Focus Image Fusion seeks to improve the quality of an acquired burst of images with different focus planes. For solving the task, an activity level measurement and a fusion rule are typically established to select and fuse the most…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Fidel Alejandro Guerrero Peña , Pedro Diamel Marrero Fernández , Tsang Ing Ren , Germano Crispim Vasconcelos , Alexandre Cunha

Differentiable image sampling in the form of backward warping has seen broad adoption in tasks like depth estimation and optical flow prediction. In contrast, how to perform forward warping has seen less attention, partly due to additional…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Simon Niklaus , Feng Liu

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mart Kartašev , Carlo Rapisarda , Dominik Fay

Video frame interpolation (VFI) serves as a useful tool for many video processing applications. Recently, it has also been applied in the video compression domain for enhancing both conventional video codecs and learning-based compression…

Image and Video Processing · Electrical Eng. & Systems 2023-06-23 Duolikun Danier , Fan Zhang , David Bull

High-frequency displays are gaining immense popularity because of their increasing use in video games and virtual reality applications. However, the issue is that the underlying GPUs cannot continuously generate frames at this high rate --…

Graphics · Computer Science 2023-07-25 Akanksha Dixit , Yashashwee Chakrabarty , Smruti R. Sarangi

Visible images offer rich texture details, while infrared images emphasize salient targets. Fusing these complementary modalities enhances scene understanding, particularly for advanced vision tasks under challenging conditions. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Beining Xu , Junxian Li

Video frame interpolation (VFI) aims to improve the temporal resolution of a video sequence. Most of the existing deep learning based VFI methods adopt off-the-shelf optical flow algorithms to estimate the bidirectional flows and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tao Yang , Peiran Ren , Xuansong Xie , Xiansheng Hua , Lei Zhang