English
Related papers

Related papers: Time Lens++: Event-based Frame Interpolation with …

200 papers

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

Dynamic vision sensors or event cameras provide rich complementary information for video frame interpolation. Existing state-of-the-art methods follow the paradigm of combining both synthesis-based and warping networks. However, few of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jiaben Chen , Yichen Zhu , Dongze Lian , Jiaqi Yang , Yifu Wang , Renrui Zhang , Xinhang Liu , Shenhan Qian , Laurent Kneip , Shenghua Gao

Video Frame Interpolation synthesizes non-existent images between adjacent frames, with the aim of providing a smooth and consistent visual experience. Two approaches for solving this challenging task are optical flow based and kernel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xi Li , Meng Cao , Yingying Tang , Scott Johnston , Zhendong Hong , Huimin Ma , Jiulong Shan

Utilization of event-based cameras is expected to improve the visual quality of video frame interpolation solutions. We introduce a learning-based method to exploit moving region boundaries in a video sequence to increase the overall…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Ahmet Akman , Onur Selim Kılıç , A. Aydın Alatan

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos. To this end, we present a unified framework of event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Xiang Zhang , Lei Yu

Recent advances in high refresh rate displays as well as the increased interest in high rate of slow motion and frame up-conversion fuel the demand for efficient and cost-effective multi-frame video interpolation solutions. To that regard,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Juwei Lu , Jin Tang , Konstantinos N Plataniotis

Video frame interpolation (VFI) that leverages the bio-inspired event cameras as guidance has recently shown better performance and memory efficiency than the frame-based methods, thanks to the event cameras' advantages, such as high…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Haoyue Liu , Jinghan Xu , Yi Chang , Hanyu Zhou , Haozhi Zhao , Lin Wang , Luxin Yan

We present a frame interpolation algorithm that synthesizes multiple intermediate frames from two input images with large in-between motion. Recent methods use multiple networks to estimate optical flow or depth and a separate network…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Fitsum Reda , Janne Kontkanen , Eric Tabellion , Deqing Sun , Caroline Pantofaru , Brian Curless

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

State-of-the-art scene flow algorithms pursue the conflicting targets of accuracy, run time, and robustness. With the successful concept of pixel-wise matching and sparse-to-dense interpolation, we push the limits of scene flow estimation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 René Schuster , Oliver Wasenmüller , Christian Unger , Georg Kuschk , Didier Stricker

We propose a light-weight video frame interpolation algorithm. Our key innovation is an instance-level supervision that allows information to be learned from the high-resolution version of similar objects. Our experiment shows that the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Liangzhe Yuan , Yibo Chen , Hantian Liu , Tao Kong , Jianbo Shi

Video Frame Interpolation (VFI) aims to generate intermediate video frames between consecutive input frames. Since the event cameras are bio-inspired sensors that only encode brightness changes with a micro-second temporal resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Taewoo Kim , Yujeong Chae , Hyun-Kurl Jang , Kuk-Jin Yoon

Video Frame Interpolation aims to recover realistic missing frames between observed frames, generating a high-frame-rate video from a low-frame-rate video. However, without additional guidance, the large motion between frames makes this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jingxi Chen , Brandon Y. Feng , Haoming Cai , Tianfu Wang , Levi Burner , Dehao Yuan , Cornelia Fermuller , Christopher A. Metzler , Yiannis Aloimonos

Video frame interpolation aims to synthesize one or multiple frames between two consecutive frames in a video. It has a wide range of applications including slow-motion video generation, frame-rate up-scaling and developing video codecs.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Saikat Dutta , Arulkumar Subramaniam , Anurag Mittal

Fast neuromorphic event-based vision sensors (Dynamic Vision Sensor, DVS) can be combined with slower conventional frame-based sensors to enable higher-quality inter-frame interpolation than traditional methods relying on fixed motion…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Adam Radomski , Andreas Georgiou , Thomas Debrunner , Chenghan Li , Luca Longinotti , Minwon Seo , Moosung Kwak , Chang-Woo Shin , Paul K. J. Park , Hyunsurk Eric Ryu , Kynan Eng

Frame interpolation is an essential video processing technique that adjusts the temporal resolution of an image sequence. While deep learning has brought great improvements to the area of video frame interpolation, techniques that make use…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Simon Niklaus , Ping Hu , Jiawen Chen

Video frame interpolation aims to synthesize nonexistent frames in-between the original frames. While significant advances have been made from the recent deep convolutional neural networks, the quality of interpolation is often reduced due…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Wenbo Bao , Wei-Sheng Lai , Chao Ma , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Video frame interpolation, the process of synthesizing intermediate frames between sequential video frames, has made remarkable progress with the use of event cameras. These sensors, with microsecond-level temporal resolution, fill…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yuhan Liu , Yongjian Deng , Hao Chen , Bochen Xie , Youfu Li , Zhen Yang

Video interpolation is an important problem in computer vision, which helps overcome the temporal limitation of camera sensors. Existing video interpolation methods usually assume uniform motion between consecutive frames and use linear…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Xiangyu Xu , Li Siyao , Wenxiu Sun , Qian Yin , Ming-Hsuan Yang
‹ Prev 1 2 3 10 Next ›