English
Related papers

Related papers: MAEVI: Motion Aware Event-Based Video Frame Interp…

200 papers

Exposure-agnostic video frame interpolation (VFI) is a challenging task that aims to recover sharp, high-frame-rate videos from blurry, low-frame-rate inputs captured under unknown and dynamic exposure conditions. Event cameras are sensors…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Junsik Jung , Yoonki Cho , Woo Jae Kim , Lin Wang , Sune-eui Yoon

Video Frame Interpolation (VFI) is a fundamental yet challenging task in computer vision, particularly under conditions involving large motion, occlusion, and lighting variation. Recent advancements in event cameras have opened up new…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Hanle Zheng , Xujie Han , Zegang Peng , Shangbin Zhang , Guangxun Du , Zhuo Zou , Xilin Wang , Jibin Wu , Hao Guo , Lei Deng

Traditional approaches to interpolate/extrapolate frames in a video sequence require accurate pixel correspondences between images, e.g., using optical flow. Their results stem on the accuracy of optical flow estimation, and could generate…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Zhe Hu , Yinglan Ma , Lizhuang Ma

Event cameras provide rich signals that are suitable for motion estimation since they respond to changes in the scene. As any visual changes in the scene produce event data, it is paramount to classify the data into different motions (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Ryo Yamaki , Shintaro Shiba , Guillermo Gallego , Yoshimitsu Aoki

Video frame interpolation is a fundamental tool for temporal video enhancement, but existing quality metrics struggle to evaluate the perceptual impact of interpolation artefacts effectively. Metrics like PSNR, SSIM and LPIPS ignore…

Image and Video Processing · Electrical Eng. & Systems 2026-01-23 Conall Daly , Darren Ramsook , Anil Kokaram

Video frame interpolation aims to synthesize nonexistent frames in-between the original frames. While significant advances have been made from the recent deep convolutional neural networks, the quality of interpolation is often reduced due…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Wenbo Bao , Wei-Sheng Lai , Chao Ma , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Video frame interpolation (VFI) is a challenging task that aims to generate intermediate frames between two consecutive frames in a video. Existing learning-based VFI methods have achieved great success, but they still suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Haoning Wu , Xiaoyun Zhang , Weidi Xie , Ya Zhang , Yanfeng Wang

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Zhihao Shi , Xiaohong Liu , Kangdi Shi , Linhui Dai , Jun Chen

In contrast to traditional cameras, whose pixels have a common exposure time, event-based cameras are novel bio-inspired sensors whose pixels work independently and asynchronously output intensity changes (called "events"), with microsecond…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Timo Stoffregen , Guillermo Gallego , Tom Drummond , Lindsay Kleeman , Davide Scaramuzza

Motion estimation (ME) and motion compensation (MC) have been widely used for classical video frame interpolation systems over the past decades. Recently, a number of data-driven frame interpolation methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Wenbo Bao , Wei-Sheng Lai , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Visual object tracking under challenging conditions of motion and light can be hindered by the capabilities of conventional cameras, prone to producing images with motion blur. Event cameras are novel sensors suited to robustly perform…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Irene Perez-Salesa , Rodrigo Aldana-Lopez , Carlos Sagues

Event cameras are a bio-inspired class of sensors that asynchronously measure per-pixel intensity changes. Under fixed illumination conditions in static or low-motion scenes, rigidly mounted event cameras are unable to generate any events…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Vincenzo Polizzi , Stephen Yang , Quentin Clark , Jonathan Kelly , Igor Gilitschenski , David B. Lindell

Video frame interpolation aims to generate high-quality intermediate frames from boundary frames and increase frame rate. While existing linear, symmetric and nonlinear models are used to bridge the gap from the lack of inter-frame motion,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Chenyang Shi , Hanxiao Liu , Jing Jin , Wenzhuo Li , Yuzhen Li , Boyi Wei , Yibo Zhang

We propose a light-weight video frame interpolation algorithm. Our key innovation is an instance-level supervision that allows information to be learned from the high-resolution version of similar objects. Our experiment shows that the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Liangzhe Yuan , Yibo Chen , Hantian Liu , Tao Kong , Jianbo Shi

Slow-motion replays provide a thrilling perspective on pivotal moments within sports games, offering a fresh and captivating visual experience. However, capturing slow-motion footage typically demands high-tech, expensive cameras and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Antoine Deckyvere , Anthony Cioppa , Silvio Giancola , Bernard Ghanem , Marc Van Droogenbroeck

Event-based cameras measure intensity changes (called `events') with microsecond accuracy under high-speed motion and challenging lighting conditions. With the `active pixel sensor' (APS), the `Dynamic and Active-pixel Vision Sensor'…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Liyuan Pan , Richard Hartley , Cedric Scheerlinck , Miaomiao Liu , Xin Yu , Yuchao Dai

The stereo event-intensity camera setup is widely applied to leverage the advantages of both event cameras with low latency and intensity cameras that capture accurate brightness and texture information. However, such a setup commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Chao Ding , Mingyuan Lin , Haijian Zhang , Jianzhuang Liu , Lei Yu

Event cameras are bio-inspired sensors that capture the per-pixel intensity changes asynchronously and produce event streams encoding the time, pixel position, and polarity (sign) of the intensity changes. Event cameras possess a myriad of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Xu Zheng , Yexin Liu , Yunfan Lu , Tongyan Hua , Tianbo Pan , Weiming Zhang , Dacheng Tao , Lin Wang

The field of neuromorphic vision is developing rapidly, and event cameras are finding their way into more and more applications. However, the data stream from these sensors is characterised by significant noise. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Marcin Kowlaczyk , Tomasz Kryjak

Effective video frame interpolation hinges on the adept handling of motion in the input scene. Prior work acknowledges asynchronous event information for this, but often overlooks whether motion induces blur in the video, limiting its scope…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Lei Sun , Daniel Gehrig , Christos Sakaridis , Mathias Gehrig , Jingyun Liang , Peng Sun , Zhijie Xu , Kaiwei Wang , Luc Van Gool , Davide Scaramuzza