English
Related papers

Related papers: Revisiting Event-based Video Frame Interpolation

200 papers

We present ContinuityCam, a novel approach to generate a continuous video from a single static RGB image and an event camera stream. Conventional cameras struggle with high-speed motion capture due to bandwidth and dynamic range…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ziyun Wang , Friedhelm Hamann , Kenneth Chaney , Wen Jiang , Guillermo Gallego , Kostas Daniilidis

Event camera sensors are bio-inspired sensors which asynchronously capture per-pixel brightness changes and output a stream of events encoding the polarity, location and time of these changes. These systems are witnessing rapid advancements…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Aupendu Kar , Vishnu Raj , Guan-Ming Su

The field of neuromorphic vision is developing rapidly, and event cameras are finding their way into more and more applications. However, the data stream from these sensors is characterised by significant noise. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Marcin Kowlaczyk , Tomasz Kryjak

Video Frame Interpolation (VFI) is a fundamental yet challenging task in computer vision, particularly under conditions involving large motion, occlusion, and lighting variation. Recent advancements in event cameras have opened up new…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Hanle Zheng , Xujie Han , Zegang Peng , Shangbin Zhang , Guangxun Du , Zhuo Zou , Xilin Wang , Jibin Wu , Hao Guo , Lei Deng

We present a frame interpolation algorithm that synthesizes multiple intermediate frames from two input images with large in-between motion. Recent methods use multiple networks to estimate optical flow or depth and a separate network…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Fitsum Reda , Janne Kontkanen , Eric Tabellion , Deqing Sun , Caroline Pantofaru , Brian Curless

Event cameras are bio-inspired sensors that capture the per-pixel intensity changes asynchronously and produce event streams encoding the time, pixel position, and polarity (sign) of the intensity changes. Event cameras possess a myriad of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Xu Zheng , Yexin Liu , Yunfan Lu , Tongyan Hua , Tianbo Pan , Weiming Zhang , Dacheng Tao , Lin Wang

Slow-motion replays provide a thrilling perspective on pivotal moments within sports games, offering a fresh and captivating visual experience. However, capturing slow-motion footage typically demands high-tech, expensive cameras and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Antoine Deckyvere , Anthony Cioppa , Silvio Giancola , Bernard Ghanem , Marc Van Droogenbroeck

Event cameras provide asynchronous, data-driven measurements of local temporal contrast over a large dynamic range with extremely high temporal resolution. Conventional cameras capture low-frequency reference intensity information. These…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Cedric Scheerlinck , Nick Barnes , Robert Mahony

Event-based camera is a bio-inspired vision sensor that records intensity changes (called event) asynchronously in each pixel. As an instance of event-based camera, Dynamic and Active-pixel Vision Sensor (DAVIS) combines a standard camera…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Yuhu Guo , Han Xiao , Yidong Chen , Xiaodong Shi

Video frame interpolation (VFI) in scenarios with large motion remains challenging due to motion ambiguity between frames. While event cameras can capture high temporal resolution motion information, existing event-based VFI methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Ziran Zhang , Xiaohui Li , Yihao Liu , Yujin Wang , Yueting Chen , Tianfan Xue , Shi Guo

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

Video Frame Interpolation (VFI) aims to generate intermediate video frames between consecutive input frames. Since the event cameras are bio-inspired sensors that only encode brightness changes with a micro-second temporal resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Taewoo Kim , Yujeong Chae , Hyun-Kurl Jang , Kuk-Jin Yoon

The stereo event-intensity camera setup is widely applied to leverage the advantages of both event cameras with low latency and intensity cameras that capture accurate brightness and texture information. However, such a setup commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Chao Ding , Mingyuan Lin , Haijian Zhang , Jianzhuang Liu , Lei Yu

Video Frame Interpolation synthesizes non-existent images between adjacent frames, with the aim of providing a smooth and consistent visual experience. Two approaches for solving this challenging task are optical flow based and kernel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xi Li , Meng Cao , Yingying Tang , Scott Johnston , Zhendong Hong , Huimin Ma , Jiulong Shan

Most approaches for video frame interpolation require accurate dense correspondences to synthesize an in-between frame. Therefore, they do not perform well in challenging scenarios with e.g. lighting changes or motion blur. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Simone Meyer , Abdelaziz Djelouah , Brian McWilliams , Alexander Sorkine-Hornung , Markus Gross , Christopher Schroers

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

Video interpolation is an important problem in computer vision, which helps overcome the temporal limitation of camera sensors. Existing video interpolation methods usually assume uniform motion between consecutive frames and use linear…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Xiangyu Xu , Li Siyao , Wenxiu Sun , Qian Yin , Ming-Hsuan Yang

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

The event camera, benefiting from its high dynamic range and low latency, provides performance gain for low-light image enhancement. Unlike frame-based cameras, it records intensity changes with extremely high temporal resolution, capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Chunyan She , Fujun Han , Chengyu Fang , Shukai Duan , Lidan Wang

Traditional approaches to interpolate/extrapolate frames in a video sequence require accurate pixel correspondences between images, e.g., using optical flow. Their results stem on the accuracy of optical flow estimation, and could generate…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Zhe Hu , Yinglan Ma , Lizhuang Ma