English
Related papers

Related papers: TimeLens: Event-based Video Frame Interpolation

200 papers

The field of neuromorphic vision is developing rapidly, and event cameras are finding their way into more and more applications. However, the data stream from these sensors is characterised by significant noise. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Marcin Kowlaczyk , Tomasz Kryjak

Optical flow estimation has achieved promising results in conventional scenes but faces challenges in high-speed and low-light scenes, which suffer from motion blur and insufficient illumination. These conditions lead to weakened texture…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Haonan Wang , Hanyu Zhou , Haoyue Liu , Luxin Yan

Most recent diffusion-based methods still show a large gap compared to non-diffusion methods for video frame interpolation, in both accuracy and efficiency. Most of them formulate the problem as a denoising procedure in latent space…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yang Hai , Guo Wang , Tan Su , Wenjie Jiang , Yinlin Hu

LiDAR point cloud frame interpolation, which synthesizes the intermediate frame between the captured frames, has emerged as an important issue for many applications. Especially for reducing the amounts of point cloud transmission, it is by…

Image and Video Processing · Electrical Eng. & Systems 2021-10-14 Lili Zhao , Zezhi Zhu , Xuhu Lin , Xuezhou Guo , Qian Yin , Wenyi Wang , Jianwen Chen

Visual object tracking under challenging conditions of motion and light can be hindered by the capabilities of conventional cameras, prone to producing images with motion blur. Event cameras are novel sensors suited to robustly perform…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Irene Perez-Salesa , Rodrigo Aldana-Lopez , Carlos Sagues

Prediction and interpolation for long-range video data involves the complex task of modeling motion trajectories for each visible object, occlusions and dis-occlusions, as well as appearance changes due to viewpoint and lighting. Optical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Kevin J. Shih , Aysegul Dundar , Animesh Garg , Robert Pottorf , Andrew Tao , Bryan Catanzaro

As event-based sensing gains in popularity, theoretical understanding is needed to harness this technology's potential. Instead of recording video by capturing frames, event-based cameras have sensors that emit events when their inputs…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Karen Adam , Adam Scholefield , Martin Vetterli

Event cameras are novel sensors that report brightness changes in the form of asynchronous "events" instead of intensity frames. They have significant advantages over conventional cameras: high temporal resolution, high dynamic range, and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Henri Rebecq , René Ranftl , Vladlen Koltun , Davide Scaramuzza

Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation. However, few studies have approached the joint video enhancement problem, namely synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Wang Shen , Wenbo Bao , Guangtao Zhai , Li Chen , Xiongkuo Min , Zhiyong Gao

The problem of video inter-frame interpolation is an essential task in the field of image processing. Correctly increasing the number of frames in the recording while maintaining smooth movement allows to improve the quality of played video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Malwina Kubas , Grzegorz Sarwas

Pairwise camera pose estimation from sparsely overlapping image pairs remains a critical and unsolved challenge in 3D vision. Most existing methods struggle with image pairs that have small or no overlap. Recent approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Qing Mao , Tianxin Huang , Yu Zhu , Jinqiu Sun , Yanning Zhang , Gim Hee Lee

Event Cameras, also known as Neuromorphic sensors, capture changes in local light intensity at the pixel level, producing asynchronously generated data termed ``events''. This distinct data format mitigates common issues observed in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Khadija Iddrisu , Waseem Shariff , Noel E. OConnor , Joseph Lemley , Suzanne Little

Event cameras, which feature pixels that independently respond to changes in brightness, are becoming increasingly popular in high-speed applications due to their lower latency, reduced bandwidth requirements, and enhanced dynamic range…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ziyuan Qu , Zihao Zou , Vivek Boominathan , Praneeth Chakravarthula , Adithya Pediredla

In low-light conditions, capturing videos with frame-based cameras often requires long exposure times, resulting in motion blur and reduced visibility. While frame-based motion deblurring and low-light enhancement have been studied, they…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Taewoo Kim , Jaeseok Jeong , Hoonhee Cho , Yuhwan Jeong , Kuk-Jin Yoon

High-speed imaging is central to the experimental investigation of fast phenomena, like flapping flags. Event-based cameras use new types of sensors that address typical challenges such as low illumination conditions, large data transfer,…

Fluid Dynamics · Physics 2024-12-10 Gaetan Raynaud , Karen Mulleners

Event-based cameras can overpass frame-based cameras limitations for important tasks such as high-speed motion detection during self-driving cars navigation in low illumination conditions. The event cameras' high temporal resolution and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Haixin Sun , Minh-Quan Dao , Vincent Fremont

Video prediction is an extrapolation task that predicts future frames given past frames, and video frame interpolation is an interpolation task that estimates intermediate frames between two frames. We have witnessed the tremendous…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Yue Wu , Qiang Wen , Qifeng Chen

We present a novel method to estimate the surface normal of an object in an ambient light environment using RGB and event cameras. Modern photometric stereo methods rely on an RGB camera, mainly in a dark room, to avoid ambient…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Wonjeong Ryoo , Giljoo Nam , Jae-Sang Hyun , Sangpil Kim

Slow motion videos are becoming increasingly popular, but capturing high-resolution videos at extremely high frame rates requires professional high-speed cameras. To mitigate this problem, current techniques increase the frame rate of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Avinash Paliwal , Nima Khademi Kalantari

Event cameras capture brightness changes asynchronously with microsecond resolution, yet existing optical flow methods fail to fully exploit this temporal continuity. Frame-based approaches impose artificial accumulation latency and suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Gunwoo Jeon , Chaesong Park , Jongwoo Lim