English
Related papers

Related papers: Self-supervised Learning of Event-guided Video Fra…

200 papers

This paper explores an efficient solution for Space-time Super-Resolution, aiming to generate High-resolution Slow-motion videos from Low Resolution and Low Frame rate videos. A simplistic solution is the sequential running of Video Super…

Image and Video Processing · Electrical Eng. & Systems 2021-06-09 Saikat Dutta , Nisarg A. Shah , Anurag Mittal

Learning to synthesize high frame rate videos via interpolation requires large quantities of high frame rate training videos, which, however, are scarce, especially at high resolutions. Here, we propose unsupervised techniques to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Fitsum A. Reda , Deqing Sun , Aysegul Dundar , Mohammad Shoeybi , Guilin Liu , Kevin J. Shih , Andrew Tao , Jan Kautz , Bryan Catanzaro

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

Joint rolling shutter correction and deblurring (RSCD) techniques are critical for the prevalent CMOS cameras. However, current approaches are still based on conventional energy optimization and are developed for static scenes. To enable…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zhihang Zhong , Yinqiang Zheng , Imari Sato

Effective video frame interpolation hinges on the adept handling of motion in the input scene. Prior work acknowledges asynchronous event information for this, but often overlooks whether motion induces blur in the video, limiting its scope…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Lei Sun , Daniel Gehrig , Christos Sakaridis , Mathias Gehrig , Jingyun Liang , Peng Sun , Zhijie Xu , Kaiwei Wang , Luc Van Gool , Davide Scaramuzza

High-dynamic scene reconstruction aims to represent static background with rigid spatial features and dynamic objects with deformed continuous spatiotemporal features. Typically, existing methods adopt unified representation model (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Hanyu Zhou , Haonan Wang , Haoyue Liu , Yuxing Duan , Luxin Yan , Gim Hee Lee

When a very fast dynamic event is recorded with a low-framerate camera, the resulting video suffers from severe motion blur (due to exposure time) and motion aliasing (due to low sampling rate in time). True Temporal Super-Resolution (TSR)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Liad Pollak Zuckerman , Eyal Naor , George Pisha , Shai Bagon , Michal Irani

Super-resolution (SR) has been widely used to convert low-resolution legacy videos to high-resolution (HR) ones, to suit the increasing resolution of displays (e.g. UHD TVs). However, it becomes easier for humans to notice motion artifacts…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Soo Ye Kim , Jihyong Oh , Munchurl Kim

Frame-based cameras with extended exposure times often produce perceptible visual blurring and information loss between frames, significantly degrading video quality. To address this challenge, we introduce EVDI++, a unified self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Chi Zhang , Xiang Zhang , Chenxu Jiang , Gui-Song Xia , Lei Yu

Slow motion videos are becoming increasingly popular, but capturing high-resolution videos at extremely high frame rates requires professional high-speed cameras. To mitigate this problem, current techniques increase the frame rate of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Avinash Paliwal , Nima Khademi Kalantari

Video stabilization is a fundamental and important technique for higher quality videos. Prior works have extensively explored video stabilization, but most of them involve cropping of the frame boundaries and introduce moderate levels of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Jinsoo Choi , In So Kweon

In this paper we consider critical motion sequences (CMSs) of rolling-shutter (RS) SfM. Employing an RS camera model with linearized pure rotation, we show that the RS distortion can be approximately expressed by two internal parameters of…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Eisuke Ito , Takayuki Okatani

In this paper, we explore the space-time video super-resolution task, which aims to generate a high-resolution (HR) slow-motion video from a low frame rate (LFR), low-resolution (LR) video. A simple solution is to split it into two…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xiaoyu Xiang , Yapeng Tian , Yulun Zhang , Yun Fu , Jan P. Allebach , Chenliang Xu

Recording fast motion in a high FPS (frame-per-second) requires expensive high-speed cameras. As an alternative, interpolating low-FPS videos from commodity cameras has attracted significant attention. If only low-FPS videos are available,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Weihua He , Kaichao You , Zhendong Qiao , Xu Jia , Ziyang Zhang , Wenhui Wang , Huchuan Lu , Yaoyuan Wang , Jianxing Liao

Because image sensor chips have a finite bandwidth with which to read out pixels, recording video typically requires a trade-off between frame rate and pixel count. Compressed sensing techniques can circumvent this trade-off by assuming…

Image and Video Processing · Electrical Eng. & Systems 2019-05-31 Nick Antipa , Patrick Oare , Emrah Bostan , Ren Ng , Laura Waller

Deformable 3D Gaussian Splatting (3D-GS) is limited by missing intermediate motion information due to the low temporal resolution of RGB cameras. To address this, we introduce the first approach combining event cameras, which capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Wenhao Xu , Wenming Weng , Yueyi Zhang , Ruikang Xu , Zhiwei Xiong

In real-world single image super-resolution (SISR) task, the low-resolution image suffers more complicated degradations, not only downsampled by unknown kernels. However, existing SISR methods are generally studied with the synthetic…

Image and Video Processing · Electrical Eng. & Systems 2020-09-15 Guanghao Yin , Shouqian Sun , Chao Li , Xin Min

This paper presents a dense depth estimation approach from light-field (LF) images that is able to compensate for strong rolling shutter (RS) effects. Our method estimates RS compensated views and dense RS compensated disparity maps. We…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Hermes McGriff , Renato Martins , Nicolas Andreff , Cedric Demonceaux

We propose a novel rolling shutter bundle adjustment method for neural radiance fields (NeRF), which utilizes the unordered rolling shutter (RS) images to obtain the implicit 3D representation. Existing NeRF methods suffer from low-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Bo Xu , Ziao Liu , Mengqi Guo , Jiancheng Li , Gim Hee Lee

Recently, video frame interpolation using a combination of frame- and event-based cameras has surpassed traditional image-based methods both in terms of performance and memory efficiency. However, current methods still suffer from (i)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Stepan Tulyakov , Alfredo Bochicchio , Daniel Gehrig , Stamatios Georgoulis , Yuanyou Li , Davide Scaramuzza