English
Related papers

Related papers: A Unified Framework for Event-based Frame Interpol…

200 papers

Shooting video with handheld shooting devices often results in blurry frames due to shaking hands and other instability factors. Although previous video deblurring methods have achieved impressive progress, they still struggle to perform…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Honglei Xu , Zhilu Zhang , Junjie Fan , Xiaohe Wu , Wangmeng Zuo

Video frame interpolation task has recently become more and more prevalent in the computer vision field. At present, a number of researches based on deep learning have achieved great success. Most of them are either based on optical flow…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Haoyue Tian , Pan Gao , Xiaojiang Peng

We propose a novel framework to generate clean video frames from a single motion-blurred image. While a broad range of literature focuses on recovering a single image from a blurred image, in this work, we tackle a more challenging task…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Dawit Mureja Argaw , Junsik Kim , Francois Rameau , Chaoning Zhang , In So Kweon

In this work, we propose a novel framework for unsupervised learning for event cameras that learns motion information from only the event stream. In particular, we propose an input representation of the events in the form of a discretized…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Alex Zihao Zhu , Liangzhe Yuan , Kenneth Chaney , Kostas Daniilidis

Event-guided motion deblurring reconstructs sharp images using the high-temporal-resolution motion cues from event cameras. However, in real capture, thresholding-induced event under-reporting causes missing and fragmented motion cues,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yihong Leng , Siming Zheng , Jinwei Chen , Bo Li , Jiaojiao Li , Peng-Tao Jiang

Recently, flow-based frame interpolation methods have achieved great success by first modeling optical flow between target and input frames, and then building synthesis network for target frame generation. However, above cascaded…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jinfeng Liu , Jie Yang

Most existing RGB-based trackers target low frame rate benchmarks of around 30 frames per second. This setting restricts the tracker's functionality in the real world, especially for fast motion. Event-based cameras as bioinspired sensors…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jiqing Zhang , Yuanchen Wang , Wenxi Liu , Meng Li , Jinpeng Bai , Baocai Yin , Xin Yang

Large text-to-image diffusion models have exhibited impressive proficiency in generating high-quality images. However, when applying these models to video domain, ensuring temporal consistency across video frames remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Shuai Yang , Yifan Zhou , Ziwei Liu , Chen Change Loy

Video frame interpolation (VFI), which aims to synthesize intermediate frames of a video, has made remarkable progress with development of deep convolutional networks over past years. Existing methods built upon convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Liying Lu , Ruizheng Wu , Huaijia Lin , Jiangbo Lu , Jiaya Jia

Applying image processing algorithms independently to each frame of a video often leads to undesired inconsistent results over time. Developing temporally consistent video-based extensions, however, requires domain knowledge for individual…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Wei-Sheng Lai , Jia-Bin Huang , Oliver Wang , Eli Shechtman , Ersin Yumer , Ming-Hsuan Yang

The stark contrast in the design philosophy of an event camera makes it particularly ideal for operating under high-speed, high dynamic range and low-light conditions, where standard cameras underperform. Nonetheless, event cameras still…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Weng Fei Low , Gim Hee Lee

In the animation industry, cartoon videos are usually produced at low frame rate since hand drawing of such frames is costly and time-consuming. Therefore, it is desirable to develop computational models that can automatically interpolate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Li Siyao , Shiyu Zhao , Weijiang Yu , Wenxiu Sun , Dimitris N. Metaxas , Chen Change Loy , Ziwei Liu

Models optimized for accuracy on single images are often prohibitively slow to run on each frame in a video. Recent work exploits the use of optical flow to warp image features forward from select keyframes, as a means to conserve…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Samvit Jain , Joseph E. Gonzalez

In this paper, we examine the problem of real-world image deblurring and take into account two key factors for improving the performance of the deep image deblurring model, namely, training data synthesis and network architecture design.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Hao Wei , Chenyang Ge , Xin Qiao , Pengchao Deng

The bio-inspired event cameras or dynamic vision sensors are capable of asynchronously capturing per-pixel brightness changes (called event-streams) in high temporal resolution and high dynamic range. However, the non-structural…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Qiang Qu , Yiran Shen , Xiaoming Chen , Yuk Ying Chung , Tongliang Liu

Non-uniform image deblurring is a challenging task due to the lack of temporal and textural information in the blurry image itself. Complementary information from auxiliary sensors such event sensors are being explored to address these…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Patricia Vitoria , Stamatios Georgoulis , Stepan Tulyakov , Alfredo Bochicchio , Julius Erbach , Yuanyou Li

Video frame interpolation is an important low-level vision task, which can increase frame rate for more fluent visual experience. Existing methods have achieved great success by employing advanced motion models and synthesis networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Ying Tai , Chengjie Wang , Jie Yang

Prevailing video frame interpolation algorithms, that generate the intermediate frames from consecutive inputs, typically rely on complex model architectures with heavy parameters or large delay, hindering them from diverse real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Xiaoming Huang , Ying Tai , Chengjie Wang , Jie Yang

State-of-the-art video deblurring methods use deep network architectures to recover sharpened video frames. Blurring especially degrades high-frequency (HF) information, yet this aspect is often overlooked by recent models that focus more…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Bo Ji , Angela Yao

Video frame interpolation (VFI) is a challenging task that aims to generate intermediate frames between two consecutive frames in a video. Existing learning-based VFI methods have achieved great success, but they still suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Haoning Wu , Xiaoyun Zhang , Weidi Xie , Ya Zhang , Yanfeng Wang