English
Related papers

Related papers: Revisiting Adaptive Convolutions for Video Frame I…

200 papers

Video frame interpolation (VFI) is a fundamental research topic in video processing, which is currently attracting increased attention across the research community. While the development of more advanced VFI algorithms has been extensively…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Duolikun Danier , Fan Zhang , David Bull

Deep convolutional neutral networks have achieved great success on image recognition tasks. Yet, it is non-trivial to transfer the state-of-the-art image recognition networks to videos as per-frame evaluation is too slow and unaffordable.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Xizhou Zhu , Yuwen Xiong , Jifeng Dai , Lu Yuan , Yichen Wei

Current state-of-the-art methods for video inpainting typically rely on optical flow or attention-based approaches to inpaint masked regions by propagating visual information across frames. While such approaches have led to significant…

Light field cameras have many advantages over traditional cameras, as they allow the user to change various camera settings after capture. However, capturing light fields requires a huge bandwidth to record the data: a modern light field…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Ting-Chun Wang , Jun-Yan Zhu , Nima Khademi Kalantari , Alexei A. Efros , Ravi Ramamoorthi

We predict future video frames from complex dynamic scenes, using an invertible neural network as the encoder of a nonlinear dynamic system with latent linear state evolution. Our invertible linear embedding (ILE) demonstrates successful…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Robert Pottorff , Jared Nielsen , David Wingate

Recording fast motion in a high FPS (frame-per-second) requires expensive high-speed cameras. As an alternative, interpolating low-FPS videos from commodity cameras has attracted significant attention. If only low-FPS videos are available,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Weihua He , Kaichao You , Zhendong Qiao , Xu Jia , Ziyang Zhang , Wenhui Wang , Huchuan Lu , Yaoyuan Wang , Jianxing Liao

In image deconvolution problems, the diagonalization of the underlying operators by means of the FFT usually yields very large speedups. When there are incomplete observations (e.g., in the case of unknown boundaries), standard…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Miguel Simões , Luis B. Almeida , José Bioucas-Dias , Jocelyn Chanussot

Prevailing video frame interpolation algorithms, that generate the intermediate frames from consecutive inputs, typically rely on complex model architectures with heavy parameters or large delay, hindering them from diverse real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Xiaoming Huang , Ying Tai , Chengjie Wang , Jie Yang

This paper considers the challenging task of long-term video interpolation. Unlike most existing methods that only generate few intermediate frames between existing adjacent ones, we attempt to speculate or imagine the procedure of an…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Xiongtao Chen , Wenmin Wang , Jinzhuo Wang , Weimian Li , Baoyang Chen

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos. To this end, we present a unified framework of event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Xiang Zhang , Lei Yu

We propose a simple, interpretable framework for solving a wide range of image reconstruction problems such as denoising and deconvolution. Given a corrupted input image, the model synthesizes a spatially varying linear filter which, when…

Image and Video Processing · Electrical Eng. & Systems 2018-11-29 Shu Kong , Charless Fowlkes

There are many methods for image enhancement. Image inpainting is one of them which could be used in reconstruction and restoration of scratch images or editing images by adding or removing objects. According to its application, different…

Image and Video Processing · Electrical Eng. & Systems 2019-11-05 Zahra Nabizadeh , Ghazale Ghorbanzade , Nader Karimi , Shadrokh Samavi

Motion is a salient cue to recognize actions in video. Modern action recognition models leverage motion information either explicitly by using optical flow as input or implicitly by means of 3D convolutional filters that simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Heng Wang , Du Tran , Lorenzo Torresani , Matt Feiszli

Slow motion videos are becoming increasingly popular, but capturing high-resolution videos at extremely high frame rates requires professional high-speed cameras. To mitigate this problem, current techniques increase the frame rate of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Avinash Paliwal , Nima Khademi Kalantari

Image acquisition in low-light conditions suffers from poor quality and significant degradation in visual aesthetics. This affects the visual perception of the acquired image and the performance of various computer vision and image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Sumit Shekhar , Max Reimann , Amir Semmo , Sebastian Pasewaldt , Jürgen Döllner , Matthias Trapp

Effective video frame interpolation hinges on the adept handling of motion in the input scene. Prior work acknowledges asynchronous event information for this, but often overlooks whether motion induces blur in the video, limiting its scope…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Lei Sun , Daniel Gehrig , Christos Sakaridis , Mathias Gehrig , Jingyun Liang , Peng Sun , Zhijie Xu , Kaiwei Wang , Luc Van Gool , Davide Scaramuzza

LiDAR point cloud frame interpolation, which synthesizes the intermediate frame between the captured frames, has emerged as an important issue for many applications. Especially for reducing the amounts of point cloud transmission, it is by…

Image and Video Processing · Electrical Eng. & Systems 2021-10-14 Lili Zhao , Zezhi Zhu , Xuhu Lin , Xuezhou Guo , Qian Yin , Wenyi Wang , Jianwen Chen

Recent years have seen tremendous progress in still-image segmentation; however the na\"ive application of these state-of-the-art algorithms to every video frame requires considerable computation and ignores the temporal continuity inherent…

Computer Vision and Pattern Recognition · Computer Science 2016-08-15 Evan Shelhamer , Kate Rakelly , Judy Hoffman , Trevor Darrell

Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one. The question of how to strike a good trade-off between visual quality and computational speed has remained one of the open challenges in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Weiyue Zhao , Xin Li , Zhan Peng , Xianrui Luo , Xinyi Ye , Hao Lu , Zhiguo Cao

Large motion poses a critical challenge in Video Frame Interpolation (VFI) task. Existing methods are often constrained by limited receptive fields, resulting in sub-optimal performance when handling scenarios with large motion. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Chunxu Liu , Guozhen Zhang , Rui Zhao , Limin Wang