English
Related papers

Related papers: A Multi-In-Single-Out Network for Video Frame Inte…

200 papers

Blurry video frame interpolation (BVFI) aims to generate high-frame-rate clear videos from low-frame-rate blurry videos, is a challenging but important topic in the computer vision community. Blurry videos not only provide spatial and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Pengcheng Lei , Zaoming Yan , Tingting Wang , Faming Fang , Guixu Zhang

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Zhihao Shi , Xiaohong Liu , Kangdi Shi , Linhui Dai , Jun Chen

Capitalizing on the rapid development of neural networks, recent video frame interpolation (VFI) methods have achieved notable improvements. However, they still fall short for real-world videos containing large motions. Complex deformation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Changlin Li , Guangyang Wu , Yanan Sun , Xin Tao , Chi-Keung Tang , Yu-Wing Tai

We address the problem of synthesizing new video frames in an existing video, either in-between existing frames (interpolation), or subsequent to them (extrapolation). This problem is challenging because video appearance and motion can be…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Ziwei Liu , Raymond A. Yeh , Xiaoou Tang , Yiming Liu , Aseem Agarwala

We present VIDIM, a generative model for video interpolation, which creates short videos given a start and end frame. In order to achieve high fidelity and generate motions unseen in the input data, VIDIM uses cascaded diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Siddhant Jain , Daniel Watson , Eric Tabellion , Aleksander Hołyński , Ben Poole , Janne Kontkanen

For video frame interpolation (VFI), existing deep-learning-based approaches strongly rely on the ground-truth (GT) intermediate frames, which sometimes ignore the non-unique nature of motion judging from the given adjacent frames. As a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Kun Zhou , Wenbo Li , Xiaoguang Han , Jiangbo Lu

Previous methods for Video Frame Interpolation (VFI) have encountered challenges, notably the manifestation of blur and ghosting effects. These issues can be traced back to two pivotal factors: unavoidable motion errors and misalignment in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Guangyang Wu , Xin Tao , Changlin Li , Wenyi Wang , Xiaohong Liu , Qingqing Zheng

Slow-motion replays provide a thrilling perspective on pivotal moments within sports games, offering a fresh and captivating visual experience. However, capturing slow-motion footage typically demands high-tech, expensive cameras and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Antoine Deckyvere , Anthony Cioppa , Silvio Giancola , Bernard Ghanem , Marc Van Droogenbroeck

Recent progress in large-scale text-to-video (T2V) and image-to-video (I2V) diffusion models has greatly enhanced video generation, especially in terms of keyframe interpolation. However, current image-to-video diffusion models, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Serin Yang , Taesung Kwon , Jong Chul Ye

Deep learning based video frame interpolation (VIF) method, aiming to synthesis the intermediate frames to enhance video quality, have been highly developed in the past few years. This paper investigates the adversarial robustness of VIF…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Junpei Liao , Zhikai Chen , Liang Yi , Wenyuan Yang , Baoyuan Wu , Xiaochun Cao

Recently, video frame interpolation using a combination of frame- and event-based cameras has surpassed traditional image-based methods both in terms of performance and memory efficiency. However, current methods still suffer from (i)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Stepan Tulyakov , Alfredo Bochicchio , Daniel Gehrig , Stamatios Georgoulis , Yuanyou Li , Davide Scaramuzza

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Feng Huang , Xin Zhang , Yixuan Xu , Xuesong Wang , Xianyu Wu

Head-mounted 360{\deg} displays and portable 360{\deg} cameras have significantly progressed, providing viewers a realistic and immersive experience. However, many omnidirectional videos have low frame rates that can lead to visual fatigue,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Wenxuan Lu , Mengshun Hu , Yansheng Qiu , Liang Liao , Zheng Wang

The stereo event-intensity camera setup is widely applied to leverage the advantages of both event cameras with low latency and intensity cameras that capture accurate brightness and texture information. However, such a setup commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Chao Ding , Mingyuan Lin , Haijian Zhang , Jianzhuang Liu , Lei Yu

Exposure-agnostic video frame interpolation (VFI) is a challenging task that aims to recover sharp, high-frame-rate videos from blurry, low-frame-rate inputs captured under unknown and dynamic exposure conditions. Event cameras are sensors…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Junsik Jung , Yoonki Cho , Woo Jae Kim , Lin Wang , Sune-eui Yoon

Video stabilization is a fundamental and important technique for higher quality videos. Prior works have extensively explored video stabilization, but most of them involve cropping of the frame boundaries and introduce moderate levels of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Jinsoo Choi , In So Kweon

Video frame interpolation is the task of creating an interframe between two adjacent frames along the time axis. So, instead of simply averaging two adjacent frames to create an intermediate image, this operation should maintain semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Saem Park , Donghoon Han , Nojun Kwak

Video frame interpolation aims to synthesize one or multiple frames between two consecutive frames in a video. It has a wide range of applications including slow-motion video generation, frame-rate up-scaling and developing video codecs.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Saikat Dutta , Arulkumar Subramaniam , Anurag Mittal

Motion-based video frame interpolation (VFI) methods have made remarkable progress with the development of deep convolutional networks over the past years. While their performance is often jeopardized by the inaccuracy of flow map…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Pengcheng Lei , Faming Fang , Guixu Zhang

Models optimized for accuracy on single images are often prohibitively slow to run on each frame in a video. Recent work exploits the use of optical flow to warp image features forward from select keyframes, as a means to conserve…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Samvit Jain , Joseph E. Gonzalez