English
Related papers

Related papers: Video Frame Interpolation with Many-to-many Splatt…

200 papers

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Qiqi Hou , Abhijay Ghildyal , Feng Liu

High-frequency displays are gaining immense popularity because of their increasing use in video games and virtual reality applications. However, the issue is that the underlying GPUs cannot continuously generate frames at this high rate --…

Graphics · Computer Science 2023-07-25 Akanksha Dixit , Yashashwee Chakrabarty , Smruti R. Sarangi

This paper presents a new deformable convolution-based video frame interpolation (VFI) method, using a coarse to fine 3D CNN to enhance the multi-flow prediction. This model first extracts spatio-temporal features at multiple scales using a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Duolikun Danier , Fan Zhang , David Bull

In recent years, visual SLAM has achieved great progress and development in different scenes, however, there are still many problems to be solved. The SLAM system is not only restricted by the external scenes but is also affected by its…

Robotics · Computer Science 2021-10-25 Zhenkun Zhu , Jikai Wang

We propose an end-to-end learned video compression scheme for low-latency scenarios. Previous methods are limited in using the previous one frame as reference. Our method introduces the usage of the previous multiple frames as references.…

Image and Video Processing · Electrical Eng. & Systems 2021-08-02 Jianping Lin , Dong Liu , Houqiang Li , Feng Wu

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Feng Huang , Xin Zhang , Yixuan Xu , Xuesong Wang , Xianyu Wu

Video frame interpolation (VFI) enables many important applications that might involve the temporal domain, such as slow motion playback, or the spatial domain, such as stop motion sequences. We are focusing on the former task, where one of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Uğur Çoğalan , Mojtaba Bemana , Hans-Peter Seidel , Karol Myszkowski

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos. To this end, we present a unified framework of event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Xiang Zhang , Lei Yu

Mixup refers to interpolation-based data augmentation, originally motivated as a way to go beyond empirical risk minimization (ERM). Yet, its extensions focus on the definition of interpolation and the space where it takes place, while the…

Machine Learning · Computer Science 2022-07-01 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Most approaches for video frame interpolation require accurate dense correspondences to synthesize an in-between frame. Therefore, they do not perform well in challenging scenarios with e.g. lighting changes or motion blur. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Simone Meyer , Abdelaziz Djelouah , Brian McWilliams , Alexander Sorkine-Hornung , Markus Gross , Christopher Schroers

Optical Flow algorithms are of high importance for many applications. Recently, the Flow Field algorithm and its modifications have shown remarkable results, as they have been evaluated with top accuracy on different data sets. In our…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 René Schuster , Christian Bailer , Oliver Wasenmüller , Didier Stricker

Video frame interpolation aims to generate high-quality intermediate frames from boundary frames and increase frame rate. While existing linear, symmetric and nonlinear models are used to bridge the gap from the lack of inter-frame motion,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Chenyang Shi , Hanxiao Liu , Jing Jin , Wenzhuo Li , Yuzhen Li , Boyi Wei , Yibo Zhang

Fluorescence microscopy is widely employed for the analysis of living biological samples; however, the utility of the resulting recordings is frequently constrained by noise, temporal variability, and inconsistent visualisation of signals…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Hassan Eshkiki , Sarah Costa , Mostafa Mohammadpour , Farinaz Tanhaei , Christopher H. George , Fabio Caraffini

In this paper, we propose an approach for view-time interpolation of stereo videos. Specifically, we build upon X-Fields that approximates an interpolatable mapping between the input coordinates and 2D RGB images using a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Avinash Paliwal , Andrii Tsarov , Nima Khademi Kalantari

Real-world binary classification tasks are in many cases imbalanced, where the minority class is much smaller than the majority class. This skewness is challenging for machine learning algorithms as they tend to focus on the majority and…

Machine Learning · Computer Science 2021-05-19 Sajad Darabi , Yotam Elor

Video Frame Interpolation (VFI) aims to synthesize intermediate frames between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works have employed generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaihyun Lew , Jooyoung Choi , Chaehun Shin , Dahuin Jung , Sungroh Yoon

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

Small object detection presents a significant challenge in computer vision and object detection. The performance of small object detectors is often compromised by a lack of pixels and less significant features. This issue stems from…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xiaohui Guo

Traditional image stitching focuses on a single panorama frame without considering the spatial-temporal consistency in videos. The straightforward image stitching approach will cause temporal flicking and color inconstancy when it is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Lu Yang , Zhenglun Kong , Ting Li , Xinyi Bai , Zhiye Lin , Hong Cheng

Applications in materials and biological imaging are limited by the ability to collect high-resolution data over large areas in practical amounts of time. One solution to this problem is to collect low-resolution data and interpolate to…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Emma J Reid , Lawrence F Drummy , Charles A Bouman , Gregery T Buzzard