中文
相关论文

相关论文: Error-Aware Spatial Ensembles for Video Frame Inte…

200 篇论文

Pre-trained image editing models exhibit strong spatial reasoning and object-aware transformation capabilities acquired from billions of image-text pairs, yet they possess no explicit temporal modeling. This paper demonstrates that these…

Frame interpolation is an essential video processing technique that adjusts the temporal resolution of an image sequence. While deep learning has brought great improvements to the area of video frame interpolation, techniques that make use…

计算机视觉与模式识别 · 计算机科学 2022-10-27 Simon Niklaus , Ping Hu , Jiawen Chen

Video frame interpolation aims to synthesize one or multiple frames between two consecutive frames in a video. It has a wide range of applications including slow-motion video generation, frame-rate up-scaling and developing video codecs.…

计算机视觉与模式识别 · 计算机科学 2022-04-14 Saikat Dutta , Arulkumar Subramaniam , Anurag Mittal

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

计算机视觉与模式识别 · 计算机科学 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

Existing video frame interpolation methods can only interpolate the frame at a given intermediate time-step, e.g. 1/2. In this paper, we aim to explore a more generalized kind of video frame interpolation, that at an arbitrary time-step. To…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Shixing Yu , Yiyang Ma , Wenhan Yang , Wei Xiang , Jiaying Liu

Versatile Video Coding (VVC) introduces more coding tools to improve compression efficiency compared to its predecessor High Efficiency Video Coding (HEVC). For inter-frame coding, Fractional Motion Estimation (FME) still has a high…

图像与视频处理 · 电气工程与系统科学 2023-02-14 Shushi Chen , Leilei Huang , Jiahao Liu , Chao Liu , Yibo Fan

Consecutive frames in a video contain redundancy, but they may also contain relevant complementary information for the detection task. The objective of our work is to leverage this complementary information to improve detection. Therefore,…

计算机视觉与模式识别 · 计算机科学 2024-02-19 Noreen Anwar , Guillaume-Alexandre Bilodeau , Wassim Bouachir

With the prosperity of digital video industry, video frame interpolation has arisen continuous attention in computer vision community and become a new upsurge in industry. Many learning-based methods have been proposed and achieved…

计算机视觉与模式识别 · 计算机科学 2020-09-11 Yihao Liu , Liangbin Xie , Li Siyao , Wenxiu Sun , Yu Qiao , Chao Dong

This work presents a supervised learning based approach to the computer vision problem of frame interpolation. The presented technique could also be used in the cartoon animations since drawing each individual frame consumes a noticeable…

计算机视觉与模式识别 · 计算机科学 2017-06-16 Vladislav Samsonov

Slow-motion replays provide a thrilling perspective on pivotal moments within sports games, offering a fresh and captivating visual experience. However, capturing slow-motion footage typically demands high-tech, expensive cameras and…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Antoine Deckyvere , Anthony Cioppa , Silvio Giancola , Bernard Ghanem , Marc Van Droogenbroeck

With the development of video generation models has advanced significantly in recent years, we adopt large-scale image-to-video diffusion models for video frame interpolation. We present a conditional encoder designed to adapt an…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Luoxu Jin , Hiroshi Watanabe

Video stabilization is a fundamental and important technique for higher quality videos. Prior works have extensively explored video stabilization, but most of them involve cropping of the frame boundaries and introduce moderate levels of…

计算机视觉与模式识别 · 计算机科学 2019-09-09 Jinsoo Choi , In So Kweon

Super-resolution (SR) has been widely used to convert low-resolution legacy videos to high-resolution (HR) ones, to suit the increasing resolution of displays (e.g. UHD TVs). However, it becomes easier for humans to notice motion artifacts…

计算机视觉与模式识别 · 计算机科学 2022-02-08 Soo Ye Kim , Jihyong Oh , Munchurl Kim

Convolutional networks optimized for accuracy on challenging, dense prediction tasks are prohibitively slow to run on each frame in a video. The spatial similarity of nearby video frames, however, suggests opportunity to reuse computation.…

计算机视觉与模式识别 · 计算机科学 2018-11-27 Samvit Jain , Joseph E. Gonzalez

LiDAR point cloud frame interpolation, which synthesizes the intermediate frame between the captured frames, has emerged as an important issue for many applications. Especially for reducing the amounts of point cloud transmission, it is by…

图像与视频处理 · 电气工程与系统科学 2021-10-14 Lili Zhao , Zezhi Zhu , Xuhu Lin , Xuezhou Guo , Qian Yin , Wenyi Wang , Jianwen Chen

In this paper, we propose an algorithm to interpolate between a pair of images of a dynamic scene. While in the past years significant progress in frame interpolation has been made, current approaches are not able to handle images with…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Pedro Figueirêdo , Avinash Paliwal , Nima Khademi Kalantari

Video frame interpolation has long been challenged by limited controllability and interactivity, especially in scenarios involving fast, highly non-linear, and fine-grained motion. Although recent interactive interpolation methods have made…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Yuchen Deng , Xiuyang Wu , Hai-Tao Zheng , Jie Wang , Feidiao Yang , Yuxing Han

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

计算机视觉与模式识别 · 计算机科学 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

Motion modeling is critical in flow-based Video Frame Interpolation (VFI). Existing paradigms either consider linear combinations of bidirectional flows or directly predict bilateral flows for given timestamps without exploring favorable…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Zujin Guo , Wei Li , Chen Change Loy

The quality of frames is significant for both research and application of video frame interpolation (VFI). In recent VFI studies, the methods of full-reference image quality assessment have generally been used to evaluate the quality of VFI…

图像与视频处理 · 电气工程与系统科学 2023-12-27 Jinliang Han , Xiongkuo Min , Yixuan Gao , Jun Jia , Lei Sun , Zuowei Cao , Yonglin Luo , Guangtao Zhai