中文
相关论文

相关论文: Triple Motion Estimation and Frame Interpolation b…

200 篇论文

Motion-based video frame interpolation commonly relies on optical flow to warp pixels from the inputs to the desired interpolation instant. Yet due to the inherent challenges of motion estimation (e.g. occlusions and discontinuities), most…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Ping Hu , Simon Niklaus , Stan Sclaroff , Kate Saenko

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect…

计算机视觉与模式识别 · 计算机科学 2020-11-04 Simon Niklaus , Long Mai , Oliver Wang

We propose Framer for interactive frame interpolation, which targets producing smoothly transitioning frames between two images as per user creativity. Concretely, besides taking the start and end frames as inputs, our approach supports…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Wen Wang , Qiuyu Wang , Kecheng Zheng , Hao Ouyang , Zhekai Chen , Biao Gong , Hao Chen , Yujun Shen , Chunhua Shen

Learned B-frame video compression aims to adopt bi-directional motion estimation and motion compensation (MEMC) coding for middle frame reconstruction. However, previous learned approaches often directly extend neural P-frame codecs to…

图像与视频处理 · 电气工程与系统科学 2024-05-08 Chenming Xu , Meiqin Liu , Chao Yao , Weisi Lin , Yao Zhao

Video frame interpolation is one of the most challenging tasks in video processing research. Recently, many studies based on deep learning have been suggested. Most of these methods focus on finding locations with useful information to…

计算机视觉与模式识别 · 计算机科学 2020-03-10 Hyeongmin Lee , Taeoh Kim , Tae-young Chung , Daehyun Pak , Yuseok Ban , Sangyoun Lee

Video Frame Interpolation (VFI) aims to synthesize non-existent intermediate frames between existent frames. Flow-based VFI algorithms estimate intermediate motion fields to warp the existent frames. Real-world motions' complexity and the…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Chang Zhou , Jie Liu , Jie Tang , Gangshan Wu

During transmission of video data over error-prone channels the risk of getting severe image distortions due to transmission errors is ubiquitous. To deal with image distortions at decoder side, error concealment is applied. This article…

图像与视频处理 · 电气工程与系统科学 2022-04-28 Jürgen Seiler , André Kaup

Models optimized for accuracy on single images are often prohibitively slow to run on each frame in a video. Recent work exploits the use of optical flow to warp image features forward from select keyframes, as a means to conserve…

计算机视觉与模式识别 · 计算机科学 2018-10-10 Samvit Jain , Joseph E. Gonzalez

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

计算机视觉与模式识别 · 计算机科学 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

Motion-compensated MR reconstruction (MCMR) is a powerful concept with considerable potential, consisting of two coupled sub-problems: Motion estimation, assuming a known image, and image reconstruction, assuming known motion. In this work,…

图像与视频处理 · 电气工程与系统科学 2022-09-09 Jiazhen Pan , Daniel Rueckert , Thomas Küstner , Kerstin Hammernik

We propose a light-weight video frame interpolation algorithm. Our key innovation is an instance-level supervision that allows information to be learned from the high-resolution version of similar objects. Our experiment shows that the…

计算机视觉与模式识别 · 计算机科学 2019-04-30 Liangzhe Yuan , Yibo Chen , Hantian Liu , Tao Kong , Jianbo Shi

With the prosperity of digital video industry, video frame interpolation has arisen continuous attention in computer vision community and become a new upsurge in industry. Many learning-based methods have been proposed and achieved…

计算机视觉与模式识别 · 计算机科学 2020-09-11 Yihao Liu , Liangbin Xie , Li Siyao , Wenxiu Sun , Yu Qiao , Chao Dong

We propose a novel DNN based framework called the Enhanced Correlation Matching based Video Frame Interpolation Network to support high resolution like 4K, which has a large scale of motion and occlusion. Considering the extensibility of…

计算机视觉与模式识别 · 计算机科学 2021-11-18 Sungho Lee , Narae Choi , Woong Il Choi

Most approaches for video frame interpolation require accurate dense correspondences to synthesize an in-between frame. Therefore, they do not perform well in challenging scenarios with e.g. lighting changes or motion blur. Recent deep…

计算机视觉与模式识别 · 计算机科学 2018-04-04 Simone Meyer , Abdelaziz Djelouah , Brian McWilliams , Alexander Sorkine-Hornung , Markus Gross , Christopher Schroers

In this paper, we introduce a novel approach that combines multiresolution (MR) techniques with the flux reconstruction (FR) method to accurately and effciently simulate compressible flows. We achieve further enhancements in effciency…

流体动力学 · 物理学 2023-06-21 Yixuan Lian , Jinsheng Cai , Shucheng Pan

Video frame interpolation is a classic and challenging low-level computer vision task. Recently, deep learning based methods have achieved impressive results, and it has been proven that optical flow based methods can synthesize frames with…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Jinfeng Liu , Lingtong Kong , Jie Yang

For video frame interpolation (VFI), existing deep-learning-based approaches strongly rely on the ground-truth (GT) intermediate frames, which sometimes ignore the non-unique nature of motion judging from the given adjacent frames. As a…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Kun Zhou , Wenbo Li , Xiaoguang Han , Jiangbo Lu

In cardiac CINE, motion-compensated MR reconstruction (MCMR) is an effective approach to address highly undersampled acquisitions by incorporating motion information between frames. In this work, we propose a novel perspective for…

图像与视频处理 · 电气工程与系统科学 2024-08-19 Jiazhen Pan , Wenqi Huang , Daniel Rueckert , Thomas Küstner , Kerstin Hammernik

In this work, we first propose a fully differentiable Many-to-Many (M2M) splatting framework to interpolate frames efficiently. Given a frame pair, we estimate multiple bidirectional flows to directly forward warp the pixels to the desired…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Ping Hu , Simon Niklaus , Lu Zhang , Stan Sclaroff , Kate Saenko

Eliminating image blur produced by various kinds of motion has been a challenging problem. Dominant approaches rely heavily on model capacity to remove blurring by reconstructing residual from blurry observation in feature space. These…

图像与视频处理 · 电气工程与系统科学 2024-04-23 Chengxu Liu , Xuan Wang , Xiangyu Xu , Ruhao Tian , Shuai Li , Xueming Qian , Ming-Hsuan Yang