English
Related papers

Related papers: Enhancing Video Super-Resolution via Implicit Resa…

200 papers

Recent progress in large-scale text-to-video (T2V) and image-to-video (I2V) diffusion models has greatly enhanced video generation, especially in terms of keyframe interpolation. However, current image-to-video diffusion models, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Serin Yang , Taesung Kwon , Jong Chul Ye

Super-resolution of LiDAR range images is crucial to improving many downstream tasks such as object detection, recognition, and tracking. While deep learning has made a remarkable advances in super-resolution techniques, typical…

Robotics · Computer Science 2022-03-15 Youngsun Kwon , Minhyuk Sung , Sung-Eui Yoon

Existing methods for video interpolation heavily rely on deep convolution neural networks, and thus suffer from their intrinsic limitations, such as content-agnostic kernel weights and restricted receptive field. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhihao Shi , Xiangyu Xu , Xiaohong Liu , Jun Chen , Ming-Hsuan Yang

Video super-resolution aims at generating a high-resolution video from its low-resolution counterpart. With the rapid rise of deep learning, many recently proposed video super-resolution methods use convolutional neural networks in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Xiaohong Liu , Lingshi Kong , Yang Zhou , Jiying Zhao , Jun Chen

Pixel-wise predictions are required in a wide variety of tasks such as image restoration, image segmentation, or disparity estimation. Common models involve several stages of data resampling, in which the resolution of feature maps is first…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shashank Agnihotri , Julia Grabinski , Margret Keuper

Video frame interpolation aims to synthesize nonexistent frames in-between the original frames. While significant advances have been made from the recent deep convolutional neural networks, the quality of interpolation is often reduced due…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Wenbo Bao , Wei-Sheng Lai , Chao Ma , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Implicit neural representations (INRs) have emerged as a promising approach for video storage and processing, showing remarkable versatility across various video tasks. However, existing methods often fail to fully leverage their…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Xinjie Zhang , Ren Yang , Dailan He , Xingtong Ge , Tongda Xu , Yan Wang , Hongwei Qin , Jun Zhang

Learning to synthesize high frame rate videos via interpolation requires large quantities of high frame rate training videos, which, however, are scarce, especially at high resolutions. Here, we propose unsupervised techniques to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Fitsum A. Reda , Deqing Sun , Aysegul Dundar , Mohammad Shoeybi , Guilin Liu , Kevin J. Shih , Andrew Tao , Jan Kautz , Bryan Catanzaro

We outline the super-resolution reconstruction problem posed as a maximization of probability. We then introduce an interpolation method based on polygonal pixel overlap, express it as a linear operator, and use it to improve…

Computer Vision and Pattern Recognition · Computer Science 2012-10-17 Stéfan J. van der Walt , B. M. Herbst

Image zooming or upsampling is a widely used tool in image processing and an essential step in many algorithms. Upsampling increases the number of pixels and introduces new information into the image, which can lead to numerical effects…

Numerical Analysis · Mathematics 2023-12-04 Bojan Crnković , Jerko Škifić , Tina Bosner

In this paper, we present a novel deep learning-based approach for still image super-resolution, that unlike the mainstream models does not rely solely on the input low resolution image for high quality upsampling, and takes advantage of a…

Computer Vision and Pattern Recognition · Computer Science 2018-12-17 Farzad Toutounchi , Ebroul Izquierdo

For video frame interpolation (VFI), existing deep-learning-based approaches strongly rely on the ground-truth (GT) intermediate frames, which sometimes ignore the non-unique nature of motion judging from the given adjacent frames. As a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Kun Zhou , Wenbo Li , Xiaoguang Han , Jiangbo Lu

In this work, we rethink the approach to video super-resolution by introducing a method based on the Diffusion Posterior Sampling framework, combined with an unconditional video diffusion transformer operating in latent space. The video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zhihao Zhan , Wang Pang , Xiang Zhu , Yechao Bai

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

This work presents a supervised learning based approach to the computer vision problem of frame interpolation. The presented technique could also be used in the cartoon animations since drawing each individual frame consumes a noticeable…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Vladislav Samsonov

Upsampling videos of human activity is an interesting yet challenging task with many potential applications ranging from gaming to entertainment and sports broadcasting. The main difficulty in synthesizing video frames in this setting stems…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Hsuan-I Ho , Xu Chen , Jie Song , Otmar Hilliges

Autoencoders represent an effective approach for computing the underlying factors characterizing datasets of different types. The latent representation of autoencoders have been studied in the context of enabling interpolation between data…

Machine Learning · Computer Science 2020-10-23 Alon Oring , Zohar Yakhini , Yacov Hel-Or

The alignment of adjacent frames is considered an essential operation in video super-resolution (VSR). Advanced VSR models, including the latest VSR Transformers, are generally equipped with well-designed alignment modules. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Shuwei Shi , Jinjin Gu , Liangbin Xie , Xintao Wang , Yujiu Yang , Chao Dong

High-refresh rate displays have become very popular in recent years due to the need for superior visual quality in gaming, professional displays and specialized applications like medical imaging. However, high-refresh rate displays alone do…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Akanksha Dixit , Smruti R. Sarangi

Recent advances in high refresh rate displays as well as the increased interest in high rate of slow motion and frame up-conversion fuel the demand for efficient and cost-effective multi-frame video interpolation solutions. To that regard,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Juwei Lu , Jin Tang , Konstantinos N Plataniotis