English
Related papers

Related papers: Deep Space-Time Video Upsampling Networks

200 papers

Downsampling is one of the most basic image processing operations. Improper spatio-temporal downsampling applied on videos can cause aliasing issues such as moir\'e patterns in space and the wagon-wheel effect in time. Consequently, the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xiaoyu Xiang , Yapeng Tian , Vijay Rengarajan , Lucas Young , Bo Zhu , Rakesh Ranjan

Deep learning based methods have recently pushed the state-of-the-art on the problem of Single Image Super-Resolution (SISR). In this work, we revisit the more traditional interpolation-based methods, that were popular before, now with the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Xu Jia , Hong Chang , Tinne Tuytelaars

Deep convolutional neural networks achieve excellent image up-sampling performance. However, CNN-based methods tend to restore high-resolution results highly depending on traditional interpolations (e.g. bicubic). In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Bolun Cai , Xiangmin Xu , Kailing Guo , Kui Jia , Dacheng Tao

Video super-resolution (VSR) is the task of restoring high-resolution frames from a sequence of low-resolution inputs. Different from single image super-resolution, VSR can utilize frames' temporal information to reconstruct results with…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Wenyi Lian , Wenjing Lian

Video frame interpolation is an important low-level vision task, which can increase frame rate for more fluent visual experience. Existing methods have achieved great success by employing advanced motion models and synthesis networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Ying Tai , Chengjie Wang , Jie Yang

This work presents a supervised learning based approach to the computer vision problem of frame interpolation. The presented technique could also be used in the cartoon animations since drawing each individual frame consumes a noticeable…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Vladislav Samsonov

As a fundamental challenge in visual computing, video super-resolution (VSR) focuses on reconstructing highdefinition video sequences from their degraded lowresolution counterparts. While deep convolutional neural networks have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-04-23 Biao Wu , Diankai Zhang , Shaoli Liu , Si Gao , Chengjian Zheng , Ning Wang

The video super-resolution (VSR) task aims to restore a high-resolution (HR) video frame by using its corresponding low-resolution (LR) frame and multiple neighboring frames. At present, many deep learning-based VSR methods rely on optical…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Hua Wang , Dewei Su , Chuangchuang Liu , Longcun Jin , Xianfang Sun , Xinyi Peng

This paper studies deep network architectures to address the problem of video classification. A multi-stream framework is proposed to fully utilize the rich multimodal information in videos. Specifically, we first train three Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2015-11-12 Zuxuan Wu , Yu-Gang Jiang , Xi Wang , Hao Ye , Xiangyang Xue , Jun Wang

Diffusion model (DM) based Video Super-Resolution (VSR) approaches achieve impressive perceptual quality. However, they suffer from error accumulation, spatial artifacts, and a trade-off between perceptual quality and fidelity, primarily…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jingyi Xu , Meisong Zheng , Ying Chen , Minglang Qiao , Xin Deng , Mai Xu

Convolutional neural networks (CNNs) have been extensively applied for image recognition problems giving state-of-the-art results on recognition, detection, segmentation and retrieval. In this work we propose and evaluate several deep…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Joe Yue-Hei Ng , Matthew Hausknecht , Sudheendra Vijayanarasimhan , Oriol Vinyals , Rajat Monga , George Toderici

In order to be able to deliver today's voluminous amount of video contents through limited bandwidth channels in a perceptually optimal way, it is important to consider perceptual trade-offs of compression and space-time downsampling…

Image and Video Processing · Electrical Eng. & Systems 2021-04-01 Dae Yeol Lee , Hyunsuk Ko , Jongho Kim , Alan C. Bovik

Significant advances in video compression system have been made in the past several decades to satisfy the nearly exponential growth of Internet-scale video traffic. From the application perspective, we have identified three major…

Image and Video Processing · Electrical Eng. & Systems 2021-01-19 Dandan Ding , Zhan Ma , Di Chen , Qingshuang Chen , Zoe Liu , Fengqing Zhu

Video frame interpolation (VFI), which aims to synthesize intermediate frames of a video, has made remarkable progress with development of deep convolutional networks over past years. Existing methods built upon convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Liying Lu , Ruizheng Wu , Huaijia Lin , Jiangbo Lu , Jiaya Jia

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mehdi S. M. Sajjadi , Raviteja Vemulapalli , Matthew Brown

Interlacing is a widely used technique, for television broadcast and video recording, to double the perceived frame rate without increasing the bandwidth. But it presents annoying visual artifacts, such as flickering and silhouette…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Haichao Zhu , Xueting Liu , Xiangyu Mao , Tien-Tsin Wong

Video frame interpolation is a fundamental tool for temporal video enhancement, but existing quality metrics struggle to evaluate the perceptual impact of interpolation artefacts effectively. Metrics like PSNR, SSIM and LPIPS ignore…

Image and Video Processing · Electrical Eng. & Systems 2026-01-23 Conall Daly , Darren Ramsook , Anil Kokaram

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

Video super-resolution (VSR) approaches have shown impressive temporal consistency in upsampled videos. However, these approaches tend to generate blurrier results than their image counterparts as they are limited in their generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Yiran Xu , Taesung Park , Richard Zhang , Yang Zhou , Eli Shechtman , Feng Liu , Jia-Bin Huang , Difan Liu

The state of the art in video super-resolution (SR) are techniques based on deep learning, but they perform poorly on real-world videos (see Figure 1). The reason is that training image-pairs are commonly created by downscaling a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Noam Elron , Alex Itskovich , Shahar S. Yuval , Noam Levy