English
Related papers

Related papers: Deep Space-Time Video Upsampling Networks

200 papers

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Zhihao Shi , Xiaohong Liu , Kangdi Shi , Linhui Dai , Jun Chen

We present a novel deep learning based algorithm for video inpainting. Video inpainting is a process of completing corrupted or missing regions in videos. Video inpainting has additional challenges compared to image inpainting due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Sungho Lee , Seoung Wug Oh , DaeYeun Won , Seon Joo Kim

Online processing of compressed videos to increase their resolutions attracts increasing and broad attention. Video Super-Resolution (VSR) using recurrent neural network architecture is a promising solution due to its efficient modeling of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Hengsheng Zhang , Xueyi Zou , Jiaming Guo , Youliang Yan , Rong Xie , Li Song

In this paper, we present an end-to-end video compression network for P-frame challenge on CLIC. We focus on deep neural network (DNN) based video compression, and improve the current frameworks from three aspects. First, we notice that…

Image and Video Processing · Electrical Eng. & Systems 2020-04-23 Runsen Feng , Yaojun Wu , Zongyu Guo , Zhizheng Zhang , Xin Jin , Zhibo Chen

Due to large pixel movement and high computational cost, estimating the motion of high-resolution frames is challenging. Thus, most flow-based Video Frame Interpolation (VFI) methods first predict bidirectional flows at low resolution and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chenyang Wu , Jiayi Fu , Chun-Le Guo , Shuhao Han , Chongyi Li

Full-field ultra-high-speed (UHS) x-ray imaging experiments have been well established to characterize various processes and phenomena. However, the potential of UHS experiments through the joint acquisition of x-ray videos with distinct…

Image and Video Processing · Electrical Eng. & Systems 2024-11-28 Songyuan Tang , Tekin Bicer , Tao Sun , Kamel Fezzaa , Samuel J. Clark

Diffusion models have demonstrated exceptional capabilities in image restoration, yet their application to video super-resolution (VSR) faces significant challenges in balancing fidelity with temporal consistency. Our evaluation reveals a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaohui Li , Yihao Liu , Shuo Cao , Ziyan Chen , Shaobin Zhuang , Xiangyu Chen , Yinan He , Yi Wang , Yu Qiao

We introduce a novel formulation for continuous space-time video super-resolution. Instead of decoupling the representation of a video sequence into separate spatial and temporal components and relying on brittle, explicit frame warping for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Alexander Becker , Julius Erbach , Dominik Narnhofer , Konrad Schindler

Video super-resolution (VSR) aims to estimate a high-resolution (HR) frame from a low-resolution (LR) frames. The key challenge for VSR lies in the effective exploitation of spatial correlation in an intra-frame and temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Young-Ju Choi , Young-Woon Lee , Byung-Gyu Kim

In recent years, the image and video coding technologies have advanced by leaps and bounds. However, due to the popularization of image and video acquisition devices, the growth rate of image and video data is far beyond the improvement of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Siwei Ma , Xinfeng Zhang , Chuanmin Jia , Zhenghui Zhao , Shiqi Wang , Shanshe Wang

Video super-resolution aims at generating a high-resolution video from its low-resolution counterpart. With the rapid rise of deep learning, many recently proposed video super-resolution methods use convolutional neural networks in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Xiaohong Liu , Lingshi Kong , Yang Zhou , Jiying Zhao , Jun Chen

Fine-grained classification is a relatively new field that has concentrated on using information from a single image, while ignoring the enormous potential of using video data to improve classification. In this work we present the novel…

Computer Vision and Pattern Recognition · Computer Science 2017-01-17 ZongYuan Ge , Chris McCool , Conrad Sanderson , Peng Wang , Lingqiao Liu , Ian Reid , Peter Corke

Large pre-trained video diffusion models excel in video frame interpolation but struggle to generate high fidelity frames due to reliance on intrinsic generative priors, limiting detail preservation from start and end frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ganggui Ding , Hao Chen , Xiaogang Xu

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert

Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Yu Liu , Yanming Guo , Michael S. Lew

Video processing and analysis have become an urgent task since a huge amount of videos (e.g., Youtube, Hulu) are uploaded online every day. The extraction of representative key frames from videos is very important in video processing and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Hao Tang , Lei Ding , Songsong Wu , Bin Ren , Nicu Sebe , Paolo Rota

Space-time video super-resolution (STVSR) is the task of interpolating videos with both Low Frame Rate (LFR) and Low Resolution (LR) to produce High-Frame-Rate (HFR) and also High-Resolution (HR) counterparts. The existing methods based on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhicheng Geng , Luming Liang , Tianyu Ding , Ilya Zharkov

3D CNN shows its strong ability in learning spatiotemporal representation in recent video recognition tasks. However, inflating 2D convolution to 3D inevitably introduces additional computational costs, making it cumbersome in practical…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Pingchuan Ma , Yao Zhou , Yu Lu , Wei Zhang

Spatial-Temporal Video Super-Resolution (ST-VSR) technology generates high-quality videos with higher resolution and higher frame rates. Existing advanced methods accomplish ST-VSR tasks through the association of Spatial and Temporal video…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Mengshun Hu , Kui Jiang , Zhixiang Nie , Zheng Wang

Purpose: In multi-spectral imaging (MSI), several fast spin echo volumes with discrete Larmor frequency offsets are acquired in an interleaved fashion with multiple concatenations. Here, a variable resolution (VR) method to nearly halve…

Medical Physics · Physics 2023-06-06 Nikolai J. Mickevicius , Azadeh Sharafi , Andrew S. Nencka , Kevin M. Koch