English
Related papers

Related papers: Temporal Consistency Learning of inter-frames for …

200 papers

This paper proposes to learn reliable dense correspondence from videos in a self-supervised manner. Our learning process integrates two highly related tasks: tracking large image regions \emph{and} establishing fine-grained pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Xueting Li , Sifei Liu , Shalini De Mello , Xiaolong Wang , Jan Kautz , Ming-Hsuan Yang

A key challenge in continuous sign language recognition (CSLR) is to efficiently capture long-range spatial interactions over time from the video input. To address this challenge, we propose TCNet, a hybrid network that effectively models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hui Lu , Albert Ali Salah , Ronald Poppe

In this paper, we consider the task of space-time video super-resolution (ST-VSR), namely, expanding a given source video to a higher frame rate and resolution simultaneously. However, most existing schemes either consider a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Yuantong Zhang , Daiqin Yang , Zhenzhong Chen , Wenpeng Ding

Most existing real-time deep models trained with each frame independently may produce inconsistent results across the temporal axis when tested on a video sequence. A few methods take the correlations in the video sequence into…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Yifan Liu , Chunhua Shen , Changqian Yu , Jingdong Wang

Video restoration (VR) aims to recover high-quality videos from degraded ones. Although recent zero-shot VR methods using pre-trained diffusion models (DMs) show good promise, they suffer from approximation errors during reverse diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Hengkang Wang , Yang Liu , Huidong Liu , Chien-Chih Wang , Yanhui Guo , Hongdong Li , Bryan Wang , Ju Sun

Recent single-image super-resolution (SISR) networks, which can adapt their network parameters to specific input images, have shown promising results by exploiting the information available within the input data as well as large external…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Jinsu Yoo , Tae Hyun Kim

We consider the problem of space-time super-resolution (ST-SR): increasing spatial resolution of video frames and simultaneously interpolating frames to increase the frame rate. Modern approaches handle these axes one at a time. In…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Muhammad Haris , Greg Shakhnarovich , Norimichi Ukita

Video super-resolution (SR) aims at generating a sequence of high-resolution (HR) frames with plausible and temporally consistent details from their low-resolution (LR) counterparts. The key challenge for video SR lies in the effective…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Longguang Wang , Yulan Guo , Li Liu , Zaiping Lin , Xinpu Deng , Wei An

Applying image processing algorithms independently to each frame of a video often leads to undesired inconsistent results over time. Developing temporally consistent video-based extensions, however, requires domain knowledge for individual…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Wei-Sheng Lai , Jia-Bin Huang , Oliver Wang , Eli Shechtman , Ersin Yumer , Ming-Hsuan Yang

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mehdi S. M. Sajjadi , Raviteja Vemulapalli , Matthew Brown

Video super-resolution (VSR), with the aim to restore a high-resolution video from its corresponding low-resolution version, is a spatial-temporal sequence prediction problem. Recently, Transformer has been gaining popularity due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jiezhang Cao , Yawei Li , Kai Zhang , Luc Van Gool

Convolutional neural networks have enabled accurate image super-resolution in real-time. However, recent attempts to benefit from temporal correlations in video super-resolution have been limited to naive or inefficient architectures. In…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Jose Caballero , Christian Ledig , Andrew Aitken , Alejandro Acosta , Johannes Totz , Zehan Wang , Wenzhe Shi

Video super-resolution (VSR) can achieve better performance compared to single image super-resolution by additionally leveraging temporal information. In particular, the recurrent-based VSR model exploits long-range temporal information…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Xingyu Zhou , Wei Long , Jingbo Lu , Shiyin Jiang , Weiyi You , Haifeng Wu , Shuhang Gu

Single-image super-resolution (SR) and multi-frame SR are two ways to super resolve low-resolution images. Single-Image SR generally handles each image independently, but ignores the temporal information implied in continuing frames.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Wenjia Niu , Kaihao Zhang , Wenhan Luo , Yiran Zhong

Compressed video super-resolution (VSR) aims to restore high-resolution frames from compressed low-resolution counterparts. Most recent VSR approaches often enhance an input frame by borrowing relevant textures from neighboring video…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Zhongwei Qiu , Huan Yang , Jianlong Fu , Dongmei Fu

In this paper, we explore the space-time video super-resolution task, which aims to generate a high-resolution (HR) slow-motion video from a low frame rate (LFR), low-resolution (LR) video. A simple solution is to split it into two…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xiaoyu Xiang , Yapeng Tian , Yulun Zhang , Yun Fu , Jan P. Allebach , Chenliang Xu

Video super-resolution (VSR) aims to reconstruct a high-resolution (HR) video from a low-resolution (LR) counterpart. Achieving successful VSR requires producing realistic HR details and ensuring both spatial and temporal consistency. To…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Janghyeok Han , Gyujin Sim , Geonung Kim , Hyun-seung Lee , Kyuha Choi , Youngseok Han , Sunghyun Cho

For video super-resolution, current state-of-the-art approaches either process multiple low-resolution (LR) frames to produce each output high-resolution (HR) frame separately in a sliding window fashion or recurrently exploit the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Bo Yan , Chuming Lin , Weimin Tan

Deep network-based image and video Compressive Sensing(CS) has attracted increasing attentions in recent years. However, in the existing deep network-based CS methods, a simple stacked convolutional network is usually adopted, which not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Tong Zhang , Wenxue Cui , Chen Hui , Feng Jiang

The video super-resolution (VSR) method based on the recurrent convolutional network has strong temporal modeling capability for video sequences. However, the temporal receptive field of different recurrent units in the unidirectional…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Shuyun Wang , Ming Yu , Cuihong Xue , Yingchun Guo , Gang Yan