English
Related papers

Related papers: RSTT: Real-time Spatial Temporal Transformer for S…

200 papers

Recently, tensor data (or multidimensional array) have been generated in many modern applications, such as functional magnetic resonance imaging (fMRI) in neuroscience and videos in video analysis. Many efforts are made in recent years to…

Machine Learning · Computer Science 2023-08-10 Jiaqi Zhang , Yinghao Cai , Zhaoyang Wang , Beilun Wang

Temporal modeling is crucial for video super-resolution. Most of the video super-resolution methods adopt the optical flow or deformable convolution for explicitly motion compensation. However, such temporal modeling techniques increase the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Takashi Isobe , Xu Jia , Xin Tao , Changlin Li , Ruihuang Li , Yongjie Shi , Jing Mu , Huchuan Lu , Yu-Wing Tai

The effective utilization of observational data is frequently hindered by insufficient resolution. To address this problem, we present a new spatio-temporal super-resolution (STSR) model, called InWaveSR. It is built on a deep learning…

Signal Processing · Electrical Eng. & Systems 2025-09-19 Xinjie Wang , Zhongrui Li , Peng Han , Chunxin Yuan , Jiexin Xu , Zhiqiang Wei , Jie Nie

Recent advancements in video super-resolution (VSR) models have demonstrated impressive results in enhancing low-resolution videos. However, due to limitations in adequately controlling the generation process, achieving high fidelity…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Yiwen Wang , Xinning Chai , Yuhong Zhang , Zhengxue Cheng , Jun Zhao , Rong Xie , Li Song

Speech super-resolution (SR) reconstructs high-fidelity wideband speech from low-resolution inputs-a task that necessitates reconciling global harmonic coherence with local transient sharpness. While diffusion-based generative models yield…

Sound · Computer Science 2026-01-01 Jiajun Yuan , Xiaochen Wang , Yuhang Xiao , Yulin Wu , Chenhao Hu , Xueyang Lv

Recent years have seen considerable research activities devoted to video enhancement that simultaneously increases temporal frame rate and spatial resolution. However, the existing methods either fail to explore the intrinsic relationship…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zhihao Shi , Xiaohong Liu , Chengqi Li , Linhui Dai , Jun Chen , Timothy N. Davidson , Jiying Zhao

Video inpainting aims to fill the given spatiotemporal holes with realistic appearance but is still a challenging task even with prosperous deep learning approaches. Recent works introduce the promising Transformer architecture into deep…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Rui Liu , Hanming Deng , Yangyi Huang , Xiaoyu Shi , Lewei Lu , Wenxiu Sun , Xiaogang Wang , Jifeng Dai , Hongsheng Li

A single rolling-shutter (RS) image may be viewed as a row-wise combination of a sequence of global-shutter (GS) images captured by a (virtual) moving GS camera within the exposure duration. Although RS cameras are widely used, the RS…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Bin Fan , Yuchao Dai , Hongdong Li

Video super-resolution (VSR) seeks to reconstruct high-resolution frames from low-resolution inputs. While diffusion-based methods have substantially improved perceptual quality, extending them to video remains challenging for two reasons:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jintong Hu , Bin Chen , Zhenyu Hu , Jiayue Liu , Guo Wang , Lu Qi

Video super-resolution (VSR) aims to estimate a high-resolution (HR) frame from a low-resolution (LR) frames. The key challenge for VSR lies in the effective exploitation of spatial correlation in an intra-frame and temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Young-Ju Choi , Young-Woon Lee , Byung-Gyu Kim

With the rise of real-time rendering and the evolution of display devices, there is a growing demand for post-processing methods that offer high-resolution content in a high frame rate. Existing techniques often suffer from quality and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Ruian He , Shili Zhou , Yuqi Sun , Ri Cheng , Weimin Tan , Bo Yan

In this paper, we consider the task of space-time video super-resolution (ST-VSR), which can increase the spatial resolution and frame rate for a given video simultaneously. Despite the remarkable progress of recent methods, most of them…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yuantong Zhang , Huairui Wang , Han Zhu , Zhenzhong Chen

Video super-resolution (VSR), with the aim to restore a high-resolution video from its corresponding low-resolution version, is a spatial-temporal sequence prediction problem. Recently, Transformer has been gaining popularity due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jiezhang Cao , Yawei Li , Kai Zhang , Luc Van Gool

Diffusion-based models have shown strong performance in video super-resolution (VSR) and video frame interpolation (VFI). However, their role in the coupled space-time video super-resolution (STVSR) setting remains limited. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zheng Chen , Ruofan Yang , Jin Han , Dehua Song , Zichen Zou , Chunming He , Yong Guo , Yulun Zhang

Video super-resolution (SR) aims at generating a sequence of high-resolution (HR) frames with plausible and temporally consistent details from their low-resolution (LR) counterparts. The key challenge for video SR lies in the effective…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Longguang Wang , Yulan Guo , Li Liu , Zaiping Lin , Xinpu Deng , Wei An

Methods based on convolutional neural network (CNN) have demonstrated tremendous improvements on single image super-resolution. However, the previous methods mainly restore images from one single area in the low resolution (LR) input, which…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Xiaoyi Jia , Xiangmin Xu , Bolun Cai , Kailing Guo

Table structure recognition (TSR) aims to convert tabular images into a machine-readable format, where a visual encoder extracts image features and a textual decoder generates table-representing tokens. Existing approaches use classic…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 ShengYun Peng , Seongmin Lee , Xiaojing Wang , Rajarajeswari Balasubramaniyan , Duen Horng Chau

This work addresses the Burst Super-Resolution (BurstSR) task using a new architecture, which requires restoring a high-quality image from a sequence of noisy, misaligned, and low-resolution RAW bursts. To overcome the challenges in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Ziwei Luo , Youwei Li , Shen Cheng , Lei Yu , Qi Wu , Zhihong Wen , Haoqiang Fan , Jian Sun , Shuaicheng Liu

Space-time video super-resolution (STVSR) aims to construct a high space-time resolution video sequence from the corresponding low-frame-rate, low-resolution video sequence. Inspired by the recent success to consider spatial-temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Chenyu You , Lianyi Han , Aosong Feng , Ruihan Zhao , Hui Tang , Wei Fan

In clinical practice, anisotropic volumetric medical images with low through-plane resolution are commonly used due to short acquisition time and lower storage cost. Nevertheless, the coarse resolution may lead to difficulties in medical…

Image and Video Processing · Electrical Eng. & Systems 2022-12-13 Pengxin Yu , Haoyue Zhang , Han Kang , Wen Tang , Corey W. Arnold , Rongguo Zhang