English
Related papers

Related papers: Temporal-Consistent Video Restoration with Pre-tra…

200 papers

Face video restoration (FVR) is a challenging but important problem where one seeks to recover a perceptually realistic face videos from a low-quality input. While diffusion probabilistic models (DPMs) have been shown to achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zihao Zou , Jiaming Liu , Shirin Shoushtari , Yubo Wang , Weijie Gan , Ulugbek S. Kamilov

Video super-resolution (VSR) is a task that aims to reconstruct high-resolution (HR) frames from the low-resolution (LR) reference frame and multiple neighboring frames. The vital operation is to utilize the relative misaligned frames for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Meiqin Liu , Shuo Jin , Chao Yao , Chunyu Lin , Yao Zhao

Video restoration poses non-trivial challenges in maintaining fidelity while recovering temporally consistent details from unknown degradations in the wild. Despite recent advances in diffusion-based restoration, these methods often face…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jianyi Wang , Zhijie Lin , Meng Wei , Yang Zhao , Ceyuan Yang , Fei Xiao , Chen Change Loy , Lu Jiang

The integration of diffusion priors with temporal alignment has emerged as a transformative paradigm for video restoration, delivering fantastic perceptual quality, yet the practical deployment of such frameworks is severely constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jianfeng Liang , Shaocheng Shen , Botao Xu , Qiang Hu , Xiaoyun Zhang

Video face restoration aims to enhance degraded face videos into high-quality results with realistic facial details, stable identity, and temporal coherence. Recent diffusion-based methods have brought strong generative priors to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Zheng Chen , Bowen Chai , Rongjun Gao , Mingtao Nie , Xi Li , Bingnan Duan , Jianping Fang , Xiaohong Liu , Linghe Kong , Yulun Zhang

Diffusion models have shown great potential in generating realistic image detail. However, adapting these models to video super-resolution (VSR) remains challenging due to their inherent stochasticity and lack of temporal modeling. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yong Liu , Jinshan Pan , Yinchuan Li , Qingji Dong , Chao Zhu , Yu Guo , Fei Wang

Diffusion model (DM) based Video Super-Resolution (VSR) approaches achieve impressive perceptual quality. However, they suffer from error accumulation, spatial artifacts, and a trade-off between perceptual quality and fidelity, primarily…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jingyi Xu , Meisong Zheng , Ying Chen , Minglang Qiao , Xin Deng , Mai Xu

Applying an image processing algorithm independently to each video frame often leads to temporal inconsistency in the resulting video. To address this issue, we present a novel and general approach for blind video temporal consistency. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Chenyang Lei , Yazhou Xing , Hao Ouyang , Qifeng Chen

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal

Text-based diffusion models have exhibited remarkable success in generation and editing, showing great promise for enhancing visual content with their generative prior. However, applying these models to video super-resolution remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Shangchen Zhou , Peiqing Yang , Jianyi Wang , Yihang Luo , Chen Change Loy

Unified image restoration is a significantly challenging task in low-level vision. Existing methods either make tailored designs for specific tasks, limiting their generalizability across various types of degradation, or rely on training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Huaqiu Li , Yong Wang , Tongwen Huang , Hailang Huang , Haoqian Wang , Xiangxiang Chu

Diffusion models have made significant advances in generating high-quality images, but their application to video generation has remained challenging due to the complexity of temporal motion. Zero-shot video editing offers a solution by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Xirui Li , Chao Ma , Xiaokang Yang , Ming-Hsuan Yang

Video generation models have made significant progress in generating realistic content, enabling applications in simulation, gaming, and film making. However, current generated videos still contain visual artifacts arising from 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Duolikun Danier , Ge Gao , Steven McDonagh , Changjian Li , Hakan Bilen , Oisin Mac Aodha

Stereo matching provides depth estimation from binocular images for downstream applications. These applications mostly take video streams as input and require temporally consistent depth maps. However, existing methods mainly focus on the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Jiaxi Zeng , Chengtang Yao , Yuwei Wu , Yunde Jia

Large text-to-image diffusion models have exhibited impressive proficiency in generating high-quality images. However, when applying these models to video domain, ensuring temporal consistency across video frames remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Shuai Yang , Yifan Zhou , Ziwei Liu , Chen Change Loy

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Recent advances in diffusion-based video restoration (VR) demonstrate significant improvement in visual quality, yet yield a prohibitive computational cost during inference. While several distillation-based approaches have exhibited the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Jianyi Wang , Shanchuan Lin , Zhijie Lin , Yuxi Ren , Meng Wei , Zongsheng Yue , Shangchen Zhou , Hao Chen , Yang Zhao , Ceyuan Yang , Xuefeng Xiao , Chen Change Loy , Lu Jiang

Despite the recent success of single image-based 3D human pose and shape estimation methods, recovering temporally consistent and smooth 3D human motion from a video is still challenging. Several video-based methods have been proposed;…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Hongsuk Choi , Gyeongsik Moon , Ju Yong Chang , Kyoung Mu Lee

Inverse problems have many applications in science and engineering. In Computer vision, several image restoration tasks such as inpainting, deblurring, and super-resolution can be formally modeled as inverse problems. Recently, methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour

Recently, latent diffusion models has demonstrated promising performance in real-world video super-resolution (VSR) task, which can reconstruct high-quality videos from distorted low-resolution input through multiple diffusion steps.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Hanting Li , Huaao Tang , Jianhong Han , Tianxiong Zhou , Jiulong Cui , Haizhen Xie , Yan Chen , Jie Hu