English
Related papers

Related papers: Spatial Degradation-Aware and Temporal Consistent …

200 papers

Deep-learning video super-resolution has progressed rapidly, but climate applications typically super-resolve (increase resolution) either space or time, and joint spatiotemporal models are often designed for a single pair of…

Machine Learning · Computer Science 2026-04-24 Max Defez , Filippo Quarenghi , Mathieu Vrac , Stephan Mandt , Tom Beucler

We introduce the first zero-shot approach for Video Semantic Segmentation (VSS) based on pre-trained diffusion models. A growing research direction attempts to employ diffusion models to perform downstream vision tasks by exploiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Qian Wang , Abdelrahman Eldesokey , Mohit Mendiratta , Fangneng Zhan , Adam Kortylewski , Christian Theobalt , Peter Wonka

Diffusion-based image super-resolution (SR) methods have demonstrated remarkable performance. Recent advancements have introduced deterministic sampling processes that reduce inference from 15 iterative steps to a single step, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zihang Liu , Zhenyu Zhang , Hao Tang

Existing video super-resolution (VSR) methods generally adopt a recurrent propagation network to extract spatio-temporal information from the entire video sequences, exhibiting impressive performance. However, the key components in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Hao Li , Jiangxin Dong , Jinshan Pan

Video diffusion models have recently shown promise for world modeling through autoregressive frame prediction conditioned on actions. However, they struggle to maintain long-term memory due to the high computational cost associated with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Ryan Po , Yotam Nitzan , Richard Zhang , Berlin Chen , Tri Dao , Eli Shechtman , Gordon Wetzstein , Xun Huang

Diffusion-based image super-resolution (SR) models have attracted substantial interest due to their powerful image restoration capabilities. However, prevailing diffusion models often struggle to strike an optimal balance between efficiency…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Qinpeng Cui , Yixuan Liu , Xinyi Zhang , Qiqi Bao , Qingmin Liao , Li Wang , Tian Lu , Zicheng Liu , Zhongdao Wang , Emad Barsoum

Removing degradation from document images not only improves their visual quality and readability, but also enhances the performance of numerous automated document analysis and recognition tasks. However, existing regression-based methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Zongyuan Yang , Baolin Liu , Yongping Xiong , Lan Yi , Guibin Wu , Xiaojun Tang , Ziqi Liu , Junjie Zhou , Xing Zhang

Denoising diffusion models (DDMs) have attracted attention for their exceptional generation quality and diversity. This success is largely attributed to the use of class- or text-conditional diffusion guidance methods, such as classifier…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Susung Hong , Gyuseong Lee , Wooseok Jang , Seungryong Kim

We present a novel method for diffusion-guided frameworks for view-consistent super-resolution (SR) in neural rendering. Our approach leverages existing 2D SR models in conjunction with advanced techniques such as Variational Score…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Shrey Vishen , Jatin Sarabu , Saurav Kumar , Chinmay Bharathulwar , Rithwick Lakshmanan , Vishnu Srinivas

This study introduces an efficient and effective method, MeDM, that utilizes pre-trained image Diffusion Models for video-to-video translation with consistent temporal flow. The proposed framework can render videos from scene position…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Ernie Chu , Tzuhsuan Huang , Shuo-Yen Lin , Jun-Cheng Chen

Sparse-view computed tomography (CT) reduces radiation exposure by subsampling projection views, but conventional reconstruction methods produce severe streak artifacts with undersampled data. While deep-learning-based methods enable…

Image and Video Processing · Electrical Eng. & Systems 2025-08-15 Jixiang Chen , Yiqun Lin , Yi Qin , Hualiang Wang , Xiaomeng Li

The extensive amounts of data required for training deep neural networks pose significant challenges on storage and transmission fronts. Dataset distillation has emerged as a promising technique to condense the information of massive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Ali Abbasi , Ashkan Shahbazi , Hamed Pirsiavash , Soheil Kolouri

Underwater images typically suffer from severe colour distortions, low visibility, and reduced structural clarity due to complex optical effects such as scattering and absorption, which greatly degrade their visual quality and limit the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Chang Huang , Jiahang Cao , Jun Ma , Kieren Yu , Cong Li , Huayong Yang , Kaishun Wu

Recent advancements in diffusion-based generative priors have enabled visually plausible image compression at extremely low bit rates. However, existing approaches suffer from slow sampling processes and suboptimal bit allocation due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Yichong Xia , Yimin Zhou , Jinpeng Wang , Bin Chen

The evolution of diffusion models has greatly impacted video generation and understanding. Particularly, text-to-video diffusion models (VDMs) have significantly facilitated the customization of input video with target appearance, motion,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Geon Yeong Park , Hyeonho Jeong , Sang Wan Lee , Jong Chul Ye

Consistent human-centric image and video synthesis aims to generate images or videos with new poses while preserving appearance consistency with a given reference image, which is crucial for low-cost visual content creation. Recent advances…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Mingdeng Cao , Chong Mou , Ziyang Yuan , Xintao Wang , Zhaoyang Zhang , Ying Shan , Yinqiang Zheng

Computer-assisted interventions can improve intra-operative guidance, particularly through deep learning methods that harness the spatiotemporal information in surgical videos. However, the severe data imbalance often found in surgical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Danush Kumar Venkatesh , Isabel Funke , Micha Pfeiffer , Fiona Kolbinger , Hanna Maria Schmeiser , Juergen Weitz , Marius Distler , Stefanie Speidel

Video diffusion models can generate realistic and temporally consistent videos. This raises concerns about provenance, ownership, and integrity. Watermarking can help address these issues by embedding metadata directly into the content. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Mohammadreza Teymoorianfard , Siddarth Sitaraman , Shiqing Ma , Amir Houmansadr

Image super-resolution (SR) has attracted increasing attention due to its wide applications. However, current SR methods generally suffer from over-smoothing and artifacts, and most work only with fixed magnifications. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sicheng Gao , Xuhui Liu , Bohan Zeng , Sheng Xu , Yanjing Li , Xiaoyan Luo , Jianzhuang Liu , Xiantong Zhen , Baochang Zhang

Spatial resolution adaptation is a technique which has often been employed in video compression to enhance coding efficiency. This approach encodes a lower resolution version of the input video and reconstructs the original resolution…

Image and Video Processing · Electrical Eng. & Systems 2021-06-16 Di Ma , Mariana Afonso , Fan Zhang , David R. Bull