English
Related papers

Related papers: Rethinking Diffusion Model-Based Video Super-Resol…

200 papers

Pre-trained diffusion models utilized for image generation encapsulate a substantial reservoir of a priori knowledge pertaining to intricate textures. Harnessing the potential of leveraging this a priori knowledge in the context of image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Junxiong Lin , Yan Wang , Zeng Tao , Boyang Wang , Qing Zhao , Haorang Wang , Xuan Tong , Xinji Mai , Yuxuan Lin , Wei Song , Jiawen Yu , Shaoqi Yan , Wenqiang Zhang

Diffusion Generative Models (DGM) have rapidly surfaced as emerging topics in the field of computer vision, garnering significant interest across a wide array of deep learning applications. Despite their high computational demand, these…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Denisha Thakkar , Vincent Quoc-Huy Trinh , Sonal Varma , Samira Ebrahimi Kahou , Hassan Rivaz , Mahdi S. Hosseini

Image diffusion models have been adapted for real-world video super-resolution to tackle over-smoothing issues in GAN-based methods. However, these models struggle to maintain temporal consistency, as they are trained on static images,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Rui Xie , Yinhong Liu , Penghao Zhou , Chen Zhao , Jun Zhou , Kai Zhang , Zhenyu Zhang , Jian Yang , Zhenheng Yang , Ying Tai

It is well known the adversarial optimization of GAN-based image super-resolution (SR) methods makes the preceding SR model generate unpleasant and undesirable artifacts, leading to large distortion. We attribute the cause of such…

Image and Video Processing · Electrical Eng. & Systems 2023-12-01 Axi Niu , Kang Zhang , Joshua Tian Jin Tee , Trung X. Pham , Jinqiu Sun , Chang D. Yoo , In So Kweon , Yanning Zhang

Light field (LF) image super-resolution (SR) is a challenging problem due to its inherent ill-posed nature, where a single low-resolution (LR) input LF image can correspond to multiple potential super-resolved outcomes. Despite this…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Wentao Chao , Fuqing Duan , Xuechun Wang , Yingqian Wang , Guanghui Wang

Recently, diffusion model-based inverse problem solvers (DIS) have emerged as state-of-the-art approaches for addressing inverse problems, including image super-resolution, deblurring, inpainting, etc. However, their application to video…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Taesung Kwon , Jong Chul Ye

Capsule endoscopy has enabled minimally invasive gastrointestinal imaging, but its clinical utility is limited by the inherently low resolution of captured images due to hardware, power, and transmission constraints. This limitation hampers…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Haozhe Jia

High temporal resolution is essential for capturing fine-grained details in video understanding. However, current video large language models (VLLMs) and benchmarks mostly rely on low-frame-rate sampling, such as uniform sampling or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Haichao Zhang , Wenhao Chai , Shwai He , Ang Li , Yun Fu

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng

In this paper, we propose a novel framework for solving high-definition video inverse problems using latent image diffusion models. Building on recent advancements in spatio-temporal optimization for video inverse problems using image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Taesung Kwon , Jong Chul Ye

Recent video inpainting methods have achieved encouraging improvements by leveraging optical flow to guide pixel propagation from reference frames either in the image space or feature space. However, they would produce severe artifacts in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Chaohao Xie , Kai Han , Kwan-Yee K. Wong

We present DiSR-NeRF, a diffusion-guided framework for view-consistent super-resolution (SR) NeRF. Unlike prior works, we circumvent the requirement for high-resolution (HR) reference images by leveraging existing powerful 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jie Long Lee , Chen Li , Gim Hee Lee

Image Super-Resolution (ISR) has seen significant progress with the introduction of remarkable generative models. However, challenges such as the trade-off issues between fidelity and realism, as well as computational complexity, have also…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Yunpeng Qu , Kun Yuan , Jinhua Hao , Kai Zhao , Qizhi Xie , Ming Sun , Chao Zhou

Large-scale pre-trained diffusion models have been extensively adopted for real-world image Super-Resolution because of their powerful generative priors through textual guidance. However, when super-resolving high-resolution images with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Qingji Dong , Hang Dong , Mingqin Chen , Rui Zhang , Yitong Wang

Current deep learning approaches in computer vision primarily focus on RGB data sacrificing information. In contrast, RAW images offer richer representation, which is crucial for precise recognition, particularly in challenging conditions…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Christoph Reinders , Radu Berdan , Beril Besbinar , Junji Otsuka , Daisuke Iso

While burst LR images are useful for improving the SR image quality compared with a single LR image, prior SR networks accepting the burst LR images are trained in a deterministic manner, which is known to produce a blurry SR image. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Kyotaro Tokoro , Kazutoshi Akita , Norimichi Ukita

Existing diffusion-based video super-resolution (VSR) methods are susceptible to introducing complex degradations and noticeable artifacts into high-resolution videos due to their inherent randomness. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Shijun Shi , Jing Xu , Lijing Lu , Zhihang Li , Kai Hu

Human mesh recovery (HMR) from a single RGB image is inherently ambiguous, as multiple 3D poses can correspond to the same 2D observation. Recent diffusion-based methods tackle this by generating various hypotheses, but often sacrifice…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Wenhao Shen , Hao Wang , Wanqi Yin , Fayao Liu , Xulei Yang , Chao Liang , Zhongang Cai , Guosheng Lin

Denoising diffusion models achieved impressive results on several image generation tasks often outperforming GAN based models. Recently, the generative capabilities of diffusion models have been employed for perceptual image compression,…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Jonas Brenig , Radu Timofte

Diffusion models have emerged as a leading technique for generating images due to their ability to create high-resolution and realistic images. Despite their strong performance, diffusion models still struggle in managing image collections…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Hailong Yang , Te Zhang , Kup-sze Choi , Zhaohong Deng