English
Related papers

Related papers: InstaVSR: Taming Diffusion for Efficient and Tempo…

200 papers

Diffusion Transformers (DiTs) dominate video generation but their high computational cost severely limits real-world applicability, usually requiring tens of minutes to generate a few seconds of video even on high-performance GPUs. This…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Haocheng Xi , Shuo Yang , Yilong Zhao , Chenfeng Xu , Muyang Li , Xiuyu Li , Yujun Lin , Han Cai , Jintao Zhang , Dacheng Li , Jianfei Chen , Ion Stoica , Kurt Keutzer , Song Han

Video generation has achieved remarkable progress with the introduction of diffusion models, which have significantly improved the quality of generated videos. However, recent research has primarily focused on scaling up model training,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Chenyang Si , Weichen Fan , Zhengyao Lv , Ziqi Huang , Yu Qiao , Ziwei Liu

The rapid progress in artificial intelligence-generated content (AIGC), especially with diffusion models, has significantly advanced development of high-quality video generation. However, current video diffusion models exhibit demanding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zheng Zhan , Yushu Wu , Yifan Gong , Zichong Meng , Zhenglun Kong , Changdi Yang , Geng Yuan , Pu Zhao , Wei Niu , Yanzhi Wang

Diffusion-based image super-resolution (SR) models have attracted substantial interest due to their powerful image restoration capabilities. However, prevailing diffusion models often struggle to strike an optimal balance between efficiency…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Qinpeng Cui , Yixuan Liu , Xinyi Zhang , Qiqi Bao , Qingmin Liao , Li Wang , Tian Lu , Zicheng Liu , Zhongdao Wang , Emad Barsoum

Efficient Image Super-Resolution (SR) aims to accelerate SR network inference by minimizing computational complexity and network parameters while preserving performance. Existing state-of-the-art Efficient Image Super-Resolution methods are…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Xiaoyan Lei , Wenlong Zhang , Weifeng Cao

Diffusion models have demonstrated excellent performance for real-world image super-resolution (Real-ISR), albeit at high computational costs. Most existing methods are trying to derive one-step diffusion models from multi-step counterparts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jianze Li , Jiezhang Cao , Zichen Zou , Xiongfei Su , Xin Yuan , Yulun Zhang , Yong Guo , Xiaokang Yang

It is a challenging problem to reproduce rich spatial details while maintaining temporal consistency in real-world video super-resolution (Real-VSR), especially when we leverage pre-trained generative models such as stable diffusion (SD)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Yujing Sun , Lingchen Sun , Shuaizheng Liu , Rongyuan Wu , Zhengqiang Zhang , Lei Zhang

The recent use of diffusion prior, enhanced by pre-trained text-image models, has markedly elevated the performance of image super-resolution (SR). To alleviate the huge computational cost required by pixel-based diffusion SR, latent-based…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Feng Luo , Jinxi Xiang , Jun Zhang , Xiao Han , Wei Yang

Video Face Enhancement (VFE) aims to restore high-quality facial regions from degraded video sequences, enabling a wide range of practical applications. Despite substantial progress in the field, current methods that primarily rely on video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Shulian Zhang , Yong Guo , Long Peng , Ziyang Wang , Ye Chen , Wenbo Li , Xiao Zhang , Yulun Zhang , Jian Chen

Volumetric video relighting is essential for bringing captured performances into virtual worlds, but current approaches struggle to deliver temporally stable, production-ready results. Diffusion-based intrinsic decomposition methods show…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Elisabeth Jüttner , Janelle Pfeifer , Leona Krath , Stefan Korfhage , Hannah Dröge , Matthias B. Hullin , Markus Plack

Image restoration faces challenges including ineffective feature fusion, computational bottlenecks and inefficient diffusion processes. To address these, we propose DiffRWKVIR, a novel framework unifying Test-Time Training (TTT) with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Rongchang Lu , Tianduo Luo , Yunzhi Jiang , Conghan Yue , Pei Yang , Guibao Liu , Changyang Gu

Diffusion-based models have gained wide adoption in the virtual human generation due to their outstanding expressiveness. However, their substantial computational requirements have constrained their deployment in real-time interactive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Haojie Yu , Zhaonian Wang , Yihan Pan , Meng Cheng , Hao Yang , Chao Wang , Tao Xie , Xiaoming Xu , Xiaoming Wei , Xunliang Cai

In this paper, we propose GuideSR, a novel single-step diffusion-based image super-resolution (SR) model specifically designed to enhance image fidelity. Existing diffusion-based SR approaches typically adapt pre-trained generative models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-02 Aditya Arora , Zhengzhong Tu , Yufei Wang , Ruizheng Bai , Jian Wang , Sizhuo Ma

Rapid advancements in video diffusion models have enabled the creation of realistic videos, raising concerns about unauthorized use and driving the demand for techniques to protect model ownership. Existing watermarking methods, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 MinHyuk Jang , Youngdong Jang , JaeHyeok Lee , Feng Yang , Gyeongrok Oh , Jongheon Jeong , Sangpil Kim

Mesh reconstruction from multi-view images is a fundamental problem in computer vision, but its performance degrades significantly under sparse-view conditions, especially in unseen regions where no ground-truth observations are available.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Haoyang Wang , Liming Liu , Peiheng Wang , Junlin Hao , Jiangkai Wu , Xinggong Zhang

Continuous space-time video super-resolution (C-STVSR) endeavors to upscale videos simultaneously at arbitrary spatial and temporal scales, which has recently garnered increasing interest. However, prevailing methods struggle to yield…

Image and Video Processing · Electrical Eng. & Systems 2025-05-09 Shuoyan Wei , Feng Li , Shengeng Tang , Yao Zhao , Huihui Bai

In this paper, we propose the first diffusion-based all-in-one video restoration method that utilizes the power of a pre-trained Stable Diffusion and a fine-tuned ControlNet. Our method can restore various types of video degradation with a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yizhou Li , Zihua Liu , Yusuke Monno , Masatoshi Okutomi

Diffusion models have recently shown promising results for video super-resolution (VSR). However, directly adapting generative diffusion models to VSR can result in redundancy, since low-quality videos already preserve substantial content…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jinpei Guo , Yifei Ji , Shengwei Wang , Zheng Chen , Yufei Wang , Sizhuo Ma , Yong Guo , Baiang Li , Jusheng Zhang , Yulun Zhang , Jian Wang

Video diffusion models can generate realistic and temporally consistent videos. This raises concerns about provenance, ownership, and integrity. Watermarking can help address these issues by embedding metadata directly into the content. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Mohammadreza Teymoorianfard , Siddarth Sitaraman , Shiqing Ma , Amir Houmansadr

The objective of image super-resolution is to generate clean and high-resolution images from degraded versions. Recent advancements in diffusion modeling have led to the emergence of various image super-resolution techniques that leverage…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Haolan Chen , Jinhua Hao , Kai Zhao , Kun Yuan , Ming Sun , Chao Zhou , Wei Hu