English
Related papers

Related papers: Asymmetric VAE for One-Step Video Super-Resolution…

200 papers

Diffusion probabilistic models have been shown to generate state-of-the-art results on several competitive image synthesis benchmarks but lack a low-dimensional, interpretable latent space, and are slow at generation. On the other hand,…

Machine Learning · Computer Science 2022-11-30 Kushagra Pandey , Avideep Mukherjee , Piyush Rai , Abhishek Kumar

Diffusion models (DMs) have significantly advanced the development of real-world image super-resolution (Real-ISR), but the computational cost of multi-step diffusion models limits their application. One-step diffusion models generate…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Jianze Li , Jiezhang Cao , Yong Guo , Wenbo Li , Yulun Zhang

Recent video super-resolution (VSR) approaches use deep neural networks to enhance low-quality input videos and recover visual detail, with diffusion-based methods in particular showing promising results. In this paper, we investigate…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Benjamin Herb , Steve Göring , Alexander Raake , Rakesh Rao Ramachandra Rao

Diffusion models have recently shown promising results for video super-resolution (VSR). However, directly adapting generative diffusion models to VSR can result in redundancy, since low-quality videos already preserve substantial content…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jinpei Guo , Yifei Ji , Shengwei Wang , Zheng Chen , Yufei Wang , Sizhuo Ma , Yong Guo , Baiang Li , Jusheng Zhang , Yulun Zhang , Jian Wang

Diffusion-based models have shown strong performance in video super-resolution (VSR) and video frame interpolation (VFI). However, their role in the coupled space-time video super-resolution (STVSR) setting remains limited. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zheng Chen , Ruofan Yang , Jin Han , Dehua Song , Zichen Zou , Chunming He , Yong Guo , Yulun Zhang

Versatile audio super-resolution (SR) is the challenging task of restoring high-frequency components from low-resolution audio with sampling rates between 4kHz and 32kHz in various domains such as music, speech, and sound effects. Previous…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Jaekwon Im , Juhan Nam

Diffusion-based image compression has demonstrated impressive perceptual performance. However, it suffers from two critical drawbacks: (1) excessive decoding latency due to multi-step sampling, and (2) poor fidelity resulting from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Zheng Chen , Mingde Zhou , Jinpei Guo , Jiale Yuan , Yifei Ji , Yulun Zhang

Diffusion models have demonstrated impressive performance in face restoration. Yet, their multi-step inference process remains computationally intensive, limiting their applicability in real-world scenarios. Moreover, existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jingkai Wang , Jue Gong , Lin Zhang , Zheng Chen , Xing Liu , Hong Gu , Yutong Liu , Yulun Zhang , Xiaokang Yang

While many diffusion models have achieved impressive results in real-world video super-resolution (Real-VSR) by generating rich and realistic details, their reliance on multi-step sampling leads to slow inference. One-step networks like…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Bin Chen , Weiqi Li , Shijie Zhao , Xuanyu Zhang , Junlin Li , Li Zhang , Jian Zhang

Diffusion models have demonstrated excellent performance for real-world image super-resolution (Real-ISR), albeit at high computational costs. Most existing methods are trying to derive one-step diffusion models from multi-step counterparts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jianze Li , Jiezhang Cao , Zichen Zou , Xiongfei Su , Xin Yuan , Yulun Zhang , Yong Guo , Xiaokang Yang

Video super-resolution (VSR) is a critical task for enhancing low-bitrate and low-resolution videos, particularly in streaming applications. While numerous solutions have been developed, they often suffer from high computational demands,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-27 Marcos V Conde , Zhijun Lei , Wen Li , Christos Bampis , Ioannis Katsavounidis , Radu Timofte

A diffusion-based voice conversion (VC) model (e.g., VoiceGrad) can achieve high speech quality and speaker similarity; however, its conversion process is slow owing to iterative sampling. FastVoiceGrad overcomes this limitation by…

Sound · Computer Science 2025-08-26 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Yuto Kondo

Recent advances in Latent Video Diffusion Models (LVDMs) have revolutionized video generation by leveraging Video Variational Autoencoders (Video VAEs) to compress intricate video data into a compact latent space. However, as LVDM training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yu Cheng , Fajie Yuan

The multi-step sampling mechanism, a key feature of visual diffusion models, has significant potential to replicate the success of OpenAI's Strawberry in enhancing performance by increasing the inference computational cost. Sufficient prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Shitong Shao , Zikai Zhou , Lichen Bai , Haoyi Xiong , Zeke Xie

Diffusion models have demonstrated exceptional capabilities in image restoration, yet their application to video super-resolution (VSR) faces significant challenges in balancing fidelity with temporal consistency. Our evaluation reveals a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaohui Li , Yihao Liu , Shuo Cao , Ziyan Chen , Shaobin Zhuang , Xiangyu Chen , Yinan He , Yi Wang , Yu Qiao

Diffusion-based models have been widely used in various visual generation tasks, showing promising results in image super-resolution (SR), while typically being limited by dozens or even hundreds of sampling steps. Although existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Xue Wu , Jingwei Xin , Zhijun Tu , Jie Hu , Jie Li , Nannan Wang , Xinbo Gao

Diffusion models have achieved remarkable progress in the field of video generation. However, their iterative denoising nature requires a large number of inference steps to generate a video, which is slow and computationally expensive. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

Video Face Enhancement (VFE) aims to restore high-quality facial regions from degraded video sequences, enabling a wide range of practical applications. Despite substantial progress in the field, current methods that primarily rely on video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Shulian Zhang , Yong Guo , Long Peng , Ziyang Wang , Ye Chen , Wenbo Li , Xiao Zhang , Yulun Zhang , Jian Chen

Although there have been significant advancements in image compression techniques, such as standard and learned codecs, these methods still suffer from severe quality degradation at extremely low bits per pixel. While recent diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Chanung Park , Joo Chan Lee , Jong Hwan Ko

Latent diffusion models have enabled high-quality video synthesis, yet their inference remains costly and time-consuming. As diffusion transformers become increasingly efficient, the latency bottleneck inevitably shifts to VAE decoders. To…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lunjie Zhu , Yushi Huang , Xingtong Ge , Yufei Xue , Zhening Liu , Yumeng Zhang , Zehong Lin , Jun Zhang