中文
相关论文

相关论文: Fast and Memory-Efficient Video Diffusion Using St…

200 篇论文

Image fusion is a fundamental and important task in computer vision, aiming to combine complementary information from different modalities to fuse images. In recent years, diffusion models have made significant developments in the field of…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Zirui Wang , Jiayi Zhang , Tianwei Guan , Yuhan Zhou , Xingyuan Li , Minjing Dong , Jinyuan Liu

The multi-step sampling mechanism, a key feature of visual diffusion models, has significant potential to replicate the success of OpenAI's Strawberry in enhancing performance by increasing the inference computational cost. Sufficient prior…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Shitong Shao , Zikai Zhou , Lichen Bai , Haoyi Xiong , Zeke Xie

Video generation has drawn significant interest recently, pushing the development of large-scale models capable of producing realistic videos with coherent motion. Due to memory constraints, these models typically generate short video…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Idan Kligvasser , Regev Cohen , George Leifman , Ehud Rivlin , Michael Elad

The recent wave of AI-generated content (AIGC) has witnessed substantial success in computer vision, with the diffusion model playing a crucial role in this achievement. Due to their impressive generative capabilities, diffusion models are…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Zhen Xing , Qijun Feng , Haoran Chen , Qi Dai , Han Hu , Hang Xu , Zuxuan Wu , Yu-Gang Jiang

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yuyang You , Yongzhi Li , Jiahui Li , Yadong Mu , Quan Chen , Peng Jiang

Video inverse problems are fundamental to streaming, telepresence, and AR/VR, where high perceptual quality must coexist with tight latency constraints. Diffusion-based priors currently deliver state-of-the-art reconstructions, but existing…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Weimin Bai , Suzhe Xu , Yiwei Ren , Jinhua Hao , Ming Sun , Wenzheng Chen , He Sun

The emergence of diffusion models has significantly advanced generative AI, improving the quality, realism, and creativity of image and video generation. Among them, Stable Diffusion (StableDiff) stands out as a key model for text-to-image…

硬件体系结构 · 计算机科学 2025-07-03 Zhican Wang , Guanghui He , Hongxiang Fan

Feature caching has recently emerged as a promising method for diffusion model acceleration. It effectively alleviates the inefficiency problem caused by high computational requirements by caching similar features in the inference process…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Jiayi Pan , Jiaming Xu , Yongkang Zhou , Guohao Dai

Diffusion models have achieved remarkable success in video generation; however, the high computational cost of the denoising process remains a major bottleneck. Existing approaches have shown promise in reducing the number of diffusion…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Xiao Liang , Yunzhu Zhang , Linchao Zhu

In this paper, we introduce Fairy, a minimalist yet robust adaptation of image-editing diffusion models, enhancing them for video editing applications. Our approach centers on the concept of anchor-based cross-frame attention, a mechanism…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Bichen Wu , Ching-Yao Chuang , Xiaoyan Wang , Yichen Jia , Kapil Krishnakumar , Tong Xiao , Feng Liang , Licheng Yu , Peter Vajda

Diffusion transformer-based video generation models (DiTs) have recently attracted widespread attention for their excellent generation quality. However, their computational cost remains a major bottleneck-attention alone accounts for over…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Xuan Shen , Chenxia Han , Yufa Zhou , Yanyue Xie , Yifan Gong , Quanyi Wang , Yiwei Wang , Yanzhi Wang , Pu Zhao , Jiuxiang Gu

Autoregressive video models offer distinct advantages over bidirectional diffusion models in creating interactive video content and supporting streaming applications with arbitrary duration. In this work, we present Next-Frame Diffusion…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Xinle Cheng , Tianyu He , Jiayi Xu , Junliang Guo , Di He , Jiang Bian

High-resolution video generation, while crucial for digital media and film, is computationally bottlenecked by the quadratic complexity of diffusion models, making practical inference infeasible. To address this, we introduce HiStream, an…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Haonan Qiu , Shikun Liu , Zijian Zhou , Zhaochong An , Weiming Ren , Zhiheng Liu , Jonas Schult , Sen He , Shoufa Chen , Yuren Cong , Tao Xiang , Ziwei Liu , Juan-Manuel Perez-Rua

Diffusion-based image super-resolution (SR) methods are mainly limited by the low inference speed due to the requirements of hundreds or even thousands of sampling steps. Existing acceleration sampling techniques inevitably sacrifice…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Zongsheng Yue , Jianyi Wang , Chen Change Loy

This paper presents PipeFusion, an innovative parallel methodology to tackle the high latency issues associated with generating high-resolution images using diffusion transformers (DiTs) models. PipeFusion partitions images into patches and…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Jiarui Fang , Jinzhe Pan , Aoyu Li , Xibo Sun , Jiannan Wang

Diffusion models have recently advanced video restoration, but applying them to real-world video super-resolution (VSR) remains challenging due to high latency, prohibitive computation, and poor generalization to ultra-high resolutions. Our…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Junhao Zhuang , Shi Guo , Xin Cai , Xiaohui Li , Yihao Liu , Chun Yuan , Tianfan Xue

Current 4D generation methods have achieved noteworthy efficacy with the aid of advanced diffusion generative models. However, these methods lack multi-view spatial-temporal modeling and encounter challenges in integrating diverse prior…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

As a fundamental backbone for video generation, diffusion models are challenged by low inference speed due to the sequential nature of denoising. Previous methods speed up the models by caching and reusing model outputs at uniformly…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Feng Liu , Shiwei Zhang , Xiaofeng Wang , Yujie Wei , Haonan Qiu , Yuzhong Zhao , Yingya Zhang , Qixiang Ye , Fang Wan

Recent advances in video diffusion models have shifted towards transformer-based architectures, achieving state-of-the-art video generation but at the cost of quadratic attention complexity, which severely limits scalability for longer…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Mohsen Ghafoorian , Amirhossein Habibian

Diffusion Transformers currently lead the field in high-quality video generation, but their slow iterative denoising process and prohibitive quadratic attention costs for long sequences create significant inference bottlenecks. While both…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Youping Gu , Xiaolong Li , Yuhao Hu , Minqi Chen , Bohan Zhuang