English
Related papers

Related papers: Forecast then Calibrate: Feature Caching as ODE fo…

200 papers

Latent diffusion models have shown promising results in audio generation, making notable advancements over traditional methods. However, their performance, while impressive with short audio clips, faces challenges when extended to longer…

Sound · Computer Science 2024-07-16 Zhenxiong Tan , Xinyin Ma , Gongfan Fang , Xinchao Wang

Text-to-Video applications receive increasing attention from the public. Among these, diffusion models have emerged as the most prominent approach, offering impressive quality in visual content generation. However, it still suffers from…

Multimedia · Computer Science 2025-01-09 Desen Sun , Henry Tian , Tim Lu , Sihang Liu

Generative models, particularly Diffusion Models (DM), have shown strong potential for Computed Tomography (CT) reconstruction serving as expressive priors for solving ill-posed inverse problems. However, diffusion-based reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Jiayang Shi , Lincen Yang , Zhong Li , Tristan Van Leeuwen , Daniel M. Pelt , K. Joost Batenburg

Despite recent progress in video generation, inference speed remains a major bottleneck. A common acceleration strategy involves reusing model outputs via caching mechanisms at fixed intervals. However, we find that such fixed-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Zishen Huang , Chunyu Yang , Mengyuan Ren

Diffusion Transformers (DiTs) have emerged as a leading architecture for text-to-image synthesis, producing high-quality and photorealistic images. However, the quadratic scaling properties of the attention in DiTs hinder image generation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Philipp Becker , Abhinav Mehrotra , Ruchika Chavhan , Malcolm Chadwick , Luca Morreale , Mehdi Noroozi , Alberto Gil Ramos , Sourav Bhattacharya

Imitation learning, particularly Diffusion Policies based methods, has recently gained significant traction in embodied AI as a powerful approach to action policy generation. These models efficiently generate action policies by learning to…

Robotics · Computer Science 2025-04-15 Haiyong Yu , Yanqiong Jin , Yonghao He , Wei Sui

Generative modelling paradigms based on denoising diffusion processes have emerged as a leading candidate for conditional sampling in inverse problems. In many real-world applications, we often have access to large, expensively trained…

Diffusion-based generative models have become dominant generators of high-fidelity images and videos but remain limited by their computationally expensive inference procedures. Existing acceleration techniques either require extensive model…

Machine Learning · Computer Science 2025-07-22 Jiaqi Han , Haotian Ye , Puheng Li , Minkai Xu , James Zou , Stefano Ermon

Recent progress in diffusion models has significantly advanced the field of human image animation. While existing methods can generate temporally consistent results for short or regular motions, significant challenges remain, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Shen Zheng , Jiaran Cai , Yuansheng Guan , Shenneng Huang , Xingpei Ma , Junjie Cao , Hanfeng Zhao , Qiang Zhang , Shunsi Zhang , Xiao-Ping Zhang

Face anti-spoofing (FAS) and adversarial detection (FAD) have been regarded as critical technologies to ensure the safety of face recognition systems. However, due to limited practicality, complex deployment, and the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Jiawei Chen , Xiao Yang , Yinpeng Dong , Hang Su , Zhaoxia Yin

Diffusion-based text-to-image generation models trade latency for quality: small models are fast but generate lower-quality images, while large models produce better images but are slow. We present MoDM, a novel caching-based serving system…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-05 Yuchen Xia , Divyam Sharma , Yichao Yuan , Souvik Kundu , Nishil Talati

Diffusion models have proven to be highly effective in generating high-quality images. However, adapting large pre-trained diffusion models to new domains remains an open challenge, which is critical for real-world applications. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Enze Xie , Lewei Yao , Han Shi , Zhili Liu , Daquan Zhou , Zhaoqiang Liu , Jiawei Li , Zhenguo Li

Existing video tokenizers typically use the traditional Variational Autoencoder (VAE) architecture for video compression and reconstruction. However, to achieve good performance, its training process often relies on complex multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Nianzu Yang , Pandeng Li , Liming Zhao , Yang Li , Chen-Wei Xie , Yehui Tang , Xudong Lu , Zhihang Liu , Yun Zheng , Yu Liu , Junchi Yan

Recent diffusion models enable high-quality video generation, but suffer from slow runtimes. The large transformer-based backbones used in these models are bottlenecked by spatiotemporal attention. In this paper, we identify that a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shai Yehezkel , Shahar Yadin , Noam Elata , Yaron Ostrovsky-Berman , Bahjat Kawar

Though rectified flow models have achieved remarkable performance in image, video, and 3D generation, their practical deployments are challenged by slow inference speeds. Prior acceleration methods reuse cached features from previous steps,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Junwen Tan , Jinglin Liang , Hongyuan Chen , Shuangping Huang

Current video deblurring methods have limitations in recovering high-frequency information since the regression losses are conservative with high-frequency details. Since Diffusion Models (DMs) have strong capabilities in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Chen Rao , Guangyuan Li , Zehua Lan , Jiakai Sun , Junsheng Luan , Wei Xing , Lei Zhao , Huaizhong Lin , Jianfeng Dong , Dalong Zhang

Diffusion and flow matching models generate high-fidelity data by simulating paths defined by Ordinary or Stochastic Differential Equations (ODEs/SDEs), starting from a tractable prior distribution. The probability flow ODE formulation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Liangyu Yuan , Ruoyu Wang , Tong Zhao , Dingwen Fu , Mingkun Lei , Beier Zhu , Chi Zhang

Diffusion Morphs (DiM) are a recent state-of-the-art method for creating high quality face morphs; however, they require a high number of network function evaluations (NFE) to create the morphs. We propose a new DiM pipeline, Fast-DiM,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Zander W. Blasingame , Chen Liu

Although diffusion model has shown great potential for generating higher quality images than GANs, slow sampling speed hinders its wide application in practice. Progressive distillation is thus proposed for fast sampling by progressively…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Wujie Sun , Defang Chen , Can Wang , Deshi Ye , Yan Feng , Chun Chen

Despite the tremendous success of diffusion generative models in text-to-image generation, replicating this success in the domain of image compression has proven difficult. In this paper, we demonstrate that diffusion can significantly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-11 Emiel Hoogeboom , Eirikur Agustsson , Fabian Mentzer , Luca Versari , George Toderici , Lucas Theis