English
Related papers

Related papers: Efficient Autoregressive Video Diffusion with Dumm…

200 papers

Autoregressive language models, despite their impressive capabilities, struggle with complex reasoning and long-term planning tasks. We introduce discrete diffusion models as a novel solution to these challenges. Through the lens of subgoal…

Computation and Language · Computer Science 2025-02-19 Jiacheng Ye , Jiahui Gao , Shansan Gong , Lin Zheng , Xin Jiang , Zhenguo Li , Lingpeng Kong

Instructional video editing applies edits to an input video using only text prompts, enabling intuitive natural-language control. Despite rapid progress, most methods still require fixed-length inputs and substantial compute. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Mohammadreza Salehi , Mehdi Noroozi , Luca Morreale , Ruchika Chavhan , Malcolm Chadwick , Alberto Gil Ramos , Abhinav Mehrotra

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

Real-time motion-controllable video generation remains challenging due to the inherent latency of bidirectional diffusion models and the lack of effective autoregressive (AR) approaches. Existing AR video diffusion models are limited to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Kesen Zhao , Jiaxin Shi , Beier Zhu , Junbao Zhou , Xiaolong Shen , Yuan Zhou , Qianru Sun , Hanwang Zhang

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent \textit{multi-step iterations} and \textit{complex backbone networks} lead to…

The computational demands of self-attention mechanisms pose a critical challenge for transformer-based video generation, particularly in synthesizing ultra-long sequences. Current approaches, such as factorized attention and fixed sparse…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Qirui Li , Guangcong Zheng , Qi Zhao , Jie Li , Bin Dong , Yiwu Yao , Xi Li

Diffusion models are a class of generative models that have been recently used for speech enhancement with remarkable success but are computationally expensive at inference time. Therefore, these models are impractical for processing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-15 Bunlong Lay , Rostislav Makarov , Timo Gerkmann

Current video generation models perform well at single-shot synthesis but struggle with multi-shot videos, facing critical challenges in maintaining character and background consistency across shots and flexibly generating videos of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Xiangyang Luo , Qingyu Li , Xiaokun Liu , Wenyu Qin , Miao Yang , Meng Wang , Pengfei Wan , Di Zhang , Kun Gai , Shao-Lun Huang

With recent advances in embodied agents and AR devices, egocentric observations are readily available as input for real-world interactive online applications. However, egocentric viewpoints can only sporadically observe hands, in addition…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Inwoo Hwang , Donggeun Lim , Hojun Jang , Young Min Kim

Recent advances in deep generative modeling have enabled efficient modeling of high dimensional data distributions and opened up a new horizon for solving data compression problems. Specifically, autoencoder based learned image or video…

Machine Learning · Computer Science 2020-04-10 Adam Golinski , Reza Pourreza , Yang Yang , Guillaume Sautiere , Taco S Cohen

Diffusion models have achieved impressive performance in video generation, but their iterative denoising process remains computationally expensive due to the large number of tokens processed at each timestep. Recently, progressive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shikang Zheng , Jingkai Huang , Jiacheng Liu , Guantao Chen , Lixuan , Yuqi Lin , Peiliang Cai , Linfeng Zhang

Despite rapid progress in autonomous driving, reliable training and evaluation of driving systems remain fundamentally constrained by the lack of scalable and interactive simulation environments. Recent generative video models achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yaoru Li , Federico Landi , Marco Godi , Xin Jin , Ruiju Fu , Yufei Ma , Muyang Sun , Heyu Si , Qi Guo

Current image captioning works usually focus on generating descriptions in an autoregressive manner. However, there are limited works that focus on generating descriptions non-autoregressively, which brings more decoding diversity. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yufeng He , Zefan Cai , Xu Gan , Baobao Chang

High-fidelity video generation remains challenging for diffusion models due to the difficulty of modeling complex spatio-temporal dynamics efficiently. Recent video diffusion methods typically represent a video as a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Minh Khoa Le , Kien Do , Duc Thanh Nguyen , Truyen Tran

Image diffusion models are trained on independently sampled static images. While this is the bedrock task protocol in generative modeling, capturing the temporal world through the lens of static snapshots is information-deficient by design.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Juhun Lee , Simon S. Woo

Generating long-form content, such as minute-long videos and extended texts, is increasingly important for modern generative models. Block diffusion improves inference efficiency via KV caching and block-wise causal inference and has been…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Zhuokun Chen , Jianfei Cai , Bohan Zhuang

Diffusion Transformers (DiTs) achieve state-of-the-art performance in high-fidelity image and video generation but suffer from expensive inference due to their iterative denoising structure. While prior methods accelerate sampling by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Dong Liu , Yanxuan Yu , Ben Lengerich , Ying Nian Wu

Diffusion models have demonstrated remarkable performance in image generation, particularly within the domain of style transfer. Prevailing style transfer approaches typically leverage pre-trained diffusion models' robust feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yeqi He , Liang Li , Zhiwen Yang , Xichun Sheng , Zhidong Zhao , Chenggang Yan

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuyang You , Yongzhi Li , Jiahui Li , Yadong Mu , Quan Chen , Peng Jiang

Generating realistic, dyadic talking head video requires ultra-low latency. Existing chunk-based methods require full non-causal context windows, introducing significant delays. This high latency critically prevents the immediate,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Bohong Chen , Haiyang Liu