English
Related papers

Related papers: FlashMotion: Few-Step Controllable Video Generatio…

200 papers

Diffusion probabilistic models have shown significant progress in video generation; however, their computational efficiency is limited by the large number of sampling steps required. Reducing sampling steps often compromises video quality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zihan Ding , Chi Jin , Difan Liu , Haitian Zheng , Krishna Kumar Singh , Qiang Zhang , Yan Kang , Zhe Lin , Yuchen Liu

Recent years have seen substantial progress in diffusion-based controllable video generation. However, achieving precise control in complex scenarios, including fine-grained object parts, sophisticated motion trajectories, and coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Haitao Zhou , Chuang Wang , Rui Nie , Jinlin Liu , Dongdong Yu , Qian Yu , Changhu Wang

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuyang You , Yongzhi Li , Jiahui Li , Yadong Mu , Quan Chen , Peng Jiang

Current video diffusion models achieve impressive generation quality but struggle in interactive applications due to bidirectional attention dependencies. The generation of a single frame requires the model to process the entire sequence,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tianwei Yin , Qiang Zhang , Richard Zhang , William T. Freeman , Fredo Durand , Eli Shechtman , Xun Huang

Motion control is crucial for generating expressive and compelling video content; however, most existing video generation models rely mainly on text prompts for control, which struggle to capture the nuances of dynamic actions and temporal…

Generating chemically valid 3D molecular conformations is critical for computational drug discovery. Classical diffusion-based models like GeoLDM perform well but require hundreds of steps, making large-scale in silico screening…

Machine Learning · Computer Science 2026-05-11 Xinyuan Wei , Zian Li , Shaoheng Yan , Cai Zhou , Muhan Zhang

Discrete flow matching generates text by iteratively transforming noise tokens into coherent language, but may require hundreds of forward passes. Distillation uses the multi-step trajectory to train a student to reproduce the process in a…

Machine Learning · Computer Science 2026-05-11 Amin Karimi Monsefi , Dominic Culver , Nikhil Bhendawade , Manuel R. Ciosici , Yizhe Zhang , Irina Belousova

Diffusion large language models (DLLMs) have emerged as powerful generative models with the promise of fast text generation through parallel decoding. However, realizing this potential in practice remains challenging: reducing the number of…

Recent advances in large multi-modal generative models have demonstrated impressive capabilities in multi-modal generation, including image and video generation. These models are typically built upon multi-step frameworks like diffusion and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Zhenglin Cheng , Peng Sun , Jianguo Li , Tao Lin

We propose FlashWorld, a generative model that produces 3D scenes from a single image or text prompt in seconds, 10~100$\times$ faster than previous works while possessing superior rendering quality. Our approach shifts from the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xinyang Li , Tengfei Wang , Zixiao Gu , Shengchuan Zhang , Chunchao Guo , Liujuan Cao

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

Machine Learning · Computer Science 2025-06-12 Bowen Zheng , Tianming Yang

Recent advances in diffusion models bring new vitality to visual content creation. However, current text-to-video generation models still face significant challenges such as high training costs, substantial data requirements, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Sicong Feng , Jielong Yang , Li Peng

Achieving high-fidelity generation in extremely few sampling steps has long been a central goal of generative modeling. Existing approaches largely rely on distillation-based frameworks to compress the original multi-step denoising process…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Rui Li , Bingyu Li , Yuanzhi Liang , Haibin Huang , Chi Zhang , XueLong Li

Recent advancements in generative models have provided promising solutions for synthesizing realistic driving videos, which are crucial for training autonomous driving perception models. However, existing approaches often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Wei Wu , Xi Guo , Weixuan Tang , Tingxuan Huang , Chiyu Wang , Dongyue Chen , Chenjing Ding

Discrete diffusion models excel at visual synthesis but rely on slow, iterative decoding. Existing single-step distillation methods attempt to bypass this bottleneck, either by training auxiliary score networks that effectively double…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Chaoyang Wang , Yunhai Tong

Despite remarkable achievements in video synthesis, achieving granular control over complex dynamics, such as nuanced movement among multiple interacting objects, still presents a significant hurdle for dynamic world modeling, compounded by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Pengxiang Li , Kai Chen , Zhili Liu , Ruiyuan Gao , Lanqing Hong , Guo Zhou , Hua Yao , Dit-Yan Yeung , Huchuan Lu , Xu Jia

In recent years, generative artificial intelligence has achieved significant advancements in the field of image generation, spawning a variety of applications. However, video generation still faces considerable challenges in various…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yuang Zhang , Jiaxi Gu , Li-Wen Wang , Han Wang , Junqi Cheng , Yuefeng Zhu , Fangyuan Zou

Recent advancements in diffusion models have shown great promise in producing high-quality video content. However, efficiently training video diffusion models capable of integrating directional guidance and controllable motion intensity…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Xuehai He , Shuohang Wang , Jianwei Yang , Xiaoxia Wu , Yiping Wang , Kuan Wang , Zheng Zhan , Olatunji Ruwase , Yelong Shen , Xin Eric Wang

Timestep distillation is an effective approach for improving the generation efficiency of diffusion models. The Consistency Model (CM), as a trajectory-based framework, demonstrates significant potential due to its strong theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Bao Tang , Shuai Zhang , Yueting Zhu , Jijun Xiang , Xin Yang , Li Yu , Wenyu Liu , Xinggang Wang

Consistency distillation methods have demonstrated significant success in accelerating generative tasks of diffusion models. However, since previous consistency distillation methods use simple and straightforward strategies in selecting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Cunzheng Wang , Ziyuan Guo , Yuxuan Duan , Huaxia Li , Nemo Chen , Xu Tang , Yao Hu