English
Related papers

Related papers: Motion Prior Distillation in Time Reversal Samplin…

200 papers

Recent literature has effectively leveraged diffusion models trained on continuous variables as priors for solving inverse problems. Notably, discrete diffusion models with discrete latent codes have shown strong performance, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Naoki Murata , Chieh-Hsin Lai , Yuhta Takida , Toshimitsu Uesaka , Bac Nguyen , Stefano Ermon , Yuki Mitsufuji

Data-driven and controllable human motion synthesis and prediction are active research areas with various applications in interactive media and social robotics. Challenges remain in these fields for generating diverse motions given past…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Wenjie Yin , Ruibo Tu , Hang Yin , Danica Kragic , Hedvig Kjellström , Mårten Björkman

Online High-Definition (HD) map construction is pivotal for autonomous driving. While recent approaches leverage historical temporal fusion to improve performance, we identify a critical safety flaw in this paradigm: it is inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ruikai Li , Xinrun Li , Mengwei Xie , Hao Shan , Shoumeng Qiu , Xinyuan Chang , Yizhe Fan , Feng Xiong , Han Jiang , Yilong Ren , Haiyang Yu , Mu Xu , Yang Long , Varun Ojha , Zhiyong Cui

Diffusion models can synthesize realistic co-speech video from audio for various applications, such as video creation and virtual agents. However, existing diffusion-based methods are slow due to numerous denoising steps and costly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Beijia Lu , Ziyi Chen , Jing Xiao , Jun-Yan Zhu

Recent advances in diffusion generative models have yielded remarkable progress. While the quality of generated content continues to improve, these models have grown considerably in size and complexity. This increasing computational burden…

Machine Learning · Computer Science 2025-03-13 Reza Shirkavand , Peiran Yu , Shangqian Gao , Gowthami Somepalli , Tom Goldstein , Heng Huang

In this paper, we address the challenge of procedure planning in instructional videos, aiming to generate coherent and task-aligned action sequences from start and end visual observations. Previous work has mainly relied on text-level…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yufan Zhou , Zhaobo Qi , Lingshuai Lin , Junqi Jing , Tingting Chai , Beichen Zhang , Shuhui Wang , Weigang Zhang

Diffusion models have recently shown considerable potential in solving Bayesian inverse problems when used as priors. However, sampling from the resulting denoising posterior distributions remains a challenge as it involves intractable…

Machine Learning · Statistics 2024-12-25 Badr Moufad , Yazid Janati , Lisa Bedin , Alain Durmus , Randal Douc , Eric Moulines , Jimmy Olsson

We introduce Motion-I2V, a novel framework for consistent and controllable image-to-video generation (I2V). In contrast to previous methods that directly learn the complicated image-to-video mapping, Motion-I2V factorizes I2V into two…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xiaoyu Shi , Zhaoyang Huang , Fu-Yun Wang , Weikang Bian , Dasong Li , Yi Zhang , Manyuan Zhang , Ka Chun Cheung , Simon See , Hongwei Qin , Jifeng Dai , Hongsheng Li

Diffusion trajectory distillation accelerates sampling by training a student model to approximate the multi-step denoising trajectories of a pretrained teacher model using far fewer steps. Despite strong empirical results, the trade-off…

Machine Learning · Computer Science 2026-04-28 Weiguo Gao , Ming Li

Temporal modeling on regular respiration-induced motions is crucial to image-guided clinical applications. Existing methods cannot simulate temporal motions unless high-dose imaging scans including starting and ending frames exist…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Xin You , Minghui Zhang , Hanxiao Zhang , Jie Yang , Nassir Navab

Diffusion models achieve strong generation quality, diversity, and distribution coverage, but their performance often comes with expensive inference. In this work, we propose Stochastic Transition-Map Distillation (STMD), a teacher-free…

Machine Learning · Computer Science 2026-05-11 George Rapakoulias , Peter Garud , Lingjiong Zhu , Panagiotis Tsiotras

Trajectory prediction is a fundamental task in Autonomous Vehicles (AVs) and Intelligent Transportation Systems (ITS), supporting efficient motion planning and real-time traffic safety management. Diffusion models have recently demonstrated…

Artificial Intelligence · Computer Science 2025-10-02 Bingzhang Wang , Kehua Chen , Yinhai Wang

Diffusion distillation is central to accelerating image and video generation, yet existing methods are fundamentally limited by the denoising process, where step reduction has largely saturated. Partial timestep low-resolution generation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Feiyang Chen , Hongpeng Pan , Haonan Xu , Xinyu Duan , Yang Yang , Zhefeng Wang

Generative inbetweening aims to generate intermediate frame sequences by utilizing two key frames as input. Although remarkable progress has been made in video generation models, generative inbetweening still faces challenges in maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Tianyi Zhu , Dongwei Ren , Qilong Wang , Xiaohe Wu , Wangmeng Zuo

Masked discrete diffusion is a dominant paradigm for high-quality language modeling where tokens are iteratively corrupted to a mask state, yet its inference efficiency is bottlenecked by the lack of deterministic sampling tools. While…

Machine Learning · Computer Science 2026-02-03 Guinan Chen , Xunpeng Huang , Ying Sun , Shijin Wang , Yanyong Zhang , Chao Wang

Diffusion probabilistic models (DPMs) have become a popular approach to conditional generation, due to their promising results and support for cross-modal synthesis. A key desideratum in conditional synthesis is to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Ye Zhu , Yu Wu , Kyle Olszewski , Jian Ren , Sergey Tulyakov , Yan Yan

Benefiting from masked visual modeling, self-supervised video representation learning has achieved remarkable progress. However, existing methods focus on learning representations from scratch through reconstructing low-level features like…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Rui Wang , Dongdong Chen , Zuxuan Wu , Yinpeng Chen , Xiyang Dai , Mengchen Liu , Lu Yuan , Yu-Gang Jiang

Dataset Distillation aims to synthesize compact datasets that can approximate the training efficacy of large-scale real datasets, offering an efficient solution to the increasing computational demands of modern deep learning. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Chenru Wang , Yunyi Chen , Zijun Yang , Joey Tianyi Zhou , Chi Zhang

Diffusion models with transformer architectures have demonstrated promising capabilities in generating high-fidelity images and scalability for high resolution. However, iterative sampling process required for synthesis is very…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yeongmin Kim , Sotiris Anagnostidis , Yuming Du , Edgar Schönfeld , Jonas Kohler , Markos Georgopoulos , Albert Pumarola , Ali Thabet , Artsiom Sanakoyeu

In recent times, large datasets hinder efficient model training while also containing redundant concepts. Dataset distillation aims to synthesize compact datasets that preserve the knowledge of large-scale training sets while drastically…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Ayush Roy , Wei-Yang Alex Lee , Rudrasis Chakraborty , Vishnu Suresh Lokhande