中文
相关论文

相关论文: FlashMotion: Few-Step Controllable Video Generatio…

200 篇论文

We propose GoalFlow, an end-to-end autonomous driving method for generating high-quality multimodal trajectories. In autonomous driving scenarios, there is rarely a single suitable trajectory. Recent methods have increasingly focused on…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Zebin Xing , Xingyu Zhang , Yang Hu , Bo Jiang , Tong He , Qian Zhang , Xiaoxiao Long , Wei Yin

Lightweight, controllable, and physically plausible human motion synthesis is crucial for animation, virtual reality, robotics, and human-computer interaction applications. Existing methods often compromise between computational efficiency,…

计算机视觉与模式识别 · 计算机科学 2025-01-29 Arvin Tashakori , Arash Tashakori , Gongbo Yang , Z. Jane Wang , Peyman Servati

Diffusion models have recently shown great promise for generative modeling, outperforming GANs on perceptual quality and autoregressive models at density estimation. A remaining downside is their slow sampling time: generating high quality…

机器学习 · 计算机科学 2022-06-08 Tim Salimans , Jonathan Ho

Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses seldom match their underlying properties. We present PhyCo, a…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Sriram Narayanan , Ziyu Jiang , Srinivasa Narasimhan , Manmohan Chandraker

We tackle the long video generation problem, i.e.~generating videos beyond the output length of video generation models. Due to the computation resource constraints, video generation models can only generate video clips that are relatively…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hsin-Ping Huang , Yu-Chuan Su , Ming-Hsuan Yang

The "one-shot" technique represents a distinct and sophisticated aesthetic in filmmaking. However, its practical realization is often hindered by prohibitive costs and complex real-world constraints. Although emerging video generation…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Jiawei Liu , Junqiao Li , Jiangfan Deng , Gen Li , Siyu Zhou , Zetao Fang , Shanshan Lao , Zengde Deng , Jianing Zhu , Tingting Ma , Jiayi Li , Yunqiu Wang , Qian He , Xinglong Wu

Diffusion models excel at producing high-quality samples but naively require hundreds of iterations, prompting multiple attempts to distill the generation process into a faster network. However, many existing approaches suffer from a…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Zhengyang Geng , Ashwini Pokle , J. Zico Kolter

The ultimate goal of video generation is to satisfy a fundamental trilemma: achieving high visual quality, maintaining rigorous physical consistency, and enabling precise controllability. While recent models can maintain this balance in…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Tianshuo Xu , Zhifei Chen , Leyi Wu , Hao Lu , Ying-cong Chen

The inference latency of diffusion models remains a critical barrier to their real-time application. While trajectory-based and distribution-based step distillation methods offer solutions, they present a fundamental trade-off.…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Hanbo Cheng , Peng Wang , Kaixiang Lei , Qi Li , Zhen Zou , Pengfei Hu , Jun Du

While text-to-video diffusion models have made significant strides, many still face challenges in generating videos with temporal consistency. Within diffusion frameworks, guidance techniques have proven effective in enhancing output…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Hyelin Nam , Jaemin Kim , Dohun Lee , Jong Chul Ye

Diffusion- and flow-based generative models have recently demonstrated strong performance in protein backbone generation tasks, offering unprecedented capabilities for de novo protein design. However, while achieving notable performance in…

机器学习 · 计算机科学 2025-10-29 Liyang Xie , Haoran Zhang , Zhendong Wang , Wesley Tansey , Mingyuan Zhou

In recent years, the rapid expansion of dataset sizes and the increasing complexity of deep learning models have significantly escalated the demand for computational resources, both for data storage and model training. Dataset distillation…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Zhe Li , Hadrien Reynaud , Mischa Dombrowski , Sarah Cechnicka , Franciskus Xaverius Erick , Bernhard Kainz

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial…

计算机视觉与模式识别 · 计算机科学 2022-06-24 Jonathan Ho , Tim Salimans , Alexey Gritsenko , William Chan , Mohammad Norouzi , David J. Fleet

Collecting multi-view driving scenario videos to enhance the performance of 3D visual perception tasks presents significant challenges and incurs substantial costs, making generative models for realistic data an appealing alternative. Yet,…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Junpeng Jiang , Gangyi Hong , Miao Zhang , Hengtong Hu , Kun Zhan , Rui Shao , Liqiang Nie

While recent foundational video generators produce visually rich output, they still struggle with appearance drift, where objects gradually degrade or change inconsistently across frames, breaking visual coherence. We hypothesize that this…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Hyeonho Jeong , Chun-Hao Paul Huang , Jong Chul Ye , Niloy Mitra , Duygu Ceylan

Diffusion trajectory distillation accelerates sampling by training a student model to approximate the multi-step denoising trajectories of a pretrained teacher model using far fewer steps. Despite strong empirical results, the trade-off…

机器学习 · 计算机科学 2026-04-28 Weiguo Gao , Ming Li

Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference…

声音 · 计算机科学 2026-02-11 Bin Lin , Peng Yang , Chao Yan , Xiaochen Liu , Wei Wang , Boyong Wu , Pengfei Tan , Xuerui Yang

Accelerating the sampling speed of diffusion models remains a significant challenge. Recent score distillation methods distill a heavy teacher model into a student generator to achieve one-step generation, which is optimized by calculating…

计算机视觉与模式识别 · 计算机科学 2025-04-18 Shengyuan Zhang , Ling Yang , Zejian Li , An Zhao , Chenye Meng , Changyuan Yang , Guang Yang , Zhiyuan Yang , Lingyun Sun

Real-time motion-controllable video generation remains challenging due to the inherent latency of bidirectional diffusion models and the lack of effective autoregressive (AR) approaches. Existing AR video diffusion models are limited to…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Kesen Zhao , Jiaxin Shi , Beier Zhu , Junbao Zhou , Xiaolong Shen , Yuan Zhou , Qianru Sun , Hanwang Zhang

Filmmaking and animation production often require sophisticated techniques for coordinating camera transitions and object movements, typically involving labor-intensive real-world capturing. Despite advancements in generative AI for video…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Yaowei Li , Xintao Wang , Zhaoyang Zhang , Zhouxia Wang , Ziyang Yuan , Liangbin Xie , Yuexian Zou , Ying Shan