中文
相关论文

相关论文: FreeTraj: Tuning-Free Trajectory Control in Video …

200 篇论文

Current motion-conditioned video generation methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction. We present MotionStream, enabling sub-second latency with up to 29 FPS…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Joonghyuk Shin , Zhengqi Li , Richard Zhang , Jun-Yan Zhu , Jaesik Park , Eli Shechtman , Xun Huang

Match-cuts are powerful cinematic tools that create seamless transitions between scenes, delivering strong visual and metaphorical connections. However, crafting match-cuts is a challenging, resource-intensive process requiring deliberate…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Alejandro Pardo , Fabio Pizzati , Tong Zhang , Alexander Pondaven , Philip Torr , Juan Camilo Perez , Bernard Ghanem

Training-free guidance enables controlled generation in diffusion and flow models, but most methods rely on gradients and assume differentiable objectives. This work focuses on training-free guidance addressing challenges from…

机器学习 · 计算机科学 2025-06-12 Yingqing Guo , Yukang Yang , Hui Yuan , Mengdi Wang

Diffusion models for continuous data gained widespread adoption owing to their high quality generation and control mechanisms. However, controllable diffusion on discrete data faces challenges given that continuous guidance methods do not…

In recent years, diffusion models have demonstrated remarkable potential across diverse domains, from vision generation to language modeling. Transferring its generative capabilities to modern end-to-end autonomous driving systems has also…

机器人学 · 计算机科学 2025-09-17 Xuefeng Jiang , Yuan Ma , Pengxiang Li , Leimeng Xu , Xin Wen , Kun Zhan , Zhongpu Xia , Peng Jia , Xianpeng Lang , Sheng Sun

With the rapid development of AI-generated content (AIGC), video generation has emerged as one of its most dynamic and impactful subfields. In particular, the advancement of video generation foundation models has led to growing demand for…

Flow-based text-to-image models follow deterministic trajectories, making it costly to explore diverse modes under limited sampling budgets. Existing approaches to improving diversity often rely on retraining or degrade image fidelity. To…

人工智能 · 计算机科学 2026-05-21 Jingxuan Wu , Zhenglin Wan , Xingrui Yu , Yuzhe Yang , Bo An , Ivor Tsang , Yang You

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

In this work, we rethink the approach to video super-resolution by introducing a method based on the Diffusion Posterior Sampling framework, combined with an unconditional video diffusion transformer operating in latent space. The video…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Zhihao Zhan , Wang Pang , Xiang Zhu , Yechao Bai

Diffusion models have emerged as a powerful generative method for synthesizing high-quality and diverse set of images. In this paper, we propose a video generation method based on diffusion models, where the effects of motion are modeled in…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Kangfu Mei , Vishal M. Patel

We present FreeMorph, the first tuning-free method for image morphing that accommodates inputs with different semantics or layouts. Unlike existing methods that rely on finetuning pre-trained diffusion models and are limited by time…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Yukang Cao , Chenyang Si , Jinghao Wang , Ziwei Liu

Accurate prediction of human or vehicle trajectories with good diversity that captures their stochastic nature is an essential task for many applications. However, many trajectory prediction models produce unreasonable trajectory samples…

计算机视觉与模式识别 · 计算机科学 2025-02-10 Qingze , Liu , Danrui Li , Samuel S. Sohn , Sejong Yoon , Mubbasir Kapadia , Vladimir Pavlovic

Recently, conditional diffusion models have gained popularity in numerous applications due to their exceptional generation ability. However, many existing methods are training-required. They need to train a time-dependent classifier or a…

计算机视觉与模式识别 · 计算机科学 2023-03-20 Jiwen Yu , Yinhuai Wang , Chen Zhao , Bernard Ghanem , Jian Zhang

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Stable Diffusion has advanced text-to-image synthesis, but training models to generate images with accurate object quantity is still difficult due to the high computational cost and the challenge of teaching models the abstract concept of…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Yanyu Li , Pencheng Wan , Liang Han , Yaowei Wang , Liqiang Nie , Min Zhang

Text-driven image and video diffusion models have recently achieved unprecedented generation realism. While diffusion models have been successfully applied for image editing, very few works have done so for video editing. We present the…

计算机视觉与模式识别 · 计算机科学 2023-02-03 Eyal Molad , Eliahu Horwitz , Dani Valevski , Alex Rav Acha , Yossi Matias , Yael Pritch , Yaniv Leviathan , Yedid Hoshen

Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a…

机器学习 · 计算机科学 2024-04-12 Tianshuo Xu , Peng Mi , Ruilin Wang , Yingcong Chen

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

机器学习 · 计算机科学 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

While recent foundational video generators produce visually rich output, they still struggle with appearance drift, where objects gradually degrade or change inconsistently across frames, breaking visual coherence. We hypothesize that this…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Hyeonho Jeong , Chun-Hao Paul Huang , Jong Chul Ye , Niloy Mitra , Duygu Ceylan

User mobility modeling serves a crucial role in analysis and optimization of contemporary wireless networks. Typical stochastic mobility models, e.g., random waypoint model and Gauss Markov model, can hardly capture the distribution…

人工智能 · 计算机科学 2024-07-30 Zhenyu Tao , Wei Xu , Xiaohu You