中文
相关论文

相关论文: FreeTraj: Tuning-Free Trajectory Control in Video …

200 篇论文

Recent advancements in diffusion models have greatly improved the quality and diversity of synthesized content. To harness the expressive power of diffusion models, researchers have explored various controllable mechanisms that allow users…

计算机视觉与模式识别 · 计算机科学 2023-04-28 Tsai-Shien Chen , Chieh Hubert Lin , Hung-Yu Tseng , Tsung-Yi Lin , Ming-Hsuan Yang

Creating high-fidelity, coherent long videos is a sought-after aspiration. While recent video diffusion models have shown promising potential, they still grapple with spatiotemporal inconsistencies and high computational resource demands.…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Yongjia Ma , Junlin Chen , Donglin Di , Qi Xie , Lei Fan , Wei Chen , Xiaofei Gou , Na Zhao , Xun Yang

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Latent video diffusion models generate videos by progressively transforming Gaussian noise into realistic samples conditioned on text or visual inputs. However, existing conditioning methods often require additional training and…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Ofir Abramovich , Nadav Z. Cohen , Adi Rosenthal , Ariel Shamir

Recent advances have reformulated diffusion models as deterministic ordinary differential equations (ODEs) through the framework of flow matching, providing a unified formulation for the noise-to-data generative process. Various…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Yan Luo , Henry Huang , Todd Y. Zhou , Mengyu Wang

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

机器学习 · 计算机科学 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

We present a diffusion-based framework for document-centric background generation that achieves foreground preservation and multi-page stylistic consistency through latent-space design rather than explicit constraints. Instead of…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Taewon Kang

Video diffusion models perform well in short-video synthesis, but their training-free extension to long videos often suffers from content drift, temporal inconsistency, and over-smoothed dynamics. Existing methods improve temporal…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Fangda Chen , Shanshan Zhao , Longrong Yang , Chuanfu Xu , Zhigang Luo , Long Lan

Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize both a differentiable…

Leveraging pre-trained conditional diffusion models for video editing without further tuning has gained increasing attention due to its promise in film production, advertising, etc. Yet, seminal works in this line fall short in generation…

计算机视觉与模式识别 · 计算机科学 2024-05-29 Zhenyi Liao , Zhijie Deng

With the increasing popularity of autonomous driving based on the powerful and unified bird's-eye-view (BEV) representation, a demand for high-quality and large-scale multi-view video data with accurate annotation is urgently required.…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Xiaofan Li , Yifu Zhang , Xiaoqing Ye

Zero-shot, training-free, image-based text-to-video generation is an emerging area that aims to generate videos using existing image-based diffusion models. Current methods in this space require specific architectural changes to image…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Diljeet Jagpal , Xi Chen , Vinay P. Namboodiri

Following the advancements in text-guided image generation technology exemplified by Stable Diffusion, video generation is gaining increased attention in the academic community. However, relying solely on text guidance for video generation…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Cong Wang , Jiaxi Gu , Panwen Hu , Haoyu Zhao , Yuanfan Guo , Jianhua Han , Hang Xu , Xiaodan Liang

Distilled video generation models offer fast and efficient synthesis but struggle with motion customization when guided by reference videos, especially under training-free settings. Existing training-free methods, originally designed for…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Jintao Rong , Xin Xie , Xinyi Yu , Linlin Ou , Xinyu Zhang , Chunhua Shen , Dong Gong

Recent advances in video generation models have enabled high-quality short video generation from text prompts. However, extending these models to longer videos remains a significant challenge, primarily due to degraded temporal consistency…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Yu Lu , Yi Yang

Long-range human movement generation remains a central challenge in computer vision and graphics. Generating coherent transitions across semantically distinct motion domains remains largely unexplored. This capability is particularly…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Haichao Wang , Alexander Okupnik , Yuxing Han , Gene Wen , Johannes Schneider , Kyriakos Flouris

Diffusion models show promising generation capability for a variety of data. Despite their high generation quality, the inference for diffusion models is still time-consuming due to the numerous sampling iterations required. To accelerate…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Kexun Zhang , Xianjun Yang , William Yang Wang , Lei Li

Diffusion models are a powerful class of generative models capable of producing high-quality images from pure noise using a simple text prompt. While most methods which introduce additional spatial constraints into the generated images…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Zakaria Patel , Kirill Serkh

Text-to-video diffusion models are notoriously limited in their ability to model temporal aspects such as motion, physics, and dynamic interactions. Existing approaches address this limitation by retraining the model or introducing external…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Ariel Shaulov , Itay Hazan , Lior Wolf , Hila Chefer