中文
相关论文

相关论文: AnimateLCM: Computation-Efficient Personalized Sty…

200 篇论文

Diffusion-based video generation can create realistic videos, yet existing image- and text-based conditioning fails to offer precise motion control. Prior methods for motion-conditioned synthesis typically require model-specific…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Assaf Singer , Noam Rotstein , Amir Mann , Ron Kimmel , Or Litany

Diffusion probabilistic models have shown significant progress in video generation; however, their computational efficiency is limited by the large number of sampling steps required. Reducing sampling steps often compromises video quality…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Zihan Ding , Chi Jin , Difan Liu , Haitian Zheng , Krishna Kumar Singh , Qiang Zhang , Yan Kang , Zhe Lin , Yuchen Liu

Recent advances in the diffusion models have significantly improved text-to-image generation. However, generating videos from text is a more challenging task than generating images from text, due to the much larger dataset and higher…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Taegyeong Lee , Soyeong Kwon , Taehwan Kim

Training of Generative Adversarial Network (GAN) on a video dataset is a challenge because of the sheer size of the dataset and the complexity of each observation. In general, the computational cost of training GAN scales exponentially with…

计算机视觉与模式识别 · 计算机科学 2020-06-02 Masaki Saito , Shunta Saito , Masanori Koyama , Sosuke Kobayashi

We present Paris 2.0, the first video generation model pre-trained through decentralized computation. Its training recipe builds upon Paris 1.0 (arXiv:2510.03434), the first ever open-weight Decentralized Diffusion Model (DDM), which showed…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Ali Rouzbayani , Bidhan Roy , Marcos Villagra , Zhiying Jiang

Training-free perceptual image codec adopt pre-trained unconditional generative model during decoding to avoid training new conditional generative model. However, they heavily rely on diffusion inversion or sample communication, which take…

图像与视频处理 · 电气工程与系统科学 2025-06-23 Ziran Zhu , Tongda Xu , Minye Huang , Dailan He , Xingtong Ge , Xinjie Zhang , Ling Li , Yan Wang

We introduce LTX-Video, a transformer-based latent diffusion model that adopts a holistic approach to video generation by seamlessly integrating the responsibilities of the Video-VAE and the denoising transformer. Unlike existing methods,…

Estimating video depth in open-world scenarios is challenging due to the diversity of videos in appearance, content motion, camera movement, and length. We present DepthCrafter, an innovative method for generating temporally consistent long…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Wenbo Hu , Xiangjun Gao , Xiaoyu Li , Sijie Zhao , Xiaodong Cun , Yong Zhang , Long Quan , Ying Shan

GANs are able to perform generation and manipulation tasks, trained on a single video. However, these single video GANs require unreasonable amount of time to train on a single video, rendering them almost impractical. In this paper we…

计算机视觉与模式识别 · 计算机科学 2022-05-13 Niv Haim , Ben Feinstein , Niv Granot , Assaf Shocher , Shai Bagon , Tali Dekel , Michal Irani

In this paper, we present \textbf{\textit{FasterCache}}, a novel training-free strategy designed to accelerate the inference of video diffusion models with high-quality generation. By analyzing existing cache-based methods, we observe that…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Zhengyao Lv , Chenyang Si , Junhao Song , Zhenyu Yang , Yu Qiao , Ziwei Liu , Kwan-Yee K. Wong

We tackle the long video generation problem, i.e.~generating videos beyond the output length of video generation models. Due to the computation resource constraints, video generation models can only generate video clips that are relatively…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hsin-Ping Huang , Yu-Chuan Su , Ming-Hsuan Yang

Modern video generative models based on diffusion models can produce very realistic clips, but they are computationally inefficient, often requiring minutes of GPU time for just a few seconds of video. This inefficiency poses a critical…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Jieying Chen , Jeffrey Hu , Joan Lasenby , Ayush Tewari

We present a training-free framework for style-personalized image generation that operates during inference using a scale-wise autoregressive model. Our method generates a stylized image guided by a single reference style while preserving…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Kyoungmin Lee , Jihun Park , Jongmin Gim , Wonhyeok Choi , Kyumin Hwang , Jaeyeul Kim , Sunghoon Im

Distilled video generation models offer fast and efficient synthesis but struggle with motion customization when guided by reference videos, especially under training-free settings. Existing training-free methods, originally designed for…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Jintao Rong , Xin Xie , Xinyi Yu , Linlin Ou , Xinyu Zhang , Chunhua Shen , Dong Gong

Diffusion-based models have gained wide adoption in the virtual human generation due to their outstanding expressiveness. However, their substantial computational requirements have constrained their deployment in real-time interactive…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Haojie Yu , Zhaonian Wang , Yihan Pan , Meng Cheng , Hao Yang , Chao Wang , Tao Xie , Xiaoming Xu , Xiaoming Wei , Xunliang Cai

Manually re-drawing an image in a certain artistic style takes a professional artist a long time. Doing this for a video sequence single-handedly is beyond imagination. We present two computational approaches that transfer the style from…

计算机视觉与模式识别 · 计算机科学 2018-08-07 Manuel Ruder , Alexey Dosovitskiy , Thomas Brox

Research on diffusion model-based video generation has advanced rapidly. However, limitations in object fidelity and generation length hinder its practical applications. Additionally, specific domains like animated wallpapers require…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Fanyi Wang , Peng Liu , Haotian Hu , Dan Meng , Jingwen Su , Jinjin Xu , Yanhao Zhang , Xiaoming Ren , Zhiwang Zhang

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial…

计算机视觉与模式识别 · 计算机科学 2022-06-24 Jonathan Ho , Tim Salimans , Alexey Gritsenko , William Chan , Mohammad Norouzi , David J. Fleet

In order to perform unconditional video generation, we must learn the distribution of the real-world videos. In an effort to synthesize high-quality videos, various studies attempted to learn a mapping function between noise and videos,…

计算机视觉与模式识别 · 计算机科学 2021-12-22 Kangyeol Kim , Sunghyun Park , Junsoo Lee , Joonseok Lee , Sookyung Kim , Jaegul Choo , Edward Choi

Text-to-video generation has made remarkable advancements through diffusion models. However, Multi-Concept Video Customization (MCVC) remains a significant challenge. We identify two key challenges for this task: 1) the identity decoupling…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Yuzhou Huang , Ziyang Yuan , Quande Liu , Qiulin Wang , Xintao Wang , Ruimao Zhang , Pengfei Wan , Di Zhang , Kun Gai