English
Related papers

Related papers: AnimateLCM: Computation-Efficient Personalized Sty…

200 papers

Diffusion-based video generation can create realistic videos, yet existing image- and text-based conditioning fails to offer precise motion control. Prior methods for motion-conditioned synthesis typically require model-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Assaf Singer , Noam Rotstein , Amir Mann , Ron Kimmel , Or Litany

Diffusion probabilistic models have shown significant progress in video generation; however, their computational efficiency is limited by the large number of sampling steps required. Reducing sampling steps often compromises video quality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zihan Ding , Chi Jin , Difan Liu , Haitian Zheng , Krishna Kumar Singh , Qiang Zhang , Yan Kang , Zhe Lin , Yuchen Liu

Recent advances in the diffusion models have significantly improved text-to-image generation. However, generating videos from text is a more challenging task than generating images from text, due to the much larger dataset and higher…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Taegyeong Lee , Soyeong Kwon , Taehwan Kim

Training of Generative Adversarial Network (GAN) on a video dataset is a challenge because of the sheer size of the dataset and the complexity of each observation. In general, the computational cost of training GAN scales exponentially with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Masaki Saito , Shunta Saito , Masanori Koyama , Sosuke Kobayashi

We present Paris 2.0, the first video generation model pre-trained through decentralized computation. Its training recipe builds upon Paris 1.0 (arXiv:2510.03434), the first ever open-weight Decentralized Diffusion Model (DDM), which showed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ali Rouzbayani , Bidhan Roy , Marcos Villagra , Zhiying Jiang

Training-free perceptual image codec adopt pre-trained unconditional generative model during decoding to avoid training new conditional generative model. However, they heavily rely on diffusion inversion or sample communication, which take…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Ziran Zhu , Tongda Xu , Minye Huang , Dailan He , Xingtong Ge , Xinjie Zhang , Ling Li , Yan Wang

We introduce LTX-Video, a transformer-based latent diffusion model that adopts a holistic approach to video generation by seamlessly integrating the responsibilities of the Video-VAE and the denoising transformer. Unlike existing methods,…

Estimating video depth in open-world scenarios is challenging due to the diversity of videos in appearance, content motion, camera movement, and length. We present DepthCrafter, an innovative method for generating temporally consistent long…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Wenbo Hu , Xiangjun Gao , Xiaoyu Li , Sijie Zhao , Xiaodong Cun , Yong Zhang , Long Quan , Ying Shan

GANs are able to perform generation and manipulation tasks, trained on a single video. However, these single video GANs require unreasonable amount of time to train on a single video, rendering them almost impractical. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Niv Haim , Ben Feinstein , Niv Granot , Assaf Shocher , Shai Bagon , Tali Dekel , Michal Irani

In this paper, we present \textbf{\textit{FasterCache}}, a novel training-free strategy designed to accelerate the inference of video diffusion models with high-quality generation. By analyzing existing cache-based methods, we observe that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Zhengyao Lv , Chenyang Si , Junhao Song , Zhenyu Yang , Yu Qiao , Ziwei Liu , Kwan-Yee K. Wong

We tackle the long video generation problem, i.e.~generating videos beyond the output length of video generation models. Due to the computation resource constraints, video generation models can only generate video clips that are relatively…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hsin-Ping Huang , Yu-Chuan Su , Ming-Hsuan Yang

Modern video generative models based on diffusion models can produce very realistic clips, but they are computationally inefficient, often requiring minutes of GPU time for just a few seconds of video. This inefficiency poses a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Jieying Chen , Jeffrey Hu , Joan Lasenby , Ayush Tewari

We present a training-free framework for style-personalized image generation that operates during inference using a scale-wise autoregressive model. Our method generates a stylized image guided by a single reference style while preserving…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Kyoungmin Lee , Jihun Park , Jongmin Gim , Wonhyeok Choi , Kyumin Hwang , Jaeyeul Kim , Sunghoon Im

Distilled video generation models offer fast and efficient synthesis but struggle with motion customization when guided by reference videos, especially under training-free settings. Existing training-free methods, originally designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Jintao Rong , Xin Xie , Xinyi Yu , Linlin Ou , Xinyu Zhang , Chunhua Shen , Dong Gong

Diffusion-based models have gained wide adoption in the virtual human generation due to their outstanding expressiveness. However, their substantial computational requirements have constrained their deployment in real-time interactive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Haojie Yu , Zhaonian Wang , Yihan Pan , Meng Cheng , Hao Yang , Chao Wang , Tao Xie , Xiaoming Xu , Xiaoming Wei , Xunliang Cai

Manually re-drawing an image in a certain artistic style takes a professional artist a long time. Doing this for a video sequence single-handedly is beyond imagination. We present two computational approaches that transfer the style from…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Manuel Ruder , Alexey Dosovitskiy , Thomas Brox

Research on diffusion model-based video generation has advanced rapidly. However, limitations in object fidelity and generation length hinder its practical applications. Additionally, specific domains like animated wallpapers require…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Fanyi Wang , Peng Liu , Haotian Hu , Dan Meng , Jingwen Su , Jinjin Xu , Yanhao Zhang , Xiaoming Ren , Zhiwang Zhang

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Jonathan Ho , Tim Salimans , Alexey Gritsenko , William Chan , Mohammad Norouzi , David J. Fleet

In order to perform unconditional video generation, we must learn the distribution of the real-world videos. In an effort to synthesize high-quality videos, various studies attempted to learn a mapping function between noise and videos,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Kangyeol Kim , Sunghyun Park , Junsoo Lee , Joonseok Lee , Sookyung Kim , Jaegul Choo , Edward Choi

Text-to-video generation has made remarkable advancements through diffusion models. However, Multi-Concept Video Customization (MCVC) remains a significant challenge. We identify two key challenges for this task: 1) the identity decoupling…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Yuzhou Huang , Ziyang Yuan , Quande Liu , Qiulin Wang , Xintao Wang , Ruimao Zhang , Pengfei Wan , Di Zhang , Kun Gai