中文
相关论文

相关论文: Feature-Conditioned Cascaded Video Diffusion Model…

200 篇论文

Synthetic data generation is a promising solution to address privacy issues with the distribution of sensitive health data. Recently, diffusion models have set new standards for generative models for different data modalities. Also very…

信号处理 · 电气工程与系统科学 2023-06-16 Juan Miguel Lopez Alcaraz , Nils Strodthoff

Image diffusion distillation achieves high-fidelity generation with very few sampling steps. However, applying these techniques directly to video diffusion often results in unsatisfactory frame quality due to the limited visual quality in…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Yuanhao Zhai , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , David Doermann , Junsong Yuan , Lijuan Wang

The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Michal Geyer , Omer Bar-Tal , Shai Bagon , Tali Dekel

Character Animation aims to generating character videos from still images through driving signals. Currently, diffusion models have become the mainstream in visual generation research, owing to their robust generative capabilities. However,…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Li Hu , Xin Gao , Peng Zhang , Ke Sun , Bang Zhang , Liefeng Bo

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

Conditional diffusion models have exhibited superior performance in high-fidelity text-guided visual generation and editing. Nevertheless, prevailing text-guided visual diffusion models primarily focus on incorporating text-visual…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Ling Yang , Zhilong Zhang , Zhaochen Yu , Jingwei Liu , Minkai Xu , Stefano Ermon , Bin Cui

Video diffusion models have recently made great progress in generation quality, but are still limited by the high memory and computational requirements. This is because current video diffusion models often attempt to process…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Sihyun Yu , Weili Nie , De-An Huang , Boyi Li , Jinwoo Shin , Anima Anandkumar

Long video generation remains a challenging and compelling topic in computer vision. Diffusion based models, among the various approaches to video generation, have achieved state of the art quality with their iterative denoising procedures.…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Siyang Zhang , Harry Yang , Ser-Nam Lim

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

计算机视觉与模式识别 · 计算机科学 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

Our study introduces a new image-to-video generator called FashionFlow to generate fashion videos. By utilising a diffusion model, we are able to create short videos from still fashion images. Our approach involves developing and connecting…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Tasin Islam , Alina Miron , XiaoHui Liu , Yongmin Li

Diffusion models have demonstrated remarkable capabilities in text-to-image and text-to-video generation, opening up possibilities for video editing based on textual input. However, the computational cost associated with sequential sampling…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Youyuan Zhang , Xuan Ju , James J. Clark

Score diffusion methods can learn probability densities from samples. The score of the noise-corrupted density is estimated using a deep neural network, which is then used to iteratively transport a Gaussian white noise density to a target…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Zahra Kadkhodaie , Stéphane Mallat , Eero P. Simoncelli

We present a novel approach designed to address the complexities posed by challenging, out-of-distribution data in the single-image depth estimation task. Starting with images that facilitate depth prediction due to the absence of…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Fabio Tosi , Pierluigi Zama Ramirez , Matteo Poggi

The video generation field has witnessed rapid improvements with the introduction of recent diffusion models. While these models have successfully enhanced appearance quality, they still face challenges in generating coherent and natural…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Yaosi Hu , Zhenzhong Chen , Chong Luo

Despite the remarkable progress in deep generative models, synthesizing high-resolution and temporally coherent videos still remains a challenge due to their high-dimensionality and complex temporal dynamics along with large spatial…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Sihyun Yu , Kihyuk Sohn , Subin Kim , Jinwoo Shin

Diffusion models have obtained substantial progress in image-to-video generation. However, in this paper, we find that these models tend to generate videos with less motion than expected. We attribute this to the issue called conditional…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Min Zhao , Hongzhou Zhu , Chendong Xiang , Kaiwen Zheng , Chongxuan Li , Jun Zhu

Current state-of-the-art methods for video inpainting typically rely on optical flow or attention-based approaches to inpaint masked regions by propagating visual information across frames. While such approaches have led to significant…

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

图像与视频处理 · 电气工程与系统科学 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

Text-conditioned image generation has made significant progress in recent years with generative adversarial networks and more recently, diffusion models. While diffusion models conditioned on text prompts have produced impressive and…

计算机视觉与模式识别 · 计算机科学 2023-05-01 Azade Farshad , Yousef Yeganeh , Yu Chi , Chengzhi Shen , Björn Ommer , Nassir Navab

Focus is a cornerstone of photography, yet autofocus systems often fail to capture the intended subject, and users frequently wish to adjust focus after capture. We introduce a novel method for realistic post-capture refocusing using video…

计算机视觉与模式识别 · 计算机科学 2025-12-30 SaiKiran Tedla , Zhoutong Zhang , Xuaner Zhang , Shumian Xin