中文
相关论文

相关论文: Diverse Video Generation from a Single Video

200 篇论文

Unconditional video generation is a challenging task that involves synthesizing high-quality videos that are both coherent and of extended duration. To address this challenge, researchers have used pretrained StyleGAN image generators for…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Yuhan Wang , Liming Jiang , Chen Change Loy

In this work, we focus on a challenging task: synthesizing multiple imaginary videos given a single image. Major problems come from high dimensionality of pixel space and the ambiguity of potential motions. To overcome those problems, we…

计算机视觉与模式识别 · 计算机科学 2017-06-16 Baoyang Chen , Wenmin Wang , Jinzhuo Wang , Xiongtao Chen

In this paper, we propose a style-based conditional video generative model. We introduce a novel temporal generator based on a set of learned sinusoidal bases. Our method learns dynamic representations of various actions that are…

计算机视觉与模式识别 · 计算机科学 2023-10-30 Sandeep Manandhar , Auguste Genovesio

Generating videos from text has proven to be a significant challenge for existing generative models. We tackle this problem by training a conditional generative model to extract both static and dynamic information from text. This is…

多媒体 · 计算机科学 2017-10-03 Yitong Li , Martin Renqiang Min , Dinghan Shen , David Carlson , Lawrence Carin

Generative models of natural images have progressed towards high fidelity samples by the strong leveraging of scale. We attempt to carry this success to the field of video modeling by showing that large Generative Adversarial Networks…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Aidan Clark , Jeff Donahue , Karen Simonyan

Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Yiran Xu , Badour AlBahar , Jia-Bin Huang

Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life, and full body generation typically does not deal with…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Yue Wu , Sicheng Xu , Jianfeng Xiang , Fangyun Wei , Qifeng Chen , Jiaolong Yang , Xin Tong

Camera-controlled video generation has achieved remarkable progress in recent years. However, existing video-to-video re-rendering methods primarily rely on Supervised Fine-Tuning using synthetic datasets. At present, there is an extreme…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Zizun Li , Haoyu Guo , Runzhe Teng , Chunhua Shen , Tong He

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou

Recent work has shown significant progress in the direction of synthetic data generation using Generative Adversarial Networks (GANs). GANs have been applied in many fields of computer vision including text-to-image conversion, domain…

计算机视觉与模式识别 · 计算机科学 2019-03-07 Mkhuseli Ngxande , Jules-Raymond Tapamo , Michael Burke

We present a novel unconditional video generative model designed to address long-term spatial and temporal dependencies, with attention to computational and dataset efficiency. To capture long spatio-temporal dependencies, our approach…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Partha Ghosh , Soubhik Sanyal , Cordelia Schmid , Bernhard Schölkopf

This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts. Existing video…

计算机视觉与模式识别 · 计算机科学 2020-08-14 Hongyuan Yu , Yan Huang , Lihong Pi , Liang Wang

A class of recent approaches for generating images, called Generative Adversarial Networks (GAN), have been used to generate impressively realistic images of objects, bedrooms, handwritten digits and a variety of other image modalities.…

计算机视觉与模式识别 · 计算机科学 2017-06-08 Swaminathan Gurumurthy , Ravi Kiran Sarvadevabhatla , Venkatesh Babu Radhakrishnan

There is an urgent need for an effective video classification method by means of a small number of samples. The deficiency of samples could be effectively alleviated by generating samples through Generative Adversarial Networks (GAN), but…

计算机视觉与模式识别 · 计算机科学 2019-10-01 Yumeng Zhang , Gaoguo Jia , Li Chen , Mingrui Zhang , Junhai Yong

The field of video generation has expanded significantly in recent years, with controllable and compositional video generation garnering considerable interest. Most methods rely on leveraging annotations such as text, objects' bounding…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Aram Davtyan , Sepehr Sameni , Björn Ommer , Paolo Favaro

Generating future frames given a few context (or past) frames is a challenging task. It requires modeling the temporal coherence of videos and multi-modality in terms of diversity in the potential future states. Current variational…

计算机视觉与模式识别 · 计算机科学 2021-07-13 Gaurav Shrivastava , Abhinav Shrivastava

The generative adversarial network (GAN) framework has emerged as a powerful tool for various image and video synthesis tasks, allowing the synthesis of visual content in an unconditional or input-conditional manner. It has enabled the…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Ming-Yu Liu , Xun Huang , Jiahui Yu , Ting-Chun Wang , Arun Mallya

The extension of image generation to video generation turns out to be a very difficult task, since the temporal dimension of videos introduces an extra challenge during the generation process. Besides, due to the limitation of memory and…

计算机视觉与模式识别 · 计算机科学 2018-12-07 Dinesh Acharya , Zhiwu Huang , Danda Pani Paudel , Luc Van Gool

Although humans have the innate ability to imagine multiple possible actions from videos, it remains an extraordinary challenge for computers due to the intricate camera movements and montages. Most existing motion generation methods…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Liangdong Qiu , Chengxing Yu , Yanran Li , Zhao Wang , Haibin Huang , Chongyang Ma , Di Zhang , Pengfei Wan , Xiaoguang Han

We introduce Vid-CamEdit, a novel framework for video camera trajectory editing, enabling the re-synthesis of monocular videos along user-defined camera paths. This task is challenging due to its ill-posed nature and the limited multi-view…