English
Related papers

Related papers: Diverse Video Generation from a Single Video

200 papers

Unconditional video generation is a challenging task that involves synthesizing high-quality videos that are both coherent and of extended duration. To address this challenge, researchers have used pretrained StyleGAN image generators for…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Yuhan Wang , Liming Jiang , Chen Change Loy

In this work, we focus on a challenging task: synthesizing multiple imaginary videos given a single image. Major problems come from high dimensionality of pixel space and the ambiguity of potential motions. To overcome those problems, we…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Baoyang Chen , Wenmin Wang , Jinzhuo Wang , Xiongtao Chen

In this paper, we propose a style-based conditional video generative model. We introduce a novel temporal generator based on a set of learned sinusoidal bases. Our method learns dynamic representations of various actions that are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Sandeep Manandhar , Auguste Genovesio

Generating videos from text has proven to be a significant challenge for existing generative models. We tackle this problem by training a conditional generative model to extract both static and dynamic information from text. This is…

Multimedia · Computer Science 2017-10-03 Yitong Li , Martin Renqiang Min , Dinghan Shen , David Carlson , Lawrence Carin

Generative models of natural images have progressed towards high fidelity samples by the strong leveraging of scale. We attempt to carry this success to the field of video modeling by showing that large Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Aidan Clark , Jeff Donahue , Karen Simonyan

Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Yiran Xu , Badour AlBahar , Jia-Bin Huang

Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life, and full body generation typically does not deal with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yue Wu , Sicheng Xu , Jianfeng Xiang , Fangyun Wei , Qifeng Chen , Jiaolong Yang , Xin Tong

Camera-controlled video generation has achieved remarkable progress in recent years. However, existing video-to-video re-rendering methods primarily rely on Supervised Fine-Tuning using synthetic datasets. At present, there is an extreme…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zizun Li , Haoyu Guo , Runzhe Teng , Chunhua Shen , Tong He

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou

Recent work has shown significant progress in the direction of synthetic data generation using Generative Adversarial Networks (GANs). GANs have been applied in many fields of computer vision including text-to-image conversion, domain…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Mkhuseli Ngxande , Jules-Raymond Tapamo , Michael Burke

We present a novel unconditional video generative model designed to address long-term spatial and temporal dependencies, with attention to computational and dataset efficiency. To capture long spatio-temporal dependencies, our approach…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Partha Ghosh , Soubhik Sanyal , Cordelia Schmid , Bernhard Schölkopf

This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hongyuan Yu , Yan Huang , Lihong Pi , Liang Wang

A class of recent approaches for generating images, called Generative Adversarial Networks (GAN), have been used to generate impressively realistic images of objects, bedrooms, handwritten digits and a variety of other image modalities.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Swaminathan Gurumurthy , Ravi Kiran Sarvadevabhatla , Venkatesh Babu Radhakrishnan

There is an urgent need for an effective video classification method by means of a small number of samples. The deficiency of samples could be effectively alleviated by generating samples through Generative Adversarial Networks (GAN), but…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Yumeng Zhang , Gaoguo Jia , Li Chen , Mingrui Zhang , Junhai Yong

The field of video generation has expanded significantly in recent years, with controllable and compositional video generation garnering considerable interest. Most methods rely on leveraging annotations such as text, objects' bounding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Aram Davtyan , Sepehr Sameni , Björn Ommer , Paolo Favaro

Generating future frames given a few context (or past) frames is a challenging task. It requires modeling the temporal coherence of videos and multi-modality in terms of diversity in the potential future states. Current variational…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Gaurav Shrivastava , Abhinav Shrivastava

The generative adversarial network (GAN) framework has emerged as a powerful tool for various image and video synthesis tasks, allowing the synthesis of visual content in an unconditional or input-conditional manner. It has enabled the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Ming-Yu Liu , Xun Huang , Jiahui Yu , Ting-Chun Wang , Arun Mallya

The extension of image generation to video generation turns out to be a very difficult task, since the temporal dimension of videos introduces an extra challenge during the generation process. Besides, due to the limitation of memory and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Dinesh Acharya , Zhiwu Huang , Danda Pani Paudel , Luc Van Gool

Although humans have the innate ability to imagine multiple possible actions from videos, it remains an extraordinary challenge for computers due to the intricate camera movements and montages. Most existing motion generation methods…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Liangdong Qiu , Chengxing Yu , Yanran Li , Zhao Wang , Haibin Huang , Chongyang Ma , Di Zhang , Pengfei Wan , Xiaoguang Han

We introduce Vid-CamEdit, a novel framework for video camera trajectory editing, enabling the re-synthesis of monocular videos along user-defined camera paths. This task is challenging due to its ill-posed nature and the limited multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Junyoung Seo , Jisang Han , Jaewoo Jung , Siyoon Jin , Joungbin Lee , Takuya Narihira , Kazumi Fukuda , Takashi Shibuya , Donghoon Ahn , Shoukang Hu , Seungryong Kim , Yuki Mitsufuji