English
Related papers

Related papers: Dynamics Transfer GAN: Generating Video by Transfe…

200 papers

Generative adversarial network (GAN) has achieved impressive success on cross-domain generation, but it faces difficulty in cross-modal generation due to the lack of a common distribution between heterogeneous data. Most existing methods of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Wen-Cheng Chen , Chien-Wen Chen , Min-Chun Hu

This study introduces an enhanced approach to video super-resolution by extending ordinary Single-Image Super-Resolution (SISR) Super-Resolution Generative Adversarial Network (SRGAN) structure to handle spatio-temporal data. While SRGAN…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Kağan Çetin , Hacer Akça , Ömer Nezih Gerek

This paper studies the dynamic generator model for spatial-temporal processes such as dynamic textures and action sequences in video data. In this model, each time frame of the video sequence is generated by a generator model, which is a…

Machine Learning · Statistics 2018-12-31 Jianwen Xie , Ruiqi Gao , Zilong Zheng , Song-Chun Zhu , Ying Nian Wu

Taking a photo outside, can we predict the immediate future, e.g., how would the cloud move in the sky? We address this problem by presenting a generative adversarial network (GAN) based two-stage approach to generating realistic time-lapse…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Wei Xiong , Wenhan Luo , Lin Ma , Wei Liu , Jiebo Luo

We present the first neural video compression method based on generative adversarial networks (GANs). Our approach significantly outperforms previous neural and non-neural video compression methods in a user study, setting a new…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Fabian Mentzer , Eirikur Agustsson , Johannes Ballé , David Minnen , Nick Johnston , George Toderici

The extension of image generation to video generation turns out to be a very difficult task, since the temporal dimension of videos introduces an extra challenge during the generation process. Besides, due to the limitation of memory and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Dinesh Acharya , Zhiwu Huang , Danda Pani Paudel , Luc Van Gool

The generative adversarial network (GAN) exhibits great superiority in the face attribute synthesis task. However, existing methods have very limited effects on the expansion of new attributes. To overcome the limitations of a single…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Xin Ning , Shaohui Xu , Xiaoli Dong , Weijun Li , Fangzhe Nan , Yuanzhou Yao

Transferring the knowledge of pretrained networks to new domains by means of finetuning is a widely used practice for applications based on discriminative models. To the best of our knowledge this practice has not been studied within the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Yaxing Wang , Chenshen Wu , Luis Herranz , Joost van de Weijer , Abel Gonzalez-Garcia , Bogdan Raducanu

Generative adversarial networks (GANs) have been successfully applied to transfer visual attributes in many domains, including that of human face images. This success is partly attributable to the facts that human faces have similar shapes…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Lei Luo , William Hsu , Shangxian Wang

Producing realistic character animations is one of the essential tasks in human-AI interactions. Considered as a sequence of poses of a humanoid, the task can be considered as a sequence generation problem with spatiotemporal smoothness and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Maryam Sadat Mirzaei , Kourosh Meshgi , Etienne Frigo , Toyoaki Nishida

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Existing deep learning methods of video recognition usually require a large number of labeled videos for training. But for a new task, videos are often unlabeled and it is also time-consuming and labor-intensive to annotate them. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2018-05-14 Feiwu Yu , Xinxiao Wu , Yuchao Sun , Lixin Duan

Creating realistic human videos entails the challenge of being able to simultaneously generate both appearance, as well as motion. To tackle this challenge, we introduce G$^{3}$AN, a novel spatio-temporal generative model, which seeks to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Yaohui Wang , Piotr Bilinski , Francois Bremond , Antitza Dantcheva

Our work explores temporal self-supervision for GAN-based video generation tasks. While adversarial training successfully yields generative models for a variety of areas, temporal relationships in the generated data are much less explored.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Mengyu Chu , You Xie , Jonas Mayer , Laura Leal-Taixé , Nils Thuerey

Our work offers a new method for domain translation from semantic label maps and Computer Graphic (CG) simulation edge map images to photo-realistic images. We train a Generative Adversarial Network (GAN) in a conditional way to generate a…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Yakov Miron , Yona Coscas

Training GANs in low-data regimes remains a challenge, as overfitting often leads to memorization or training divergence. In this work, we introduce One-Shot GAN that can learn to generate samples from a training set as little as one image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Vadim Sushko , Juergen Gall , Anna Khoreva

Generation of realistic high-resolution videos of human subjects is a challenging and important task in computer vision. In this paper, we focus on human motion transfer - generation of a video depicting a particular subject, observed in a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Polina Zablotskaia , Aliaksandr Siarohin , Bo Zhao , Leonid Sigal

Video generation is an interesting problem in computer vision. It is quite popular for data augmentation, special effect in move, AR/VR and so on. With the advances of deep learning, many deep generative models have been proposed to solve…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Tingfung Lau , Sailun Xu , Xinze Wang

Recent advancements in Generative Adversarial Networks (GANs) enable the generation of highly realistic images, raising concerns about their misuse for malicious purposes. Detecting these GAN-generated images (GAN-images) becomes…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Hyeonseong Jeon , Youngoh Bang , Junyaup Kim , Simon S. Woo

Generative Adversarial Networks (GANs) have shown great performance on super-resolution problems since they can generate more visually realistic images and video frames. However, these models often introduce side effects into the outputs,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Xijun Wang , Santiago López-Tapia , Alice Lucas , Xinyi Wu , Rafael Molina , Aggelos K. Katsaggelos