English
Related papers

Related papers: Conditional Video Generation Using Action-Appearan…

200 papers

Human video motion transfer has a wide range of applications in multimedia, computer vision and graphics. Recently, due to the rapid development of Generative Adversarial Networks (GANs), there has been significant progress in the field.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Dongxu Wei , Xiaowei Xu , Haibin Shen , Kejie Huang

This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hongyuan Yu , Yan Huang , Lihong Pi , Liang Wang

Conditional image generation is effective for diverse tasks including training data synthesis for learning-based computer vision. However, despite the recent advances in generative adversarial networks (GANs), it is still a challenging task…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yutaro Miyauchi , Yusuke Sugano , Yasuyuki Matsushita

Generating images with conditional descriptions gains increasing interests in recent years. However, existing conditional inputs are suffering from either unstructured forms (captions) or limited information and expensive labeling (scene…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Tao Ma , Yikang Li

Due to the emergence of Generative Adversarial Networks, video synthesis has witnessed exceptional breakthroughs. However, existing methods lack a proper representation to explicitly control the dynamics in videos. Human pose, on the other…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Ceyuan Yang , Zhe Wang , Xinge Zhu , Chen Huang , Jianping Shi , Dahua Lin

Human motion synthesis conditioned on textual input has gained significant attention in recent years due to its potential applications in various domains such as gaming, film production, and virtual reality. Conditioned Motion synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Avinash Amballa , Gayathri Akkinapalli , Vinitra Muralikrishnan

Learning to represent and generate videos from unlabeled data is a very challenging problem. To generate realistic videos, it is important not only to ensure that the appearance of each frame is real, but also to ensure the plausibility of…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Katsunori Ohnishi , Shohei Yamamoto , Yoshitaka Ushiku , Tatsuya Harada

Text to Image Synthesis refers to the process of automatic generation of a photo-realistic image starting from a given text and is revolutionizing many real-world applications. In order to perform such process it is necessary to exploit…

Machine Learning · Computer Science 2019-10-10 Marco Menardi , Alex Falcon , Saida S. Mohamed , Lorenzo Seidenari , Giuseppe Serra , Alberto Del Bimbo , Carlo Tasso

Recently, generative adversarial networks (GAN) have gathered a lot of interest. Their efficiency in generating unseen samples of high quality, especially images, has improved over the years. In the field of Natural Language Generation…

Computation and Language · Computer Science 2019-11-01 Jean-Benoit Delbrouck , Bastien Vanderplaetse , Stéphane Dupont

The application of video captioning models aims at translating the content of videos by using accurate natural language. Due to the complex nature inbetween object interaction in the video, the comprehensive understanding of spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yutao Jin , Bin Liu , Jing Wang

Generative Adversarial Networks (GANs) have shown remarkable successes in generating realistic images and interpolating changes between images. Existing models, however, do not take into account physical contexts behind images in generating…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Hayato Futase , Tomoki Tsujimura , Tetsuya Kajimoto , Hajime Kawarazaki , Toshiyuki Suzuki , Makoto Miwa , Yutaka Sasaki

We study how to generate captions that are not only accurate in describing an image but also discriminative across different images. The problem is both fundamental and interesting, as most machine-generated captions, despite phenomenal…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Dianqi Li , Qiuyuan Huang , Xiaodong He , Lei Zhang , Ming-Ting Sun

Recent works have successfully extended large-scale text-to-image models to the video domain, producing promising results but at a high computational cost and requiring a large amount of video data. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Bo Peng , Xinyuan Chen , Yaohui Wang , Chaochao Lu , Yu Qiao

Future frame prediction in videos is a promising avenue for unsupervised video representation learning. Video frames are naturally generated by the inherent pixel flows from preceding frames based on the appearance and motion dynamics in…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Xiaodan Liang , Lisa Lee , Wei Dai , Eric P. Xing

Generative models that can model and predict sequences of future events can, in principle, learn to capture complex real-world phenomena, such as physical interactions. However, a central challenge in video prediction is that the future is…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Manoj Kumar , Mohammad Babaeizadeh , Dumitru Erhan , Chelsea Finn , Sergey Levine , Laurent Dinh , Durk Kingma

In this paper, we aim to improve the state-of-the-art video generative adversarial networks (GANs) with a view towards multi-functional applications. Our improved video GAN model does not separate foreground from background nor dynamic from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Bernhard Kratzwald , Zhiwu Huang , Danda Pani Paudel , Acharya Dinesh , Luc Van Gool

In this paper, we propose Dynamics Transfer GAN; a new method for generating video sequences based on generative adversarial learning. The spatial constructs of a generated video sequence are acquired from the target image. The dynamics of…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Wissam J. Baddar , Geonmo Gu , Sangmin Lee , Yong Man Ro

Video generation is an interesting problem in computer vision. It is quite popular for data augmentation, special effect in move, AR/VR and so on. With the advances of deep learning, many deep generative models have been proposed to solve…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Tingfung Lau , Sailun Xu , Xinze Wang

Technological developments have produced methods that can generate educational videos from input text or sound. Recently, the use of deep learning techniques for image and video generation has been widely explored, particularly in…

Multimedia · Computer Science 2026-01-27 M. E. ElAlami , S. M. Khater , M. El. R. Rehan

In recent years, Generative Adversarial Networks (GANs) have seen significant advancements, leading to their widespread adoption across various fields. The original GAN architecture enables the generation of images without any specific…

Machine Learning · Computer Science 2024-09-04 Anis Bourou , Valérie Mezger , Auguste Genovesio