English
Related papers

Related papers: Conditional MoCoGAN for Zero-Shot Video Generation

200 papers

Generative Adversarial Networks (GAN) have shown great promise in tasks like synthetic image generation, image inpainting, style transfer, and anomaly detection. However, generating discrete data is a challenge. This work presents an…

Machine Learning · Computer Science 2018-04-04 Shreyas Patel , Ashutosh Kakadiya , Maitrey Mehta , Raj Derasari , Rahul Patel , Ratnik Gandhi

The field of automatic video generation has received a boost thanks to the recent Generative Adversarial Networks (GANs). However, most existing methods cannot control the contents of the generated video using a text caption, losing their…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Shohei Yamamoto , Antonio Tejero-de-Pablos , Yoshitaka Ushiku , Tatsuya Harada

We propose a video compression framework using conditional Generative Adversarial Networks (GANs). We rely on two encoders: one that deploys a standard video codec and another which generates low-level maps via a pipeline of down-sampling,…

Image and Video Processing · Electrical Eng. & Systems 2018-11-28 Sungsoo Kim , Jin Soo Park , Christos G. Bampis , Jaeseong Lee , Mia K. Markey , Alexandros G. Dimakis , Alan C. Bovik

We propose a novel conditional GAN (cGAN) model for continuous fine-grained human action segmentation, that utilises multi-modal data and learned scene context information. The proposed approach utilises two GANs: termed Action GAN and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Harshala Gammulle , Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Generative image models have been extensively studied in recent years. In the unconditional setting, they model the marginal distribution from unlabelled images. To allow for more control, image synthesis can be conditioned on semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Marlène Careil , Stéphane Lathuilière , Camille Couprie , Jakob Verbeek

This work proposes the continuous conditional generative adversarial network (CcGAN), the first generative model for image generation conditional on continuous, scalar conditions (termed regression labels). Existing conditional GANs (cGANs)…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Xin Ding , Yongwei Wang , Zuheng Xu , William J. Welch , Z. Jane Wang

When trained on multimodal image datasets, normal Generative Adversarial Networks (GANs) are usually outperformed by class-conditional GANs and ensemble GANs, but conditional GANs is restricted to labeled datasets and ensemble GANs lack…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Haifeng Shi , Guanyu Cai , Yuqin Wang , Shaohua Shang , Lianghua He

When robots work in a cluttered environment, the constraints for motions change frequently and the required action can change even for the same task. However, planning complex motions from direct calculation has the risk of resulting in…

Robotics · Computer Science 2019-10-09 Kyo Kutsuzawa , Hitoshi Kusano , Ayaka Kume , Shoichiro Yamaguchi

This paper studies the problem of generalized zero-shot learning which requires the model to train on image-label pairs from some seen classes and test on the task of classifying new images from both seen and unseen classes. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 He Huang , Changhu Wang , Philip S. Yu , Chang-Dong Wang

We present a meta-learning based generative model for zero-shot learning (ZSL) towards a challenging setting when the number of training examples from each \emph{seen} class is very few. This setup contrasts with the conventional ZSL…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Vinay Kumar Verma , Ashish Mishra , Anubha Pandey , Hema A. Murthy , Piyush Rai

Advances in technology have led to the development of methods that can create desired visual multimedia. In particular, image generation using deep learning has been extensively studied across diverse fields. In comparison, video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Doyeon Kim , Donggyu Joo , Junmo Kim

In recent years, diffusion models have gained popularity for their ability to generate higher-quality images in comparison to GAN models. However, like any other large generative models, these models require a huge amount of data,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Rajesh Shrestha , Bowen Xie

Multi-view frame reconstruction is an important problem particularly when multiple frames are missing and past and future frames within the camera are far apart from the missing ones. Realistic coherent frames can still be reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Tahmida Mahmud , Mohammad Billah , Amit K. Roy-Chowdhury

Zero-shot learning (ZSL) is commonly used to address the very pervasive problem of predicting unseen classes in fine-grained image classification and other tasks. One family of solutions is to learn synthesised unseen visual samples…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Zhi Chen , Sen Wang , Jingjing Li , Zi Huang

Generative Adversarial Networks (GANs) can generate near photo realistic images in narrow domains such as human faces. Yet, modeling complex distributions of datasets such as ImageNet and COCO-Stuff remains challenging in unconditional…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Arantxa Casanova , Marlène Careil , Jakob Verbeek , Michal Drozdzal , Adriana Romero-Soriano

This work introduces a novel system for the generation of images that contain multiple classes of objects. Recent work in Generative Adversarial Networks have produced high quality images, but many focus on generating images of a single…

Machine Learning · Computer Science 2019-11-11 Elijah D. Bolluyt , Cristina Comaniciu

Class-conditioning offers a direct means to control a Generative Adversarial Network (GAN) based on a discrete input variable. While necessary in many applications, the additional information provided by the class labels could even be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Mohamad Shahbazi , Martin Danelljan , Danda Pani Paudel , Luc Van Gool

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

Adversarial examples are typically constructed by perturbing an existing data point within a small matrix norm, and current defense methods are focused on guarding against this type of attack. In this paper, we propose unrestricted…

Machine Learning · Computer Science 2018-12-04 Yang Song , Rui Shu , Nate Kushman , Stefano Ermon

While generative adversarial networks (GANs) have revolutionized machine learning, a number of open questions remain to fully understand them and exploit their power. One of these questions is how to efficiently achieve proper diversity and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ze Wang , Xiuyuan Cheng , Guillermo Sapiro , Qiang Qiu