English
Related papers

Related papers: Hierarchical Patch VAE-GAN: Generating Diverse Vid…

200 papers

We present a new method for improving the performances of variational autoencoder (VAE). In addition to enforcing the deep feature consistent principle thus ensuring the VAE output and its corresponding input images to have similar deep…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Xianxu Hou , Ke Sun , Linlin Shen , Guoping Qiu

Given an incomplete image without additional constraint, image inpainting natively allows for multiple solutions as long as they appear plausible. Recently, multiplesolution inpainting methods have been proposed and shown the potential of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Jialun Peng , Dong Liu , Songcen Xu , Houqiang Li

Variational Autoencoder (VAE) and its variations are classic generative models by learning a low-dimensional latent representation to satisfy some prior distribution (e.g., Gaussian distribution). Their advantages over GAN are that they can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Cong Geng , Jia Wang , Li Chen , Zhiyong Gao

In this paper, we propose a generative model, Temporal Generative Adversarial Nets (TGAN), which can learn a semantic representation of unlabeled videos, and is capable of generating videos. Unlike existing Generative Adversarial Nets…

Machine Learning · Computer Science 2017-08-21 Masaki Saito , Eiichi Matsumoto , Shunta Saito

Variational Autoencoders (VAEs) provide a theoretically-backed and popular framework for deep generative models. However, learning a VAE from data poses still unanswered theoretical questions and considerable practical challenges. In this…

Machine Learning · Computer Science 2020-06-01 Partha Ghosh , Mehdi S. M. Sajjadi , Antonio Vergari , Michael Black , Bernhard Schölkopf

Generative deep neural networks used in machine learning, like the Variational Auto-Encoders (VAE), and Generative Adversarial Networks (GANs) produce new objects each time when asked to do so with the constraint that the new objects remain…

Machine Learning · Statistics 2023-03-15 Gabriel Turinici

Colorization is an ambiguous problem, with multiple viable colorizations for a single grey-level image. However, previous methods only produce the single most probable colorization. Our goal is to model the diversity intrinsic to the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-28 Aditya Deshpande , Jiajun Lu , Mao-Chuang Yeh , Min Jin Chong , David Forsyth

High-resolution video generation has emerged as a crucial task in computer vision, with wide-ranging applications in entertainment, simulation, and data augmentation. However, generating temporally coherent and visually realistic videos…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Abhinav Sagar

Recent years witness the tremendous success of generative adversarial networks (GANs) in synthesizing photo-realistic images. GAN generator learns to compose realistic images and reproduce the real data distribution. Through that, a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Yinghao Xu , Yujun Shen , Jiapeng Zhu , Ceyuan Yang , Bolei Zhou

We present VideoGPT: a conceptually simple architecture for scaling likelihood based generative modeling to natural videos. VideoGPT uses VQ-VAE that learns downsampled discrete latent representations of a raw video by employing 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Wilson Yan , Yunzhi Zhang , Pieter Abbeel , Aravind Srinivas

Endoscopic videos from multicentres often have different imaging conditions, e.g., color and illumination, which make the models trained on one domain usually fail to generalize well to another. Domain adaptation is one of the potential…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Jiawei Chen , Yuexiang Li , Kai Ma , Yefeng Zheng

This paper addresses a challenging problem -- how to generate multi-view cloth images from only a single view input. To generate realistic-looking images with different views from the input, we propose a new image generation model termed…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Bo Zhao , Xiao Wu , Zhi-Qi Cheng , Hao Liu , Zequn Jie , Jiashi Feng

We present a VAE architecture for encoding and generating high dimensional sequential data, such as video or audio. Our deep generative model learns a latent representation of the data which is split into a static and dynamic part, allowing…

Machine Learning · Computer Science 2018-06-13 Yingzhen Li , Stephan Mandt

Existing controllable video generation methods are typically designed for rigid, task-specific settings, such as first-frame image-to-video, inpainting, or interpolation, treating spatio-temporal control as a set of isolated problems. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Minghong Cai , Qiulin Wang , Zongli Ye , Wenze Liu , Quande Liu , Weicai Ye , Xintao Wang , Pengfei Wan , Kun Gai , Xiangyu Yue

Current approaches in video forecasting attempt to generate videos directly in pixel space using Generative Adversarial Networks (GANs) or Variational Autoencoders (VAEs). However, since these approaches try to model all the structure and…

Computer Vision and Pattern Recognition · Computer Science 2017-05-02 Jacob Walker , Kenneth Marino , Abhinav Gupta , Martial Hebert

Single image generative models perform synthesis and manipulation tasks by capturing the distribution of patches within a single image. The classical (pre Deep Learning) prevailing approaches for these tasks are based on an optimization…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Niv Granot , Ben Feinstein , Assaf Shocher , Shai Bagon , Michal Irani

Deep generative models have achieved impressive success in recent years. Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), as emerging families for generative model learning, have largely been considered as two…

Machine Learning · Computer Science 2018-07-12 Zhiting Hu , Zichao Yang , Ruslan Salakhutdinov , Eric P. Xing

Recently, probabilistic predictive coding that directly models the conditional distribution of latent features across successive frames for temporal redundancy removal has yielded promising results. Existing methods using a single-scale…

Image and Video Processing · Electrical Eng. & Systems 2023-12-13 Ming Lu , Zhihao Duan , Fengqing Zhu , Zhan Ma

Variational Convertor-Encoder (VCE) converts an image to various styles; we present this novel architecture for the problem of one-shot generalization and its transfer to new tasks not seen before without additional training. We also…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Chengshuai Li , Shuai Han , Jianping Xing

Recent work in synthetic data generation in the time-series domain has focused on the use of Generative Adversarial Networks. We propose a novel architecture for synthetically generating time-series data with the use of Variational…

Machine Learning · Computer Science 2021-12-08 Abhyuday Desai , Cynthia Freeman , Zuhui Wang , Ian Beaver