English
Related papers

Related papers: Neural Video Compression using GANs for Detail Syn…

200 papers

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

Unconditional image generation has recently been dominated by generative adversarial networks (GANs). GAN methods train a generator which regresses images from random noise vectors, as well as a discriminator that attempts to differentiate…

Machine Learning · Computer Science 2018-12-24 Yedid Hoshen , Jitendra Malik

Recent work has shown significant progress in the direction of synthetic data generation using Generative Adversarial Networks (GANs). GANs have been applied in many fields of computer vision including text-to-image conversion, domain…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Mkhuseli Ngxande , Jules-Raymond Tapamo , Michael Burke

The development of sophisticated models for video-to-video synthesis has been facilitated by recent advances in deep reinforcement learning and generative adversarial networks (GANs). In this paper, we propose RL-V2V-GAN, a new deep neural…

Machine Learning · Computer Science 2024-10-29 Yintai Ma , Diego Klabjan , Jean Utke

Generative adversarial networks (GANs) transform latent vectors into visually plausible images. It is generally thought that the original GAN formulation gives no out-of-the-box method to reverse the mapping, projecting images back into…

Machine Learning · Computer Science 2017-02-20 Zachary C. Lipton , Subarna Tripathi

Generative Adversarial Networks (GANs) have received a great deal of attention due in part to recent success in generating original, high-quality samples from visual domains. However, most current methods only allow for users to guide this…

Graphics · Computer Science 2019-04-05 Eric Heim

Generative Adversarial Networks (GANs) are an arrange of two neural networks -- the generator and the discriminator -- that are jointly trained to generate artificial data, such as images, from random inputs. The quality of these generated…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Manel Mateos , Alejandro González , Xavier Sevillano

Endoscopic videos from multicentres often have different imaging conditions, e.g., color and illumination, which make the models trained on one domain usually fail to generalize well to another. Domain adaptation is one of the potential…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Jiawei Chen , Yuexiang Li , Kai Ma , Yefeng Zheng

Video generation has seen remarkable progress thanks to advancements in generative deep learning. However, generating long sequences remains a significant challenge. Generated videos should not only display coherent and continuous movement…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jingbo Yang , Adrian G. Bors

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

Machine Learning · Computer Science 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

Remarkable progress has been achieved in synthesizing photo-realistic images with generative adversarial networks (GANs). Recently, GANs are utilized as the training sample generator when obtaining or storing real training data is expensive…

Machine Learning · Computer Science 2022-12-22 Bo Zhao , Hakan Bilen

Remarkable achievements have been attained with Generative Adversarial Networks (GANs) in image-to-image translation. However, due to a tremendous amount of parameters, state-of-the-art GANs usually suffer from low efficiency and bulky…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Linfeng Zhang , Xin Chen , Xiaobing Tu , Pengfei Wan , Ning Xu , Kaisheng Ma

This work presents an analysis of the discriminators used in Generative Adversarial Networks (GANs) for Video. We show that unconstrained video discriminator architectures induce a loss surface with high curvature which make optimisation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Emmanuel Kahembwe , Subramanian Ramamoorthy

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

Machine Learning · Statistics 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

Generative models of natural images have progressed towards high fidelity samples by the strong leveraging of scale. We attempt to carry this success to the field of video modeling by showing that large Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Aidan Clark , Jeff Donahue , Karen Simonyan

GAN-based image compression schemes have shown remarkable progress lately due to their high perceptual quality at low bit rates. However, there are two main issues, including 1) the reconstructed image perceptual degeneration in color,…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Fanxin Xia , Jian Jin , Lili Meng , Feng Ding , Huaxiang Zhang

The usage of deep generative models for image compression has led to impressive performance gains over classical codecs while neural video compression is still in its infancy. Here, we propose an end-to-end, deep generative modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jun Han , Salvator Lombardo , Christopher Schroers , Stephan Mandt

In this paper, we aim to improve the state-of-the-art video generative adversarial networks (GANs) with a view towards multi-functional applications. Our improved video GAN model does not separate foreground from background nor dynamic from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Bernhard Kratzwald , Zhiwu Huang , Danda Pani Paudel , Acharya Dinesh , Luc Van Gool

Despite Generative Adversarial Networks (GANs) have been widely used in various image-to-image translation tasks, they can be hardly applied on mobile devices due to their heavy computation and storage cost. Traditional network compression…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hanting Chen , Yunhe Wang , Han Shu , Changyuan Wen , Chunjing Xu , Boxin Shi , Chao Xu , Chang Xu