English
Related papers

Related papers: Learning to Generate Time-Lapse Videos Using Multi…

200 papers

Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation…

Atmospheric and Oceanic Physics · Physics 2022-11-09 Lucy Harris , Andrew T. T. McRae , Matthew Chantry , Peter D. Dueben , Tim N. Palmer

Current generative frameworks use end-to-end learning and generate images by sampling from uniform noise distribution. However, these approaches ignore the most basic principle of image formation: images are product of: (a) Structure: the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Xiaolong Wang , Abhinav Gupta

We focus on the problem of novel-view human action synthesis. Given an action video, the goal is to generate the same action from an unseen viewpoint. Naturally, novel view video synthesis is more challenging than image synthesis. It…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xianhang Li , Junhao Zhang , Kunchang Li , Shruti Vyas , Yogesh S Rawat

While Generative Adversarial Networks (GANs) are fundamental to many generative modelling applications, they suffer from numerous issues. In this work, we propose a principled framework to simultaneously mitigate two fundamental issues in…

Machine Learning · Computer Science 2020-11-24 Kwot Sin Lee , Ngoc-Trung Tran , Ngai-Man Cheung

Generative adversarial networks (GANs) have been recently adopted for super-resolution, an application closely related to what is referred to as "downscaling" in the atmospheric sciences: improving the spatial resolution of low-resolution…

Image and Video Processing · Electrical Eng. & Systems 2021-11-12 Jussi Leinonen , Daniele Nerini , Alexis Berne

Generating video frames that accurately predict future world states is challenging. Existing approaches either fail to capture the full distribution of outcomes, or yield blurry generations, or both. In this paper we introduce an…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Remi Denton , Rob Fergus

We propose a video compression framework using conditional Generative Adversarial Networks (GANs). We rely on two encoders: one that deploys a standard video codec and another which generates low-level maps via a pipeline of down-sampling,…

Image and Video Processing · Electrical Eng. & Systems 2018-11-28 Sungsoo Kim , Jin Soo Park , Christos G. Bampis , Jaeseong Lee , Mia K. Markey , Alexandros G. Dimakis , Alan C. Bovik

Although Generative Adversarial Networks have shown remarkable performance in image generation, there are some challenges in image realism and convergence speed. The results of some models display the imbalances of quality within a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Ying Liu , Wenhong Cai , Xiaohui Yuan , Jinhai Xiang

We applied Generative Adversarial Networks (GANs) to learn a model of DOOM levels from human-designed content. Initially, we analysed the levels and extracted several topological features. Then, for each level, we extracted a set of images…

Machine Learning · Computer Science 2026-04-16 Edoardo Giacomello , Pier Luca Lanzi , Daniele Loiacono

Generative Adversarial Networks have been crucial in the developments made in unsupervised learning in recent times. Exemplars of image synthesis from text or other images, these networks have shown remarkable improvements over conventional…

Machine Learning · Computer Science 2019-09-02 Rohan Akut , Sumukh Marathe , Rucha Apte , Ishan Joshi , Siddhivinayak Kulkarni

A class of recent approaches for generating images, called Generative Adversarial Networks (GAN), have been used to generate impressively realistic images of objects, bedrooms, handwritten digits and a variety of other image modalities.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Swaminathan Gurumurthy , Ravi Kiran Sarvadevabhatla , Venkatesh Babu Radhakrishnan

Generative Adversarial Networks (GANs) are a powerful framework for deep generative modeling. Posed as a two-player minimax problem, GANs are typically trained end-to-end on real-valued data and can be used to train a generator of…

Machine Learning · Statistics 2017-11-15 Anirudh Goyal , Nan Rosemary Ke , Alex Lamb , R Devon Hjelm , Chris Pal , Joelle Pineau , Yoshua Bengio

Fast and accurate simulations of the non-linear evolution of the cosmic density field are a major component of many cosmological analyses, but the computational time and storage required to run them can be exceedingly large. For this…

Cosmology and Nongalactic Astrophysics · Physics 2020-11-17 Richard M. Feder , Philippe Berger , George Stein

Depth perception is a key component for autonomous systems that interact in the real world, such as delivery robots, warehouse robots, and self-driving cars. Tasks in autonomous robotics such as 3D object recognition, simultaneous…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Miguel Alonso

Generative adversarial networks (GANs) synthesize realistic images from a random latent vector. While many studies have explored various training configurations and architectures for GANs, the problem of inverting a generative model to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Nicky Bayat , Vahid Reza Khazaie , Yalda Mohsenzadeh

The development of sophisticated models for video-to-video synthesis has been facilitated by recent advances in deep reinforcement learning and generative adversarial networks (GANs). In this paper, we propose RL-V2V-GAN, a new deep neural…

Machine Learning · Computer Science 2024-10-29 Yintai Ma , Diego Klabjan , Jean Utke

The ability to generate synthetic medical images is useful for data augmentation, domain transfer, and out-of-distribution detection. However, generating realistic, high-resolution medical images is challenging, particularly for Full Field…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Dimitrios Korkinof , Tobias Rijken , Michael O'Neill , Joseph Yearsley , Hugh Harvey , Ben Glocker

Astronomy of the 21st century increasingly finds itself with extreme quantities of data. This growth in data is ripe for modern technologies such as deep image processing, which has the potential to allow astronomers to automatically…

Instrumentation and Methods for Astrophysics · Physics 2019-03-19 Levi Fussell , Ben Moews

When robots work in a cluttered environment, the constraints for motions change frequently and the required action can change even for the same task. However, planning complex motions from direct calculation has the risk of resulting in…

Robotics · Computer Science 2019-10-09 Kyo Kutsuzawa , Hitoshi Kusano , Ayaka Kume , Shoichiro Yamaguchi

Generative adversarial networks (GANs) are among the most successful models for learning high-complexity, real-world distributions. However, in theory, due to the highly non-convex, non-concave landscape of the minmax training objective,…

Machine Learning · Computer Science 2023-04-04 Zeyuan Allen-Zhu , Yuanzhi Li