English
Related papers

Related papers: Learning to Generate Time-Lapse Videos Using Multi…

200 papers

We present a new two-stage pipeline for predicting frames of traffic scenes where relevant objects can still reliably be detected. Using a recent video prediction network, we first generate a sequence of future frames based on past frames.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Peter König , Sandra Aigner , Marco Körner

Current approaches in video forecasting attempt to generate videos directly in pixel space using Generative Adversarial Networks (GANs) or Variational Autoencoders (VAEs). However, since these approaches try to model all the structure and…

Computer Vision and Pattern Recognition · Computer Science 2017-05-02 Jacob Walker , Kenneth Marino , Abhinav Gupta , Martial Hebert

Video generation has seen remarkable progress thanks to advancements in generative deep learning. However, generating long sequences remains a significant challenge. Generated videos should not only display coherent and continuous movement…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jingbo Yang , Adrian G. Bors

Dark matter in the universe evolves through gravity to form a complex network of halos, filaments, sheets and voids, that is known as the cosmic web. Computational models of the underlying physical processes, such as classical N-body…

Cosmology and Nongalactic Astrophysics · Physics 2018-11-30 Andres C. Rodriguez , Tomasz Kacprzak , Aurelien Lucchi , Adam Amara , Raphael Sgier , Janis Fluri , Thomas Hofmann , Alexandre Réfrégier

Generating realistic images is difficult, and many formulations for this task have been proposed recently. If we restrict the task to that of generating a particular class of images, however, the task becomes more tractable. That is to say,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 David Berthelot , Peyman Milanfar , Ian Goodfellow

Generative Adversarial Networks (GANs) are a recent advancement in unsupervised machine learning. They are a cat-and-mouse game between two neural networks: [1] a discriminator network which learns to validate whether a sample is real or…

Cosmology and Nongalactic Astrophysics · Physics 2020-06-23 Olivia Curtis , Tereasa G. Brainerd

We present a video generation model that accurately reproduces object motion, changes in camera viewpoint, and new content that arises over time. Existing video generation methods often fail to produce new content as a function of time…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Tim Brooks , Janne Hellsten , Miika Aittala , Ting-Chun Wang , Timo Aila , Jaakko Lehtinen , Ming-Yu Liu , Alexei A. Efros , Tero Karras

Event cameras have a lot of advantages over traditional cameras, such as low latency, high temporal resolution, and high dynamic range. However, since the outputs of event cameras are the sequences of asynchronous events overtime rather…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 S. Mohammad Mostafavi I. , Lin Wang , Yo-Sung Ho , Kuk-Jin Yoon

We present LR-GAN: an adversarial image generation model which takes scene structure and context into account. Unlike previous generative adversarial networks (GANs), the proposed GAN learns to generate image background and foregrounds…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Jianwei Yang , Anitha Kannan , Dhruv Batra , Devi Parikh

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

The extension of image generation to video generation turns out to be a very difficult task, since the temporal dimension of videos introduces an extra challenge during the generation process. Besides, due to the limitation of memory and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Dinesh Acharya , Zhiwu Huang , Danda Pani Paudel , Luc Van Gool

Humans can imagine a scene from a sound. We want machines to do so by using conditional generative adversarial networks (GANs). By applying the techniques including spectral norm, projection discriminator and auxiliary classifier, compared…

Computation and Language · Computer Science 2018-08-14 Chia-Hung Wan , Shun-Po Chuang , Hung-Yi Lee

Most of the existing works in video synthesis focus on generating videos using adversarial learning. Despite their success, these methods often require input reference frame or fail to generate diverse videos from the given data…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Abhishek Aich , Akash Gupta , Rameswar Panda , Rakib Hyder , M. Salman Asif , Amit K. Roy-Chowdhury

The visual world we sense, interpret and interact everyday is a complex composition of interleaved physical entities. Therefore, it is a very challenging task to generate vivid scenes of similar complexity using computers. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Mehmet Ozgur Turkoglu , William Thong , Luuk Spreeuwers , Berkay Kicanaoglu

Generative Adversarial Networks (GANs) produce high-quality images but are challenging to train. They need careful regularization, vast amounts of compute, and expensive hyper-parameter sweeps. We make significant headway on these issues by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Axel Sauer , Kashyap Chitta , Jens Müller , Andreas Geiger

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

Machine Learning · Computer Science 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

Image generation has rapidly evolved in recent years. Modern architectures for adversarial training allow to generate even high resolution images with remarkable quality. At the same time, more and more effort is dedicated towards…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Amrutha Saseendran , Kathrin Skubch , Margret Keuper

Image generation remains a fundamental problem in artificial intelligence in general and deep learning in specific. The generative adversarial network (GAN) was successful in generating high quality samples of natural images. We propose a…

Artificial Intelligence · Computer Science 2016-11-15 Hanock Kwak , Byoung-Tak Zhang

In recent years, the use of deep learning is becoming increasingly popular in computer vision. However, the effective training of deep architectures usually relies on huge sets of annotated data. This is critical in the medical field where…

Image and Video Processing · Electrical Eng. & Systems 2019-07-30 Paolo Andreini , Simone Bonechi , Monica Bianchini , Alessandro Mecocci , Franco Scarselli , Andrea Sodi

Predicting the future is a fantasy but practicality work. It is the key component to intelligent agents, such as self-driving vehicles, medical monitoring devices and robotics. In this work, we consider generating unseen future frames from…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Guohao Ying , Yingtian Zou , Lin Wan , Yiming Hu , Jiashi Feng