English
Related papers

Related papers: Non-Adversarial Video Synthesis with Learned Prior…

200 papers

Standard methods for generating adversarial examples for neural networks do not consistently fool neural network classifiers in the physical world due to a combination of viewpoint shifts, camera noise, and other natural transformations,…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Anish Athalye , Logan Engstrom , Andrew Ilyas , Kevin Kwok

Videos express highly structured spatio-temporal patterns of visual data. A video can be thought of as being governed by two factors: (i) temporally invariant (e.g., person identity), or slowly varying (e.g., activity), attribute-induced…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Jiawei He , Andreas Lehrmann , Joseph Marino , Greg Mori , Leonid Sigal

Currently, various studies have been exploring generation of long videos. However, the generated frames in these videos often exhibit jitter and noise. Therefore, in order to generate the videos without these noise, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Chaoyi Wang , Yaozhe Song , Yafeng Zhang , Jun Pei , Lijie Xia , Jianpo Liu

The video generation task can be formulated as a prediction of future video frames given some past frames. Recent generative models for videos face the problem of high computational requirements. Some models require up to 512 Tensor…

Computer Vision and Pattern Recognition · Computer Science 2020-06-20 Ruslan Rakhimov , Denis Volkhonskiy , Alexey Artemov , Denis Zorin , Evgeny Burnaev

Adversarial attacks in the input (pixel) space typically incorporate noise margins such as $L_1$ or $L_{\infty}$-norm to produce imperceptibly perturbed data that confound deep learning networks. Such noise margins confine the magnitude of…

Machine Learning · Computer Science 2023-04-11 Nitish Shukla , Sudipta Banerjee

Generative adversarial networks (GANs) transform latent vectors into visually plausible images. It is generally thought that the original GAN formulation gives no out-of-the-box method to reverse the mapping, projecting images back into…

Machine Learning · Computer Science 2017-02-20 Zachary C. Lipton , Subarna Tripathi

Gatys et al. (2015) showed that optimizing pixels to match features in a convolutional network with respect reference image features is a way to render images of high visual quality. We show that unrolling this gradient-based optimization…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , Chris Dongjoo Kim , Hui Jiang , Roland Memisevic

Recent approaches in generative adversarial networks (GANs) can automatically synthesize realistic images from descriptive text. Despite the overall fair quality, the generated images often expose visible flaws that lack structural…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 Miriam Cha , Youngjune Gwon , H. T. Kung

Due to the emergence of Generative Adversarial Networks, video synthesis has witnessed exceptional breakthroughs. However, existing methods lack a proper representation to explicitly control the dynamics in videos. Human pose, on the other…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Ceyuan Yang , Zhe Wang , Xinge Zhu , Chen Huang , Jianping Shi , Dahua Lin

Images synthesized by powerful generative adversarial network (GAN) based methods have drawn moral and privacy concerns. Although image forensic models have reached great performance in detecting fake images from real ones, these models can…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Dongze Li , Wei Wang , Hongxing Fan , Jing Dong

This presentation introduces a self-supervised learning approach to the synthesis of new video clips from old ones, with several new key elements for improved spatial resolution and realism: It conditions the synthesis process on contextual…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Guillaume Le Moing , Jean Ponce , Cordelia Schmid

In this paper, we present a novel adversarial lossy video compression model. At extremely low bit-rates, standard video coding schemes suffer from unpleasant reconstruction artifacts such as blocking, ringing etc. Existing learned neural…

Image and Video Processing · Electrical Eng. & Systems 2021-06-22 Vijay Veerabadran , Reza Pourreza , Amirhossein Habibian , Taco Cohen

Adversarial learning helps generative models translate MRI from source to target sequence when lacking paired samples. However, implementing MRI synthesis with adversarial learning in clinical settings is challenging due to training…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Luyi Han , Tao Tan , Tianyu Zhang , Xin Wang , Yuan Gao , Chunyao Lu , Xinglong Liang , Haoran Dou , Yunzhi Huang , Ritse Mann

Latent video diffusion models generate videos by progressively transforming Gaussian noise into realistic samples conditioned on text or visual inputs. However, existing conditioning methods often require additional training and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ofir Abramovich , Nadav Z. Cohen , Adi Rosenthal , Ariel Shamir

Generative models of natural images have progressed towards high fidelity samples by the strong leveraging of scale. We attempt to carry this success to the field of video modeling by showing that large Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Aidan Clark , Jeff Donahue , Karen Simonyan

Unconditional video generation is a challenging task that involves synthesizing high-quality videos that are both coherent and of extended duration. To address this challenge, researchers have used pretrained StyleGAN image generators for…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Yuhan Wang , Liming Jiang , Chen Change Loy

Compositing is one of the most important editing operations for images and videos. The process of improving the realism of composite results is often called harmonization. Previous approaches for harmonization mainly focus on images. In…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Haozhi Huang , Senzhe Xu , Junxiong Cai , Wei Liu , Shimin Hu

This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hongyuan Yu , Yan Huang , Lihong Pi , Liang Wang

Video super-resolution (VSR) has become one of the most critical problems in video processing. In the deep learning literature, recent works have shown the benefits of using adversarial-based and perceptual losses to improve the performance…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Alice Lucas , Santiago Lopez Tapia , Rafael Molina , Aggelos K. Katsaggelos

In order to perform unconditional video generation, we must learn the distribution of the real-world videos. In an effort to synthesize high-quality videos, various studies attempted to learn a mapping function between noise and videos,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Kangyeol Kim , Sunghyun Park , Junsoo Lee , Joonseok Lee , Sookyung Kim , Jaegul Choo , Edward Choi