English
Related papers

Related papers: Non-Adversarial Video Synthesis with Learned Prior…

200 papers

Generative Adversarial Networks (GANs) have achieved remarkable results in the task of generating realistic natural images. In most successful applications, GAN models share two common aspects: solving a challenging saddle point…

Machine Learning · Statistics 2019-05-21 Piotr Bojanowski , Armand Joulin , David Lopez-Paz , Arthur Szlam

In this work, we propose a modeling technique for jointly training image and video generation models by simultaneously learning to map latent variables with a fixed prior onto real images and interpolate over images to generate videos. The…

Machine Learning · Computer Science 2019-12-18 Yatin Dandi , Aniket Das , Soumye Singhal , Vinay P. Namboodiri , Piyush Rai

There is an urgent need for an effective video classification method by means of a small number of samples. The deficiency of samples could be effectively alleviated by generating samples through Generative Adversarial Networks (GAN), but…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Yumeng Zhang , Gaoguo Jia , Li Chen , Mingrui Zhang , Junhai Yong

Inspired by the remarkable success of Latent Diffusion Models (LDMs) for image synthesis, we study LDM for text-to-video generation, which is a formidable challenge due to the computational and memory constraints during both model training…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jiaxi Gu , Shicong Wang , Haoyu Zhao , Tianyi Lu , Xing Zhang , Zuxuan Wu , Songcen Xu , Wei Zhang , Yu-Gang Jiang , Hang Xu

In this paper, we study the problem of producing a comprehensive video summary following an unsupervised approach that relies on adversarial learning. We build on a popular method where a Generative Adversarial Network (GAN) is trained to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Maria Nektaria Minaidi , Charilaos Papaioannou , Alexandros Potamianos

We present a novel method for generating geometrically realistic and consistent orbital videos from a single image of an object. Existing video generation works mostly rely on pixel-wise attention to enforce view consistency across frames.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Rong Wang , Ruyi Zha , Ziang Cheng , Jiayu Yang , Pulak Purkait , Hongdong Li

Adversarial examples are intentionally crafted data with the purpose of deceiving neural networks into misclassification. When we talk about strategies to create such examples, we usually refer to perturbation-based methods that fabricate…

Computer Vision and Pattern Recognition · Computer Science 2018-06-28 Shih-hong Tsai

The generation of adversarial inputs has become a crucial issue in establishing the robustness and trustworthiness of deep neural nets, especially when they are used in safety-critical application domains such as autonomous vehicles and…

Machine Learning · Computer Science 2024-01-03 Tooba Khan , Kumar Madhukar , Subodh Vishnu Sharma

Generative Adversarial Networks (GANs) have emerged as a significant player in generative modeling by mapping lower-dimensional random noise to higher-dimensional spaces. These networks have been used to generate high-resolution images and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Satya Pratheek Tata , Subhankar Mishra

Stochastic video prediction models take in a sequence of image frames, and generate a sequence of consecutive future image frames. These models typically generate future frames in an autoregressive fashion, which is slow and requires the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Ananya Kumar , S. M. Ali Eslami , Danilo J. Rezende , Marta Garnelo , Fabio Viola , Edward Lockhart , Murray Shanahan

Virtual Adversarial Training (VAT) has shown impressive results among recently developed regularization methods called consistency regularization. VAT utilizes adversarial samples, generated by injecting perturbation in the input space, for…

Machine Learning · Computer Science 2022-12-27 Genki Osada , Budrul Ahsan , Revoti Prasad Bora , Takashi Nishide

There have been many efforts in attacking image classification models with adversarial perturbations, but the same topic on video classification has not yet been thoroughly studied. This paper presents a novel idea of video-based attack,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Zhikai Chen , Lingxi Xie , Shanmin Pang , Yong He , Qi Tian

We consider the problem of generating plausible and diverse video sequences, when we are only given a start and an end frame. This task is also known as inbetweening, and it belongs to the broader area of stochastic video generation, which…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Yunpeng Li , Dominik Roblek , Marco Tagliasacchi

Diffusion models have exhibited promising progress in video generation. However, they often struggle to retain consistent details within local regions across frames. One underlying cause is that traditional diffusion models approximate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Yupu Yao , Shangqi Deng , Zihan Cao , Harry Zhang , Liang-Jian Deng

The real world exhibits an abundance of non-stationary textures. Examples include textures with large-scale structures, as well as spatially variant and inhomogeneous textures. While existing example-based texture synthesis methods can cope…

Graphics · Computer Science 2024-01-08 Yang Zhou , Zhen Zhu , Xiang Bai , Dani Lischinski , Daniel Cohen-Or , Hui Huang

The demand for high-quality city street layouts has persisted for an extended period presenting notable challenges. Conventional methods are yet to effectively address the integration of both natural and socioeconomic factors in this…

Graphics · Computer Science 2025-11-10 Lehao Yang , Cui Zhu , Tian Feng

Training of Generative Adversarial Network (GAN) on a video dataset is a challenge because of the sheer size of the dataset and the complexity of each observation. In general, the computational cost of training GAN scales exponentially with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Masaki Saito , Shunta Saito , Masanori Koyama , Sosuke Kobayashi

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Efficient audio synthesis is an inherently difficult machine learning task, as human perception is sensitive to both global structure and fine-scale waveform coherence. Autoregressive models, such as WaveNet, model local structure at the…

Adversarial learning has emerged as one of the successful techniques to circumvent the susceptibility of existing methods against adversarial perturbations. However, the majority of existing defense methods are tailored to defend against a…

Machine Learning · Computer Science 2021-06-28 Divyam Madaan , Jinwoo Shin , Sung Ju Hwang