English
Related papers

Related papers: Autoregressive Adversarial Post-Training for Real-…

200 papers

Given an arbitrary face image and an arbitrary speech clip, the proposed work attempts to generating the talking face video with accurate lip synchronization while maintaining smooth transition of both lip and facial movement over the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Yang Song , Jingwen Zhu , Dawei Li , Xiaolong Wang , Hairong Qi

Diffusion-based video generation models have demonstrated remarkable success in obtaining high-fidelity videos through the iterative denoising process. However, these models require multiple denoising steps during sampling, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Zhixing Zhang , Yanyu Li , Yushu Wu , Yanwu Xu , Anil Kag , Ivan Skorokhodov , Willi Menapace , Aliaksandr Siarohin , Junli Cao , Dimitris Metaxas , Sergey Tulyakov , Jian Ren

Generative Adversarial Networks have been employed successfully to generate high-resolution augmented images of size 1024^2. Although the augmented images generated are unprecedented, the training time of the model is exceptionally high.…

Image and Video Processing · Electrical Eng. & Systems 2022-02-28 Atharva Karwande , Pranesh Kulkarni , Tejas Kolhe , Akshay Joshi , Soham Kamble

Adversarial training (AT) is a simple yet effective defense against adversarial attacks to image classification systems, which is based on augmenting the training set with attacks that maximize the loss. However, the effectiveness of AT as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Kaleab A. Kinfu , René Vidal

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Multiple different approaches of generating adversarial examples have been proposed to attack deep neural networks. These approaches involve either directly computing gradients with respect to the image pixels, or directly solving an…

Neural and Evolutionary Computing · Computer Science 2017-03-29 Shumeet Baluja , Ian Fischer

The video generation task can be formulated as a prediction of future video frames given some past frames. Recent generative models for videos face the problem of high computational requirements. Some models require up to 512 Tensor…

Computer Vision and Pattern Recognition · Computer Science 2020-06-20 Ruslan Rakhimov , Denis Volkhonskiy , Alexey Artemov , Denis Zorin , Evgeny Burnaev

Autoregressive models recently achieved comparable results versus state-of-the-art Generative Adversarial Networks (GANs) with the help of Vector Quantized Variational AutoEncoders (VQ-VAE). However, autoregressive models have several…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Kenan E. Ak , Ning Xu , Zhe Lin , Yilin Wang

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

In this paper, we aim to improve the state-of-the-art video generative adversarial networks (GANs) with a view towards multi-functional applications. Our improved video GAN model does not separate foreground from background nor dynamic from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Bernhard Kratzwald , Zhiwu Huang , Danda Pani Paudel , Acharya Dinesh , Luc Van Gool

Adversarial training is wildly considered as one of the most effective way to defend against adversarial examples. However, existing adversarial training methods consume unbearable time, due to the fact that they need to generate…

Machine Learning · Computer Science 2021-03-10 Yaguan Qian , Qiqi Shao , Tengteng Yao , Bin Wang , Shouling Ji , Shaoning Zeng , Zhaoquan Gu , Wassim Swaileh

Deep neural networks have been shown to perform poorly on adversarial examples. To address this, several techniques have been proposed to increase robustness of a model for image classification tasks. However, in video understanding tasks,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Divya Choudhary , Palash Goyal , Saurabh Sahu

In the deep learning era, long video generation of high-quality still remains challenging due to the spatio-temporal complexity and continuity of videos. Existing prior works have attempted to model video distribution by representing videos…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Sihyun Yu , Jihoon Tack , Sangwoo Mo , Hyunsu Kim , Junho Kim , Jung-Woo Ha , Jinwoo Shin

Advances in technology have led to the development of methods that can create desired visual multimedia. In particular, image generation using deep learning has been extensively studied across diverse fields. In comparison, video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Doyeon Kim , Donggyu Joo , Junmo Kim

Extensive research has demonstrated that deep neural networks (DNNs) are prone to adversarial attacks. Although various defense mechanisms have been proposed for image classification networks, fewer approaches exist for video-based models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Nupur Thakur , Baoxin Li

Generative Adversarial Networks (GANs) have been studied in text generation to tackle the exposure bias problem. Despite their remarkable development, they adopt autoregressive structures so suffering from high latency in both training and…

Computation and Language · Computer Science 2024-10-03 Da Ren , Yi Cai , Qing Li

Generative adversarial networks (GANs) learn a deep generative model that is able to synthesise novel, high-dimensional data samples. New data samples are synthesised by passing latent samples, drawn from a chosen prior distribution,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-16 Antonia Creswell , Anil A Bharath

AI-generated content has attracted lots of attention recently, but photo-realistic video synthesis is still challenging. Although many attempts using GANs and autoregressive models have been made in this area, the visual quality and length…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yingqing He , Tianyu Yang , Yong Zhang , Ying Shan , Qifeng Chen

Diffusion models have exhibited promising progress in video generation. However, they often struggle to retain consistent details within local regions across frames. One underlying cause is that traditional diffusion models approximate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Yupu Yao , Shangqi Deng , Zihan Cao , Harry Zhang , Liang-Jian Deng

In this work, we introduce a two-step framework for generative modeling of temporal data. Specifically, the generative adversarial networks (GANs) setting is employed to generate synthetic scenes of moving objects. To do so, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Isabela Albuquerque , João Monteiro , Tiago H. Falk