English
Related papers

Related papers: Self-Attention Based Generative Adversarial Networ…

200 papers

In many applications, including surveillance, entertainment, and restoration, there is a need to increase both the spatial resolution and the frame rate of a video sequence. The aim is to improve visual quality, refine details, and create a…

Image and Video Processing · Electrical Eng. & Systems 2024-07-25 Congrui Fu , Hui Yuan , Liquan Shen , Raouf Hamzaoui , Hao Zhang

In this paper, we present an unsupervised learning approach for analyzing facial behavior based on a deep generative model combined with a convolutional neural network (CNN). We jointly train a variational auto-encoder (VAE) and a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-14 Suman Saha , Rajitha Navarathna , Leonhard Helminger , Romann Weber

Video summarization aims at generating concise video summaries from the lengthy videos, to achieve better user watching experience. Due to the subjectivity, purely supervised methods for video summarization may bring the inherent errors…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Tianyu Liu

Generative adversarial nets (GAN) has been successfully introduced for generating text to alleviate the exposure bias. However, discriminators in these models only evaluate the entire sequence, which causes feedback sparsity and mode…

Machine Learning · Computer Science 2019-05-31 Xingyuan Chen , Yanzhe Li , Peng Jin , Jiuhua Zhang , Xinyu Dai , Jiajun Chen , Gang Song

Video summarization aims to generate a compact, informative, and representative synopsis of raw videos, which is crucial for browsing, analyzing, and understanding video content. Dominant approaches in video summarization primarily rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Libin Lan , Lu Jiang , Tianshu Yu , Xiaojuan Liu , Zhongshi He

Models based on self-attention mechanisms have been successful in analyzing temporal data and have been widely used in the natural language domain. We propose a new model architecture for video face representation and recognition based on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Ihor Protsenko , Taras Lehinevych , Dmytro Voitekh , Ihor Kroosh , Nick Hasty , Anthony Johnson

Synthesising a text-to-image model of high-quality images by guiding the generative model through the Text description is an innovative and challenging task. In recent years, AttnGAN based on the Attention mechanism to guide GAN training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Mingyu Jin , Chong Zhang , Qinkai Yu , Haochen Xue , Xiaobo Jin , Xi Yang

There is an urgent need for an effective video classification method by means of a small number of samples. The deficiency of samples could be effectively alleviated by generating samples through Generative Adversarial Networks (GAN), but…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Yumeng Zhang , Gaoguo Jia , Li Chen , Mingrui Zhang , Junhai Yong

Most existing zero-shot learning methods consider the problem as a visual semantic embedding one. Given the demonstrated capability of Generative Adversarial Networks(GANs) to generate images, we instead leverage GANs to imagine unseen…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Yizhe Zhu , Mohamed Elhoseiny , Bingchen Liu , Xi Peng , Ahmed Elgammal

Video generation has seen remarkable progress thanks to advancements in generative deep learning. However, generating long sequences remains a significant challenge. Generated videos should not only display coherent and continuous movement…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jingbo Yang , Adrian G. Bors

Generative Adversarial Networks (GANs) have been shown to produce realistically looking synthetic images with remarkable success, yet their performance seems less impressive when the training set is highly diverse. In order to provide a…

Machine Learning · Computer Science 2018-08-31 Matan Ben-Yosef , Daphna Weinshall

Previous approaches for video summarization mainly concentrate on finding the most diverse and representative visual contents as video summary without considering the user's preference. This paper addresses the task of query-focused video…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Shuwen Xiao , Zhou Zhao , Zijian Zhang , Xiaohui Yan , Min Yang

Video summarization aims to facilitate large-scale video browsing by producing short, concise summaries that are diverse and representative of original videos. In this paper, we formulate video summarization as a sequential decision-making…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Kaiyang Zhou , Yu Qiao , Tao Xiang

In this paper we propose a generative adversarial network (GAN) framework to enhance the perceptual quality of compressed videos. Our framework includes attention and adaptation to different quantization parameters (QPs) in a single model.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Saiping Zhang , Luis Herranz , Marta Mrak , Marc Gorriz Blanch , Shuai Wan , Fuzheng Yang

This compilation of various research paper highlights provides a comprehensive overview of recent developments in super-resolution image and video using deep learning algorithms such as Generative Adversarial Networks. The studies covered…

Image and Video Processing · Electrical Eng. & Systems 2024-08-31 Ankush Maity , Roshan Pious , Sourabh Kumar Lenka , Vishal Choudhary , Sharayu Lokhande

Generative Adversarial Networks (GAN) is a model for data synthesis, which creates plausible data through the competition of generator and discriminator. Although GAN application to image synthesis is extensively studied, it has inherent…

Computation and Language · Computer Science 2025-01-07 Jun-Min Lee , Tae-Bin Ha

The development of sophisticated models for video-to-video synthesis has been facilitated by recent advances in deep reinforcement learning and generative adversarial networks (GANs). In this paper, we propose RL-V2V-GAN, a new deep neural…

Machine Learning · Computer Science 2024-10-29 Yintai Ma , Diego Klabjan , Jean Utke

In this paper, we propose a generative model, Temporal Generative Adversarial Nets (TGAN), which can learn a semantic representation of unlabeled videos, and is capable of generating videos. Unlike existing Generative Adversarial Nets…

Machine Learning · Computer Science 2017-08-21 Masaki Saito , Eiichi Matsumoto , Shunta Saito

This study explores innovative methods for improving Visual Question Answering (VQA) using Generative Adversarial Networks (GANs), autoencoders, and attention mechanisms. Leveraging a balanced VQA dataset, we investigate three distinct…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Panfeng Li , Qikai Yang , Xieming Geng , Wenjing Zhou , Zhicheng Ding , Yi Nian

This paper presents a novel approach for unsupervised video summarization using reinforcement learning (RL), addressing limitations like unstable adversarial training and reliance on heuristic-based reward functions. The method operates on…

Multimedia · Computer Science 2025-12-24 Mehryar Abbasi , Hadi Hadizadeh , Parvaneh Saeedi