English
Related papers

Related papers: Learning Temporal Coherence via Self-Supervision f…

200 papers

GANs involve training two networks in an adversarial game, where each network's task depends on its adversary. Recently, several works have framed GAN training as an online or continual learning problem. We focus on the discriminator, which…

Machine Learning · Computer Science 2018-12-06 Ting Chen , Xiaohua Zhai , Neil Houlsby

Adversarially trained generative models (GANs) have recently achieved compelling image synthesis results. But despite early successes in using GANs for unsupervised representation learning, they have since been superseded by approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Jeff Donahue , Karen Simonyan

Understanding temporal dynamics of video is an essential aspect of learning better video representations. Recently, transformer-based architectural designs have been extensively explored for video tasks due to their capability to capture…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Sukmin Yun , Jaehyung Kim , Dongyoon Han , Hwanjun Song , Jung-Woo Ha , Jinwoo Shin

Accounting for the increased concern for public safety, automatic abnormal event detection and recognition in a surveillance scene is crucial. It is a current open study subject because of its intricacy and utility. The identification of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Anikeit Sethi , Krishanu Saini , Sai Mounika Mididoddi

There is an urgent need for an effective video classification method by means of a small number of samples. The deficiency of samples could be effectively alleviated by generating samples through Generative Adversarial Networks (GAN), but…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Yumeng Zhang , Gaoguo Jia , Li Chen , Mingrui Zhang , Junhai Yong

Since the creation of Generative Adversarial Networks (GANs), much work has been done to improve their training stability, their generated image quality, their range of application but nearly none of them explored their self-training…

Machine Learning · Computer Science 2017-10-31 Alan Do-Omri , Dalei Wu , Xiaohua Liu

Generative adversarial network (GAN) is gaining increased importance in artificially constructing natural images and related functionalities wherein two networks called generator and discriminator are evolving through adversarial…

Machine Learning · Computer Science 2019-05-27 Makoto Naruse , Takashi Matsubara , Nicolas Chauvet , Kazutaka Kanno , Tianyu Yang , Atsushi Uchida

Recently, learning-based models have enhanced the performance of single-image super-resolution (SISR). However, applying SISR successively to each video frame leads to a lack of temporal coherency. Convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Aman Chadha , John Britto , M. Mani Roja

Video summarization is a crucial technique for social understanding, enabling efficient browsing of massive multimedia content and extraction of key information from social platforms. Most existing unsupervised summarization methods rely on…

Artificial Intelligence · Computer Science 2026-01-22 Haizhou Liu , Haodong Jin , Yiming Wang , Hui Yu

With the explosive growth of video data, video summarization, which attempts to seek the minimum subset of frames while still conveying the main story, has become one of the hottest topics. Nowadays, substantial achievements have been made…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Guoqiang Liang , Yanbing Lv , Shucheng Li , Shizhou Zhang , Yanning Zhang

In this work we address the challenging problem of unsupervised learning from videos. Existing methods utilize the spatio-temporal continuity in contiguous video frames as regularization for the learning process. Typically, this temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-10-12 Carolina Redondo-Cabrera , Roberto J. López-Sastre

While Convolutional Neural Networks (CNNs) trained for image and video super-resolution (SR) regularly achieve new state-of-the-art performance, they also suffer from significant drawbacks. One of their limitations is their lack of…

Image and Video Processing · Electrical Eng. & Systems 2020-06-16 Alice Lucas , Santiago Lopez-Tapia , Rafael Molina , Aggelos K. Katsaggelos

Training GANs on videos is even more sophisticated than on images because videos have a distinguished dimension: time. While recent methods designed a dedicated architecture considering time, generated videos are still far from…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kibeom Hong , Youngjung Uh , Hyeran Byun

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Collecting well-annotated image datasets to train modern machine learning algorithms is prohibitively expensive for many tasks. One appealing alternative is rendering synthetic data where ground-truth annotations are generated…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Konstantinos Bousmalis , Nathan Silberman , David Dohan , Dumitru Erhan , Dilip Krishnan

To generate accurate videos, algorithms have to understand the spatial and temporal dependencies in the world. Current algorithms enable accurate predictions over short horizons but tend to suffer from temporal inconsistencies. When…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Wilson Yan , Danijar Hafner , Stephen James , Pieter Abbeel

In order to provide the right type of assistance at the right time, computer-assisted surgery systems need context awareness. To achieve this, methods for surgical workflow analysis are crucial. Currently, convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Isabel Funke , Alexander Jenke , Sören Torge Mees , Jürgen Weitz , Stefanie Speidel , Sebastian Bodenstedt

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

Given an arbitrary face image and an arbitrary speech clip, the proposed work attempts to generating the talking face video with accurate lip synchronization while maintaining smooth transition of both lip and facial movement over the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Yang Song , Jingwen Zhu , Dawei Li , Xiaolong Wang , Hairong Qi

Generative Adversarial Networks (GANs) have extended deep learning to complex generation and translation tasks across different data modalities. However, GANs are notoriously difficult to train: Mode collapse and other instabilities in the…

Neural and Evolutionary Computing · Computer Science 2021-10-29 Santiago Gonzalez , Mohak Kant , Risto Miikkulainen