English
Related papers

Related papers: Adversarial Framework for Unsupervised Learning of…

200 papers

The deep generative adversarial networks (GAN) recently have been shown to be promising for different computer vision applications, like image edit- ing, synthesizing high resolution images, generating videos, etc. These networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Ali Diba , Vivek Sharma , Rainer Stiefelhagen , Luc Van Gool

Human actions are comprised of a sequence of poses. This makes videos of humans a rich and dense source of human poses. We propose an unsupervised method to learn pose features from videos that exploits a signal which is complementary to…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Senthil Purushwalkam , Abhinav Gupta

Motions are reflected in videos as the movement of pixels, and actions are essentially patterns of inconsistent motions between the foreground and the background. To well distinguish the actions, especially those with complicated…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ziyuan Huang , Shiwei Zhang , Jianwen Jiang , Mingqian Tang , Rong Jin , Marcelo Ang

This paper addresses the problem of self-supervised video representation learning from a new perspective -- by video pace prediction. It stems from the observation that human visual system is sensitive to video pace, e.g., slow motion, a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Jiangliu Wang , Jianbo Jiao , Yun-Hui Liu

This paper introduces a novel self-supervised method that leverages incoherence detection for video representation learning. It roots from the observation that visual systems of human beings can easily identify video incoherence based on…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Haozhi Cao , Yuecong Xu , Jianfei Yang , Kezhi Mao , Lihua Xie , Jianxiong Yin , Simon See

Self supervised representation learning has recently attracted a lot of research interest for both the audio and visual modalities. However, most works typically focus on a particular modality or feature alone and there has been very…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-21 Abhinav Shukla , Konstantinos Vougioukas , Pingchuan Ma , Stavros Petridis , Maja Pantic

Temporal segmentation of long videos is an important problem, that has largely been tackled through supervised learning, often requiring large amounts of annotated training data. In this paper, we tackle the problem of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Sathyanarayanan N. Aakur , Sudeep Sarkar

Neural networks for multi-domain learning empowers an effective combination of information from different domains by sharing and co-learning the parameters. In visual tracking, the emerging features in shared layers of a multi-domain…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Kourosh Meshgi , Maryam Sadat Mirzaei

Face presentation attack detection (PAD) plays an important role in defending face recognition systems against presentation attacks. The success of PAD largely relies on supervised learning that requires a huge number of labeled data, which…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Usman Muhammad , Mourad Oussalah

The problem of action recognition involves locating the action in the video, both over time and spatially in the image. The dominant current approaches use supervised learning to solve this problem, and require large amounts of annotated…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Sathyanarayanan N. Aakur , Sudeep Sarkar

Most of the existing works in video synthesis focus on generating videos using adversarial learning. Despite their success, these methods often require input reference frame or fail to generate diverse videos from the given data…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Abhishek Aich , Akash Gupta , Rameswar Panda , Rakib Hyder , M. Salman Asif , Amit K. Roy-Chowdhury

In this paper, we aim to improve the state-of-the-art video generative adversarial networks (GANs) with a view towards multi-functional applications. Our improved video GAN model does not separate foreground from background nor dynamic from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Bernhard Kratzwald , Zhiwu Huang , Danda Pani Paudel , Acharya Dinesh , Luc Van Gool

We present a large-scale study on unsupervised spatiotemporal representation learning from videos. With a unified perspective on four recent image-based frameworks, we study a simple objective that can easily generalize all these methods to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Christoph Feichtenhofer , Haoqi Fan , Bo Xiong , Ross Girshick , Kaiming He

This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Deepak Pathak , Ross Girshick , Piotr Dollár , Trevor Darrell , Bharath Hariharan

Robust frame-wise embeddings are essential to perform video analysis and understanding tasks. We present a self-supervised method for representation learning based on aligning temporal video sequences. Our framework uses a transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Keyne Oei , Amr Gomaa , Anna Maria Feit , João Belo

Contrastive self-supervised learning has emerged as a promising approach to unsupervised visual representation learning. In general, these methods learn global (image-level) representations that are invariant to different views (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pedro O. Pinheiro , Amjad Almahairi , Ryan Y. Benmalek , Florian Golemo , Aaron Courville

Unsupervised learning from visual data is one of the most difficult challenges in computer vision, being a fundamental task for understanding how visual recognition works. From a practical point of view, learning from unsupervised visual…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

Action recognition in videos has attracted a lot of attention in the past decade. In order to learn robust models, previous methods usually assume videos are trimmed as short sequences and require ground-truth annotations of each video…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Xiao-Yu Zhang , Haichao Shi , Changsheng Li , Kai Zheng , Xiaobin Zhu , Lixin Duan

Distinguishing if an action is performed as intended or if an intended action fails is an important skill that not only humans have, but that is also important for intelligent systems that operate in human environments. Recognizing if an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Olga Zatsarynna , Yazan Abu Farha , Juergen Gall