English
Related papers

Related papers: Self-Supervised Video Representation Learning With…

200 papers

Video anomaly detection is of critical practical importance to a variety of real applications because it allows human attention to be focused on events that are likely to be of interest, in spite of an otherwise overwhelming volume of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Guansong Pang , Cheng Yan , Chunhua Shen , Anton van den Hengel , Xiao Bai

A steady momentum of innovations and breakthroughs has convincingly pushed the limits of unsupervised image representation learning. Compared to static 2D images, video has one more dimension (time). The inherent supervision existing in…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Ting Yao , Yiheng Zhang , Zhaofan Qiu , Yingwei Pan , Tao Mei

One significant factor we expect the video representation learning to capture, especially in contrast with the image representation learning, is the object motion. However, we found that in the current mainstream video datasets, some action…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Jinpeng Wang , Yuting Gao , Ke Li , Jianguo Hu , Xinyang Jiang , Xiaowei Guo , Rongrong Ji , Xing Sun

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer

Medical imaging data suffers from the limited availability of annotation because annotating 3D medical data is a time-consuming and expensive task. Moreover, even if the annotation is available, supervised learning-based approaches suffer…

Image and Video Processing · Electrical Eng. & Systems 2020-11-12 Abinav Ravi Venkatakrishnan , Seong Tae Kim , Rami Eisawy , Franz Pfister , Nassir Navab

Existing video self-supervised learning methods mainly rely on trimmed videos for model training. However, trimmed datasets are manually annotated from untrimmed videos. In this sense, these methods are not really self-supervised. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Dezhao Luo , Bo Fang , Yu Zhou , Yucan Zhou , Dayan Wu , Weiping Wang

Despite the recent success of end-to-end learned representations, hand-crafted optical flow features are still widely used in video analysis tasks. To fill this gap, we propose TVNet, a novel end-to-end trainable neural network, to learn…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Lijie Fan , Wenbing Huang , Chuang Gan , Stefano Ermon , Boqing Gong , Junzhou Huang

In this paper, we propose a deep convolutional neural network (CNN) for anomaly detection in surveillance videos. The model is adapted from a typical auto-encoder working on video patches under the perspective of sparse combination…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Trong Nguyen Nguyen , Jean Meunier

Exemplar learning of visual similarities in an unsupervised manner is a problem of paramount importance to Computer Vision. In this context, however, the recent breakthrough in deep learning could not yet unfold its full potential. With…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Artsiom Sanakoyeu , Miguel A. Bautista , Björn Ommer

While great strides have been made in using deep learning algorithms to solve supervised learning tasks, the problem of unsupervised learning - leveraging unlabeled examples to learn about the structure of a domain - remains a difficult…

Machine Learning · Computer Science 2017-03-02 William Lotter , Gabriel Kreiman , David Cox

This paper addresses the task of unsupervised learning of representations for action recognition in videos. Previous works proposed to utilize future prediction, or other domain-specific objectives to train a network, but achieved only…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Pavel Tokmakov , Martial Hebert , Cordelia Schmid

The objective of this paper is self-supervised learning from video, in particular for representations for action recognition. We make the following contributions: (i) We propose a new architecture and learning framework Memory-augmented…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Tengda Han , Weidi Xie , Andrew Zisserman

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

Contrastive learning has nearly closed the gap between supervised and self-supervised learning of image representations, and has also been explored for videos. However, prior work on contrastive learning for video data has not explored the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ishan Dave , Rohit Gupta , Mamshad Nayeem Rizve , Mubarak Shah

We propose a one-class neural network (OC-NN) model to detect anomalies in complex data sets. OC-NN combines the ability of deep networks to extract a progressively rich representation of data with the one-class objective of creating a…

Machine Learning · Computer Science 2019-01-14 Raghavendra Chalapathy , Aditya Krishna Menon , Sanjay Chawla

Motivated by the previous success of Two-Dimensional Convolutional Neural Network (2D CNN) on image recognition, researchers endeavor to leverage it to characterize videos. However, one limitation of applying 2D CNN to analyze videos is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Junwu Weng , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xudong Jiang , Junsong Yuan

Semi-supervised video anomaly detection (VAD) methods formulate the task of anomaly detection as detection of deviations from the learned normal patterns. Previous works in the field (reconstruction or prediction-based methods) suffer from…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Mohammad Baradaran , Robert Bergevin

Anomalous activity recognition deals with identifying the patterns and events that vary from the normal stream. In a surveillance paradigm, these events range from abuse to fighting and road accidents to snatching, etc. Due to the sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 R. Maqsood , UI. Bajwa , G. Saleem , Rana H. Raza , MW. Anwar

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Convolutional Neural Networks (CNNs) have shown to be powerful medical image segmentation models. In this study, we address some of the main unresolved issues regarding these models. Specifically, training of these models on small medical…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Davood Karimi , Ali Gholipour