English
Related papers

Related papers: DistInit: Learning Video Representations Without a…

200 papers

In this paper, we investigate how to learn a suitable representation of satellite image time series in an unsupervised manner by leveraging large amounts of unlabeled data. Additionally , we aim to disentangle the representation of time…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Eduardo Sanchez , Mathieu Serrurier , Mathias Ortner

Representation learning has been proven to play an important role in the unprecedented success of machine learning models in numerous tasks, such as machine translation, face recognition and recommendation. The majority of existing…

Machine Learning · Computer Science 2020-09-24 Wentao Wang , Guowei Xu , Wenbiao Ding , Gale Yan Huang , Guoliang Li , Jiliang Tang , Zitao Liu

Learning interpretable and disentangled representations is a crucial yet challenging task in representation learning. In this work, we focus on semi-supervised disentanglement learning and extend work by Locatello et al. (2019) by…

Machine Learning · Computer Science 2020-06-24 Weili Nie , Zichao Wang , Ankit B. Patel , Richard G. Baraniuk

Unsupervised pre-training was a critical technique for training deep neural networks years ago. With sufficient labeled data and modern training techniques, it is possible to train very deep neural networks from scratch in a purely…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Jianfeng Dong , Xiao-Jiao Mao , Chunhua Shen , Yu-Bin Yang

Isolating different types of motion in video data is a highly relevant problem in video analysis. Applications can be found, for example, in dynamic medical or biological imaging, where the analysis and further processing of the dynamics of…

Image and Video Processing · Electrical Eng. & Systems 2023-05-18 Abdullah Abdullah , Martin Holler , Karl Kunisch , Malena Sabate Landman

We propose a general way to integrate procedural knowledge of a domain into deep learning models. We apply it to the case of video prediction, building on top of object-centric deep models and show that this leads to a better performance…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Patrick Takenaka , Johannes Maucher , Marco F. Huber

We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self-supervised learning (SSL), we develop a non-contrastive representation learning method that can exploit additional knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Hamed Pirsiavash

In this work, we address the challenging video scene parsing problem by developing effective representation learning methods given limited parsing annotations. In particular, we contribute two novel methods that constitute a unified parsing…

Computer Vision and Pattern Recognition · Computer Science 2016-12-14 Xiaojie Jin , Xin Li , Huaxin Xiao , Xiaohui Shen , Zhe Lin , Jimei Yang , Yunpeng Chen , Jian Dong , Luoqi Liu , Zequn Jie , Jiashi Feng , Shuicheng Yan

Discriminative self-supervised learning allows training models on any random group of internet images, and possibly recover salient information that helps differentiate between the images. Applied to ImageNet, this leads to object centric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Priya Goyal , Quentin Duval , Isaac Seessel , Mathilde Caron , Ishan Misra , Levent Sagun , Armand Joulin , Piotr Bojanowski

The existing solutions for object detection distillation rely on the availability of both a teacher model and ground-truth labels. We propose a new perspective to relax this constraint. In our framework, a student is first trained with…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Amin Banitalebi-Dehkordi

In the absence of large labelled datasets, self-supervised learning techniques can boost performance by learning useful representations from unlabelled data, which is often more readily available. However, there is often a domain shift…

Machine Learning · Computer Science 2020-06-23 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

This paper introduces a novel self-learning framework that automates the label acquisition process for improving models for detecting players in broadcast footage of sports games. Unlike most previous self-learning approaches for improving…

Computer Vision and Pattern Recognition · Computer Science 2013-07-30 Kenji Okuma , David G. Lowe , James J. Little

The ability to localize and segment objects from unseen classes would open the door to new applications, such as autonomous object learning in active vision. Nonetheless, improving the performance on unseen classes requires additional…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yuming Du , Yang Xiao , Vincent Lepetit

Despite the fast progress in training specialized models for various tasks, learning a single general model that works well for many tasks is still challenging for computer vision. Here we introduce multi-task self-training (MuST), which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Golnaz Ghiasi , Barret Zoph , Ekin D. Cubuk , Quoc V. Le , Tsung-Yi Lin

Self-supervised learning has proved to be a powerful approach to learn image representations without the need of large labeled datasets. For underwater robotics, it is of great interest to design computer vision algorithms to improve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Alan Preciado-Grijalva , Bilal Wehbe , Miguel Bande Firvida , Matias Valdenegro-Toro

Missing data poses significant challenges while learning representations of video sequences. We present Disentangled Imputed Video autoEncoder (DIVE), a deep generative model that imputes and predicts future video frames in the presence of…

Machine Learning · Computer Science 2020-11-05 Armand Comas-Massagué , Chi Zhang , Zlatan Feric , Octavia Camps , Rose Yu

Learning visual knowledge from massive weakly-labeled web videos has attracted growing research interests thanks to the large corpus of easily accessible video data on the Internet. However, for video action recognition, the action of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kunpeng Li , Zizhao Zhang , Guanhang Wu , Xuehan Xiong , Chen-Yu Lee , Zhichao Lu , Yun Fu , Tomas Pfister

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

A goal of unsupervised machine learning is to build representations of complex high-dimensional data, with simple relations to their properties. Such disentangled representations make easier to interpret the significant latent factors of…

Machine Learning · Computer Science 2023-04-06 Jorge Fernandez-de-Cossio-Diaz , Simona Cocco , Remi Monasson