English
Related papers

Related papers: A Computational Account Of Self-Supervised Visual …

200 papers

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Self-supervised learning has achieved remarkable success in learning visual representations from clean data, yet remains challenging when clean observations are sparse or not available at all. In this paper, we demonstrate that pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Konstantinos Alexis , Giorgos Giannopoulos , Dimitrios Gunopulos

In everyday life collaboration tasks between human operators and robots, the former necessitate simple ways for programming new skills, the latter have to show adaptive capabilities to cope with environmental changes. The joint use of…

Robotics · Computer Science 2023-09-15 Rocco Felici , Matteo Saveriano , Loris Roveda , Antonio Paolillo

Recent progress in contrastive learning has revolutionized unsupervised representation learning. Concretely, multiple views (augmentations) from the same image are encouraged to map to the similar embeddings, while views from different…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Nanxuan Zhao , Zhirong Wu , Rynson W. H. Lau , Stephen Lin

Understanding users' activities from head-mounted cameras is a fundamental task for Augmented and Virtual Reality (AR/VR) applications. A typical approach is to train a classifier in a supervised manner using data labeled by humans. This…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Satoshi Tsutsui , Ruta Desai , Karl Ridgeway

Human perception is structured around objects which form the basis for our higher-level cognition and impressive systematic generalization abilities. Yet most work on representation learning focuses on feature learning without even…

Contrastive learning has achieved great success in self-supervised visual representation learning, but existing approaches mostly ignored spatial information which is often crucial for visual representation. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xinyue Huo , Lingxi Xie , Longhui Wei , Xiaopeng Zhang , Hao Li , Zijie Yang , Wengang Zhou , Houqiang Li , Qi Tian

We study self-supervised video representation learning, which is a challenging task due to 1) lack of labels for explicit supervision; 2) unstructured and noisy visual information. Existing methods mainly use contrastive loss with video…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Deng Huang , Wenhao Wu , Weiwen Hu , Xu Liu , Dongliang He , Zhihua Wu , Xiangmiao Wu , Mingkui Tan , Errui Ding

In recent years, several unsupervised, "contrastive" learning algorithms in vision have been shown to learn representations that perform remarkably well on transfer tasks. We show that this family of algorithms maximizes a lower bound on…

Machine Learning · Computer Science 2020-06-08 Mike Wu , Chengxu Zhuang , Milan Mosse , Daniel Yamins , Noah Goodman

We propose a self-supervised method for learning motion-focused video representations. Existing approaches minimize distances between temporally augmented videos, which maintain high spatial similarity. We instead propose to learn…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Fida Mohammad Thoker , Hazel Doughty , Cees Snoek

In this thesis we address two related aspects of visual object recognition: the use of motion information, and the use of internal supervision, to help unsupervised learning. These two aspects are inter-related in the current study, since…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Daniel Harari

This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Deepak Pathak , Ross Girshick , Piotr Dollár , Trevor Darrell , Bharath Hariharan

Traditional visual servoing methods suffer from serving between scenes from multiple perspectives, which humans can complete with visual signals alone. In this paper, we investigated how multi-perspective visual servoing could be solved…

Robotics · Computer Science 2023-12-27 Lei Zhang , Jiacheng Pei , Kaixin Bai , Zhaopeng Chen , Jianwei Zhang

Given a collection of images, humans are able to discover landmarks by modeling the shared geometric structure across instances. This idea of geometric equivariance has been widely used for the unsupervised discovery of object landmark…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zezhou Cheng , Jong-Chyi Su , Subhransu Maji

The labeled data required to learn pose estimation for articulated objects is difficult to provide in the desired quantity, realism, density, and accuracy. To address this issue, we develop a method to learn representations, which are very…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Georg Poier , David Schinagl , Horst Bischof

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

Machine Learning · Computer Science 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Egocentric videos can bring a lot of information about how humans perceive the world and interact with the environment, which can be beneficial for the analysis of human behaviour. The research in egocentric video analysis is developing…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Ivan Rodin , Antonino Furnari , Dimitrios Mavroedis , Giovanni Maria Farinella

Human skeleton point clouds are commonly used to automatically classify and predict the behaviour of others. In this paper, we use a contrastive self-supervised learning method, SimCLR, to learn representations that capture the semantics of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Nico Lingg , Miguel Sarabia , Luca Zappella , Barry-John Theobald

Unsupervised representation learning methods like SwAV are proved to be effective in learning visual semantics of a target dataset. The main idea behind these methods is that different views of a same image represent the same semantics. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Mehdi Seyfi , Amin Banitalebi-Dehkordi , Yong Zhang

We present a new approach to instill 4D dynamic object priors into learned 3D representations by unsupervised pre-training. We observe that dynamic movement of an object through an environment provides important cues about its objectness,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Yujin Chen , Matthias Nießner , Angela Dai