English
Related papers

Related papers: InfoBehavior: Self-supervised Representation Learn…

200 papers

Hypergraphs play a pivotal role in the modelling of data featuring higher-order relations involving more than two entities. Hypergraph neural networks emerge as a powerful tool for processing hypergraph-structured data, delivering…

Machine Learning · Computer Science 2024-06-04 Zexi Liu , Bohan Tang , Ziyuan Ye , Xiaowen Dong , Siheng Chen , Yanfeng Wang

There are many real-world knowledge based networked systems with multi-type interacting entities that can be regarded as heterogeneous networks including human connections and biological evolutions. One of the main issues in such networks…

Social and Information Networks · Computer Science 2019-11-05 Soheila Molaei , Hadi Zare , Hadi Veisi

Sequence data is challenging for machine learning approaches, because the lengths of the sequences may vary between samples. In this paper, we present an unsupervised learning model for sequence data, called the Integrated Sequence…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Wenjie Pei , David M. J. Tax

Self-supervised learning techniques have shown their abilities to learn meaningful feature representation. This is made possible by training a model on pretext tasks that only requires to find correlations between inputs or parts of inputs.…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Vishal Keshav , Fabien Delattre

The use of imitation learning to learn a single policy for a complex task that has multiple modes or hierarchical structure can be challenging. In fact, previous work has shown that when the modes are known, learning separate policies for…

Machine Learning · Computer Science 2019-03-13 Arjun Sharma , Mohit Sharma , Nicholas Rhinehart , Kris M. Kitani

Imitation learning is widely used for learning to act in complex environments. While pure neural-based methods handle high dimensional data effectively, they suffer from the requirement of large number of samples and are prone to…

Machine Learning · Computer Science 2026-05-11 Nikhilesh Prabhakar , Varun Balaji , Athresh Karanam , Kristian Kersting , Sriraam Natarajan

Understanding how images of objects and scenes behave in response to specific ego-motions is a crucial aspect of proper visual development, yet existing visual learning methods are conspicuously disconnected from the physical source of…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Dinesh Jayaraman , Kristen Grauman

We study unsupervised video representation learning that seeks to learn both motion and appearance features from unlabeled video only, which can be reused for downstream tasks such as action recognition. This task, however, is extremely…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Peihao Chen , Deng Huang , Dongliang He , Xiang Long , Runhao Zeng , Shilei Wen , Mingkui Tan , Chuang Gan

In recent years, discriminative self-supervised methods have made significant strides in advancing various visual tasks. The central idea of learning a data encoder that is robust to data distortions/augmentations is straightforward yet…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yuewei Yang , Hai Li , Yiran Chen

Video representation learning is a vital problem for classification task. Recently, a promising unsupervised paradigm termed self-supervised learning has emerged, which explores inherent supervisory signals implied in massive data for…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Chenrui Zhang , Yuxin Peng

Feature selection is a dimensionality reduction technique that selects a subset of representative features from high dimensional data by eliminating irrelevant and redundant features. Recently, feature selection combined with sparse…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Siwei Feng , Marco F. Duarte

In this work, we perform unsupervised learning of representations by maximizing mutual information between an input and the output of a deep neural network encoder. Importantly, we show that structure matters: incorporating knowledge about…

The goal of unsupervised representation learning is to extract a new representation of data, such that solving many different tasks becomes easier. Existing methods typically focus on vectorized data and offer little support for relational…

Machine Learning · Statistics 2017-09-29 Sebastijan Dumancic , Hendrik Blockeel

Social relations are often used to improve recommendation quality when user-item interaction data is sparse in recommender systems. Most existing social recommendation models exploit pairwise relations to mine potential user preferences.…

Information Retrieval · Computer Science 2022-03-01 Junliang Yu , Hongzhi Yin , Jundong Li , Qinyong Wang , Nguyen Quoc Viet Hung , Xiangliang Zhang

With the tremendous success of deep learning in visual tasks, the representations extracted from intermediate layers of learned models, that is, deep features, attract much attention of researchers. Previous empirical analysis shows that…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Qi Qian , Juhua Hu , Hao Li

Learning visual representations with self-supervised learning has become popular in computer vision. The idea is to design auxiliary tasks where labels are free to obtain. Most of these tasks end up providing data to learn specific kinds of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Xiaolong Wang , Kaiming He , Abhinav Gupta

This paper proposes a novel pretext task to address the self-supervised video representation learning problem. Specifically, given an unlabeled video clip, we compute a series of spatio-temporal statistical summaries, such as the spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Wei Liu , Yun-hui Liu

This work explores how to use self-supervised learning on videos to learn a class-specific image embedding that encodes pose and shape information. At train time, two frames of the same video of an object class (e.g. human upper body) are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Olivia Wiles , A. Sophia Koepke , Andrew Zisserman

This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Deepak Pathak , Ross Girshick , Piotr Dollár , Trevor Darrell , Bharath Hariharan

Hypergraphs provide a natural way of representing group relations, whose complexity motivates an extensive array of prior work to adopt some form of abstraction and simplification of higher-order interactions. However, the following…

Social and Information Networks · Computer Science 2020-05-14 Se-eun Yoon , Hyungseok Song , Kijung Shin , Yung Yi