English
Related papers

Related papers: The Hidden Uniform Cluster Prior in Self-Supervise…

200 papers

In supervised deep learning, learning good representations for remote--sensing images (RSI) relies on manual annotations. However, in the area of remote sensing, it is hard to obtain huge amounts of labeled data. Recently, self--supervised…

Machine Learning · Computer Science 2022-09-27 Qinglin Li , Bin Li , Jonathan M Garibaldi , Guoping Qiu

This paper presents a new multitask learning framework that learns a shared representation among the tasks, incorporating both task and feature clusters. The jointly-induced clusters yield a shared latent subspace where task relationships…

Machine Learning · Statistics 2017-03-06 Keerthiram Murugesan , Jaime Carbonell , Yiming Yang

Recent Self-Supervised Learning (SSL) methods are able to learn feature representations that are invariant to different data augmentations, which can then be transferred to downstream tasks of interest. However, different downstream tasks…

Machine Learning · Computer Science 2023-03-08 Chen Huang , Hanlin Goh , Jiatao Gu , Josh Susskind

Multi-view subspace clustering aims to discover the inherent structure of data by fusing multiple views of complementary information. Most existing methods first extract multiple types of handcrafted features and then learn a joint affinity…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Pengfei Zhu , Xinjie Yao , Yu Wang , Binyuan Hui , Dawei Du , Qinghua Hu

In the 21st-century information age, with the development of big data technology, effectively extracting valuable information from massive data has become a key issue. Traditional data mining methods are inadequate when faced with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Aoran Shen , Minghao Dai , Jiacheng Hu , Yingbin Liang , Shiru Wang , Junliang Du

Supervised (pre-)training currently yields state-of-the-art performance for representation learning for visual recognition, yet it comes at the cost of (1) intensive manual annotations and (2) an inherent restriction in the scope of data…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Ruohan Gao , Dinesh Jayaraman , Kristen Grauman

In the context of mobile sensing environments, various sensors on mobile devices continually generate a vast amount of data. Analyzing this ever-increasing data presents several challenges, including limited access to annotated data and a…

Machine Learning · Computer Science 2023-05-02 Jason Liu , Shohreh Deldari , Hao Xue , Van Nguyen , Flora D. Salim

Self-supervised learning is a promising unsupervised learning framework that has achieved success with large floating point networks. But such networks are not readily deployable to edge devices. To accelerate deployment of models with the…

Machine Learning · Computer Science 2022-03-30 Dahyun Kim , Jonghyun Choi

The lack of labeled data is a major obstacle to learning high-quality sentence embeddings. Recently, self-supervised contrastive learning (SCL) is regarded as a promising way to address this problem. However, the existing works mainly rely…

Computation and Language · Computer Science 2022-03-01 Junhan Yang , Zheng Liu , Shitao Xiao , Jianxun Lian , Lijun Wu , Defu Lian , Guangzhong Sun , Xing Xie

This work investigates the unexplored usability of self-supervised representation learning in the direction of functional knowledge transfer. In this work, functional knowledge transfer is achieved by joint optimization of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Prakash Chandra Chhipa , Muskaan Chopra , Gopal Mengi , Varun Gupta , Richa Upadhyay , Meenakshi Subhash Chippa , Kanjar De , Rajkumar Saini , Seiichi Uchida , Marcus Liwicki

Self-supervised learning, which benefits from automatically constructing labels through pre-designed pretext task, has recently been applied for strengthen supervised learning. Since previous self-supervised pretext tasks are based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Zilin Ding , Yuhang Yang , Xuan Cheng , Xiaomin Wang , Ming Liu

Deep neural networks have gained tremendous success in a broad range of machine learning tasks due to its remarkable capability to learn semantic-rich features from high-dimensional data. However, they often require large-scale labelled…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hu Wang , Guansong Pang , Chunhua Shen , Congbo Ma

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

In this paper, we tackle the problem of learning visual representations from unlabeled scene-centric data. Existing works have demonstrated the potential of utilizing the underlying complex structure within scene-centric data; still, they…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xin Wen , Bingchen Zhao , Anlin Zheng , Xiangyu Zhang , Xiaojuan Qi

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

Machine Learning · Computer Science 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

Semi-Supervised Learning (SSL) has been proved to be an effective way to leverage both labeled and unlabeled data at the same time. Recent semi-supervised approaches focus on deep neural networks and have achieved promising results on…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Hong-Yu Zhou , Avital Oliver , Jianxin Wu , Yefeng Zheng

A learning classifier must outperform a trivial solution, in case of imbalanced data, this condition usually does not hold true. To overcome this problem, we propose a novel data level resampling method - Clustering Based Oversampling for…

Machine Learning · Computer Science 2018-11-13 Naman D. Singh , Abhinav Dhall

The collection and curation of large-scale medical datasets from multiple institutions is essential for training accurate deep learning models, but privacy concerns often hinder data sharing. Federated learning (FL) is a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Rui Yan , Liangqiong Qu , Qingyue Wei , Shih-Cheng Huang , Liyue Shen , Daniel Rubin , Lei Xing , Yuyin Zhou

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

Machine Learning · Computer Science 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu