English
Related papers

Related papers: Joint Data and Feature Augmentation for Self-Super…

200 papers

One-class recognition is traditionally approached either as a representation learning problem or a feature modeling problem. In this work, we argue that both of these approaches have their own limitations; and a more effective solution can…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Pramuditha Perera , Vishal Patel

Benefiting from the effectiveness of graph neural networks (GNNs) and contrastive learning, GNN-based contrastive learning has become mainstream for knowledge-aware recommendation. However, most existing contrastive learning-based methods…

Information Retrieval · Computer Science 2025-05-14 Shengyin Sun , Chen Ma

Federated learning enables collaborative training of deep learning models across institutions without sharing sensitive patient data. However, its performance is often limited by small datasets and non-independent, identically distributed…

Image and Video Processing · Electrical Eng. & Systems 2026-04-17 Hongyi Pan , Ziliang Hong , Gorkem Durak , Ziyue Xu , Ulas Bagci

Pre-training has become a standard paradigm in many computer vision tasks. However, most of the methods are generally designed on the RGB image domain. Due to the discrepancy between the two-dimensional image plane and the three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Zhenyu Li , Zehui Chen , Ang Li , Liangji Fang , Qinhong Jiang , Xianming Liu , Junjun Jiang , Bolei Zhou , Hang Zhao

One of the most promising approaches for unsupervised learning is combining deep representation learning and deep clustering. Some recent works propose to simultaneously learn representation using deep neural networks and perform clustering…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Mina Rezaei , Emilio Dorigatti , David Ruegamer , Bernd Bischl

Most deep learning-based point cloud processing methods are supervised and require large scale of labeled data. However, manual labeling of point cloud data is laborious and time-consuming. Self-supervised representation learning can…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xin Cao , Huan Xia , Xinxin Han , Yifan Wang , Kang Li , Linzhi Su

Self-supervised learning (SSL) has the potential to benefit many applications, particularly those where manually annotating data is cumbersome. One such situation is the semantic segmentation of point clouds. In this context, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yanhao Wu , Tong Zhang , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

Contrastive learning has recently demonstrated great potential for unsupervised pre-training in 3D scene understanding tasks. However, most existing work randomly selects point features as anchors while building contrast, leading to a clear…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Kangcheng Liu , Xinhu Zheng , Chaoqun Wang , Kai Tang , Ming Liu , Baoquan Chen

Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learning has witnessed…

Machine Learning · Computer Science 2024-05-01 Wei Cui , Rasa Hosseinzadeh , Junwei Ma , Tongzi Wu , Yi Sui , Keyvan Golestan

Data augmentation aims to generate new and synthetic features from the original data, which can identify a better representation of data and improve the performance and generalizability of downstream tasks. However, data augmentation for…

Machine Learning · Computer Science 2021-06-17 Zhengzheng Tang , Ziyue Qiao , Xuehai Hong , Yang Wang , Fayaz Ali Dharejo , Yuanchun Zhou , Yi Du

Graph contrastive learning (GCL) has emerged as an effective tool for learning unsupervised representations of graphs. The key idea is to maximize the agreement between two augmented views of each graph via data augmentation. Existing GCL…

Machine Learning · Computer Science 2022-09-16 Xin Zhang , Qiaoyu Tan , Xiao Huang , Bo Li

Augmentation techniques and sampling strategies are crucial in contrastive learning, but in most existing works, augmentation techniques require careful design, and their sampling strategies can only capture a small amount of intrinsic…

Machine Learning · Computer Science 2023-07-28 Yixian Ma , Kun Zhan

Self-supervised representation learning has shown remarkable success in a number of domains. A common practice is to perform data augmentation via hand-crafted transformations intended to leave the semantics of the data invariant. We seek…

In this paper, we investigate the research problem of unsupervised multi-view feature selection. Conventional solutions first simply combine multiple pre-constructed view-specific similarity structures into a collaborative similarity…

Information Retrieval · Computer Science 2019-04-26 Xiao Dong , Lei Zhu , Xuemeng Song , Jingjing Li , Zhiyong Cheng

Completing the whole 3D structure based on an incomplete point cloud is a challenging task, particularly when the residual point cloud lacks typical structural characteristics. Recent methods based on cross-modal learning attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Hongye Hou , Liu Zhan , Yang Yang

This work presents a novel domain adaption paradigm for studying contrastive self-supervised representation learning and knowledge transfer using remote sensing satellite data. Major state-of-the-art remote sensing visual domain efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Muskaan Chopra , Prakash Chandra Chhipa , Gopal Mengi , Varun Gupta , Marcus Liwicki

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao

In the domain of recommendation and collaborative filtering, Graph Contrastive Learning (GCL) has become an influential approach. Nevertheless, the reasons for the effectiveness of contrastive learning are still not well understood. In this…

Information Retrieval · Computer Science 2024-10-01 Chengkai Liu , Jianling Wang , James Caverlee

Supervised learning-based adversarial attack detection methods rely on a large number of labeled data and suffer significant performance degradation when applying the trained model to new domains. In this paper, we propose a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yi Li , Plamen Angelov , Neeraj Suri

Graph contrastive learning (GCL) has emerged as a dominant technique for graph representation learning which maximizes the mutual information between paired graph augmentations that share the same semantics. Unfortunately, it is difficult…

Machine Learning · Computer Science 2023-03-21 Jun Xia , Lirong Wu , Jintao Chen , Bozhen Hu , Stan Z. Li