English
Related papers

Related papers: Geometry-Aware Contrastive Learning for Few-Shot A…

200 papers

Self-supervised learning (SSL) has become prevalent for learning representations in computer vision. Notably, SSL exploits contrastive learning to encourage visual representations to be invariant under various image transformations. The…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Swati Jindal , Roberto Manduchi

Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentations per instance (more than two) improve generalization in…

Deep neural networks have been widely studied in autonomous driving applications such as semantic segmentation or depth estimation. However, training a neural network in a supervised manner requires a large amount of annotated labels which…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Dongseok Shim , H. Jin Kim

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Recently, deep end-to-end learning has been studied for intent classification in Spoken Language Understanding (SLU). However, end-to-end models require a large amount of speech data with intent labels, and highly optimized models are…

Computation and Language · Computer Science 2024-05-27 Suyoung Kim , Jiyeon Hwang , Ho-Young Jung

Conventional Graph Contrastive Learning (GCL) on Text-Attributed Graphs (TAGs) relies on blind stochastic augmentations, inadvertently entangling task-relevant signals with noise. We propose SDM-SCR, a robust framework anchored in…

Artificial Intelligence · Computer Science 2026-04-17 Zhaoxing Li , Hai-Feng Zhang , Xiaoming Zhang

Self-supervised learning (SSL) is a method that learns the data representation by utilizing supervision inherent in the data. This learning method is in the spotlight in the drug field, lacking annotated data due to time-consuming and…

Biomolecules · Quantitative Biology 2022-08-19 Kisung Moon , Sunyoung Kwon

Human action recognition (HAR) with multi-modal inputs (RGB-D, skeleton, point cloud) can achieve high accuracy but typically relies on large labeled datasets and degrades sharply when sensors fail or are noisy. We present Robust…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Hasan Akgul , Mari Eplik , Javier Rojas , Akira Yamamoto , Rajesh Kumar , Maya Singh

Self-supervised learning (SSL) is a powerful technique for learning from unlabeled data. By learning to remain invariant to applied data augmentations, methods such as SimCLR and MoCo can reach quality on par with supervised approaches.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Marcin Przewięźlikowski , Mateusz Pyla , Bartosz Zieliński , Bartłomiej Twardowski , Jacek Tabor , Marek Śmieja

Hyperspectral images with high spectral resolution provide new insights into recognizing subtle differences in similar substances. However, object detection in hyperspectral images faces significant challenges in intra- and inter-class…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Xiao He , Chang Tang , Xinwang Liu , Wei Zhang , Zhimin Gao , Chuankun Li , Shaohua Qiu , Jiangfeng Xu

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

Machine Learning · Computer Science 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

One-stage object detectors such as the YOLO family achieve state-of-the-art performance in real-time vision applications but remain heavily reliant on large-scale labeled datasets for training. In this work, we present a systematic study of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Manikanta Kotthapalli , Reshma Bhatia , Nainsi Jain

In this paper, we introduce a novel method designed to enhance label efficiency in satellite imagery analysis by integrating semi-supervised learning (SSL) with active learning strategies. Our approach utilizes contrastive learning together…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 David Pogorzelski , Peter Arlinghaus , Wenyan Zhang

Graph representation learning (GRL) makes considerable progress recently, which encodes graphs with topological structures into low-dimensional embeddings. Meanwhile, the time-consuming and costly process of annotating graph labels manually…

Machine Learning · Computer Science 2024-02-28 Haojun Jiang , Jiawei Sun , Jie Li , Chentao Wu

Consistency regularization has prevailed in semi-supervised semantic segmentation and achieved promising performance. However, existing methods typically concentrate on enhancing the Image-augmentation based Prediction consistency and…

Multimedia · Computer Science 2025-03-25 Jianjian Yin , Tao Chen , Gensheng Pei , Yazhou Yao , Liqiang Nie , Xiansheng Hua

Recent advances in neural radiation fields (NeRF) and 3D Gaussian-based SLAM have achieved impressive localization accuracy and high-quality dense mapping in static scenes. However, these methods remain challenged in dynamic environments,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Wenhua Wu , Chenpeng Su , Siting Zhu , Tianchen Deng , Jianhao Jiao , Guangming Wang , Dimitrios Kanoulas , Zhe Liu , Hesheng Wang

While self-supervised representation learning (SSL) has received widespread attention from the community, recent research argue that its performance will suffer a cliff fall when the model size decreases. The current method mainly relies on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yuting Gao , Jia-Xin Zhuang , Shaohui Lin , Hao Cheng , Xing Sun , Ke Li , Chunhua Shen

Most recent self-supervised learning methods learn visual representation by contrasting different augmented views of images. Compared with supervised learning, more aggressive augmentations have been introduced to further improve the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yingbin Bai , Erkun Yang , Zhaoqing Wang , Yuxuan Du , Bo Han , Cheng Deng , Dadong Wang , Tongliang Liu

3D-aware Generative Adversarial Networks (3D-GANs) currently exhibit artifacts in their 3D geometrical modeling, such as mesh imperfections and holes. These shortcomings are primarily attributed to the limited availability of annotated 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jiarong Guo , Xiaogang Xu , Hengshuang Zhao

Contrastive learning has been proven beneficial for self-supervised skeleton-based action recognition. Most contrastive learning methods utilize carefully designed augmentations to generate different movement patterns of skeletons for the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jiahang Zhang , Lilang Lin , Jiaying Liu