English
Related papers

Related papers: Self-Supervised Representation Learning for Geospa…

200 papers

Learning visual representations through self-supervision is an extremely challenging task as the network needs to sieve relevant patterns from spurious distractors without the active guidance provided by supervision. This is achieved…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Fatemeh Saleh , Fuwen Tan , Adrian Bulat , Georgios Tzimiropoulos , Brais Martinez

Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-22 Melikasadat Emami , Dung Tran , Kazuhito Koishida

Self-supervised representation learning techniques utilize large datasets without semantic annotations to learn meaningful, universal features that can be conveniently transferred to solve a wide variety of downstream supervised tasks. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Swetava Ganguli , C. V. Krishnakumar Iyer , Vipul Pandey

Self-Supervised Learning (SSL) is an increasingly popular ML paradigm that trains models to transform complex inputs into representations without relying on explicit labels. These representations encode similarity structures that enable…

Machine Learning · Computer Science 2022-06-30 Adam Dziedzic , Nikita Dhawan , Muhammad Ahmad Kaleem , Jonas Guan , Nicolas Papernot

3D point clouds are a crucial type of data collected by LiDAR sensors and widely used in transportation applications due to its concise descriptions and accurate localization. Deep neural networks (DNNs) have achieved remarkable success in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Changyu Zeng , Wei Wang , Anh Nguyen , Yutao Yue

Recent Self-Supervised Learning (SSL) methods are able to learn feature representations that are invariant to different data augmentations, which can then be transferred to downstream tasks of interest. However, different downstream tasks…

Machine Learning · Computer Science 2023-03-08 Chen Huang , Hanlin Goh , Jiatao Gu , Josh Susskind

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

In defense-related remote sensing applications, such as vehicle detection on satellite imagery, supervised learning requires a huge number of labeled examples to reach operational performances. Such data are challenging to obtain as it…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Jules BOURCIER , Thomas Floquet , Gohar Dashyan , Tugdual Ceillier , Karteek Alahari , Jocelyn Chanussot

Self-supervised Learning (SSL) aims at learning representations of objects without relying on manual labeling. Recently, a number of SSL methods for graph representation learning have achieved performance comparable to SOTA semi-supervised…

Machine Learning · Computer Science 2021-08-25 Zekarias T. Kefato , Sarunas Girdzijauskas , Hannes Stärk

A major limitation in applying deep learning to artificial intelligence (AI) systems is the scarcity of high-quality curated datasets. We investigate strong augmentation based self-supervised learning (SSL) techniques to address this…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 John D. Miller , Vignesh A. Arasu , Albert X. Pu , Laurie R. Margolies , Weiva Sieh , Li Shen

We investigate the generalization of semi-supervised learning (SSL) to diverse pixel-wise tasks. Although SSL methods have achieved impressive results in image classification, the performances of applying them to pixel-wise tasks are…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Zhanghan Ke , Di Qiu , Kaican Li , Qiong Yan , Rynson W. H. Lau

Self-supervised learning (SSL) methods have become a dominant paradigm for creating general purpose models whose capabilities can be transferred to downstream supervised learning tasks. However, most such methods rely on vast amounts of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Lakshay Sharma , Alex Marin

3D-aware Generative Adversarial Networks (3D-GANs) currently exhibit artifacts in their 3D geometrical modeling, such as mesh imperfections and holes. These shortcomings are primarily attributed to the limited availability of annotated 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jiarong Guo , Xiaogang Xu , Hengshuang Zhao

Self-supervised learning (SSL) provides a promising alternative for representation learning on hypergraphs without costly labels. However, existing hypergraph SSL models are mostly based on contrastive methods with the instance-level…

Machine Learning · Computer Science 2024-04-19 Fan Li , Xiaoyang Wang , Dawei Cheng , Wenjie Zhang , Ying Zhang , Xuemin Lin

Supervised deep learning models depend on massive labeled data. Unfortunately, it is time-consuming and labor-intensive to collect and annotate bitemporal samples containing desired changes. Transfer learning from pre-trained models is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Hao Chen , Wenyuan Li , Song Chen , Zhenwei Shi

Localizing keypoints of an object is a basic visual problem. However, supervised learning of a keypoint localization network often requires a large amount of data, which is expensive and time-consuming to obtain. To remedy this, there is an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Can Wang , Sheng Jin , Yingda Guan , Wentao Liu , Chen Qian , Ping Luo , Wanli Ouyang

Semi-supervised learning (SSL) addresses the critical challenge of training accurate models when labeled data is scarce but unlabeled data is abundant. Graph-based SSL (GSSL) has emerged as a popular framework that captures data structure…

Machine Learning · Statistics 2026-02-10 Nadav Katz , Ariel Jaffe

Supervised learning methods have been found to exhibit inductive biases favoring simpler features. When such features are spuriously correlated with the label, this can result in suboptimal performance on minority subgroups. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Kimia Hamidieh , Haoran Zhang , Swami Sankaranarayanan , Marzyeh Ghassemi