English
Related papers

Related papers: MatSSL: Robust Self-Supervised Representation Lear…

200 papers

The ability to generate online maps using only onboard sensory information is crucial for enabling autonomous driving beyond well-mapped areas. Training models for this task -- predicting lane markers, road edges, and pedestrian crossings…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Adam Lilja , Erik Wallin , Junsheng Fu , Lars Hammarstrand

Densely annotating LiDAR point clouds is costly, which restrains the scalability of fully-supervised learning methods. In this work, we study the underexplored semi-supervised learning (SSL) in LiDAR segmentation. Our core idea is to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Lingdong Kong , Jiawei Ren , Liang Pan , Ziwei Liu

Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, prior work in SSL focuses on tasks like object recognition or detection, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Donghyun Kim , Kuniaki Saito , Samarth Mishra , Stan Sclaroff , Kate Saenko , Bryan A Plummer

The rapid advancement in self-supervised representation learning has highlighted its potential to leverage unlabeled data for learning rich visual representations. However, the existing techniques, particularly those employing different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Sana Ayromlou , Vahid Reza Khazaie , Fereshteh Forghani , Arash Afkanpour

Self-Supervised learning (SSL) has become the new state-of-art in several domain classification and segmentation tasks. Of these, one popular category in SSL is distillation networks such as BYOL. This work proposes RSDnet, which applies…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Pallavi Jain , Bianca Schoen-Phelan , Robert Ross

We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is…

Machine Learning · Computer Science 2021-03-16 Masato Ishii

Synthetic Aperture Sonar (SAS) imaging has become a crucial technology for underwater exploration because of its unique ability to maintain resolution at increasing ranges, a characteristic absent in conventional sonar techniques. However,…

Signal Processing · Electrical Eng. & Systems 2023-08-24 Brandon Sheffield , Frank E. Bobe , Bradley Marchand , Matthew S. Emigh

Semi-supervised learning (SSL) has garnered significant attention due to its ability to leverage limited labeled data and a large amount of unlabeled data to improve model generalization performance. Recent approaches achieve impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Bo Cheng , Jueqing Lu , Yuan Tian , Haifeng Zhao , Yi Chang , Lan Du

Semi-supervised learning (SSL) algorithms struggle to perform well when exposed to imbalanced training data. In this scenario, the generated pseudo-labels can exhibit a bias towards the majority class, and models that employ these…

Machine Learning · Computer Science 2024-09-18 Zeju Li , Ying-Qiu Zheng , Chen Chen , Saad Jbabdi

It is well known that the success of deep neural networks is greatly attributed to large-scale labeled datasets. However, it can be extremely time-consuming and laborious to collect sufficient high-quality labeled data in most practical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Yao Yao , Junyi Shen , Jin Xu , Bin Zhong , Li Xiao

Automated segmentation of multiple sclerosis (MS) lesions from MRI scans is important to quantify disease progression. In recent years, convolutional neural networks (CNNs) have shown top performance for this task when a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Jiacheng Wang , Hao Li , Han Liu , Dewei Hu , Daiwei Lu , Keejin Yoon , Kelsey Barter , Francesca Bagnato , Ipek Oguz

State-of-the-art deep learning models are often trained with a large amount of costly labeled training data. However, requiring exhaustive manual annotations may degrade the model's generalizability in the limited-label regime.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yanbei Chen , Massimiliano Mancini , Xiatian Zhu , Zeynep Akata

Automatic histopathology image segmentation is crucial to disease analysis. Limited available labeled data hinders the generalizability of trained models under the fully supervised setting. Semi-supervised learning (SSL) based on generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Hongxiao Wang , Hao Zheng , Jianxu Chen , Lin Yang , Yizhe Zhang , Danny Z. Chen

Accurate anomaly detection is critical in vision-based infrastructure inspection, where it helps prevent costly failures and enhances safety. Self-Supervised Learning (SSL) offers a promising approach by learning robust representations from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Daniel Otero , Rafael Mateus , Randall Balestriero

The core issue in semi-supervised learning (SSL) lies in how to effectively leverage unlabeled data, whereas most existing methods tend to put a great emphasis on the utilization of high-confidence samples yet seldom fully explore the usage…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Yue Duan , Zhen Zhao , Lei Qi , Lei Wang , Luping Zhou , Yinghuan Shi , Yang Gao

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-22 Melikasadat Emami , Dung Tran , Kazuhito Koishida

Unsupervised machine learning offers significant opportunities for extracting knowledge from unlabeled data sets and for achieving maximum machine learning performance. This paper demonstrates how to construct, use, and evaluate a high…

Materials Science · Physics 2021-04-13 Ryan Cohn , Elizabeth Holm

We consider the task of self-supervised representation learning (SSL) for tabular data: tabular-SSL. Typical contrastive learning based SSL methods require instance-wise data augmentations which are difficult to design for unstructured…

Machine Learning · Computer Science 2022-06-20 Kushal Majmundar , Sachin Goyal , Praneeth Netrapalli , Prateek Jain

Medical imaging has witnessed remarkable progress but usually requires a large amount of high-quality annotated data which is time-consuming and costly to obtain. To alleviate this burden, semi-supervised learning has garnered attention as…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Qingyue Wei , Lequan Yu , Xianhang Li , Wei Shao , Cihang Xie , Lei Xing , Yuyin Zhou