English
Related papers

Related papers: TriNet: stabilizing self-supervised learning from …

200 papers

Active Learning (AL) and Semi-supervised Learning are two techniques that have been studied to reduce the high cost of deep learning by using a small amount of labeled data and a large amount of unlabeled data. To improve the accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Jaeseung Lim , Jongkeun Na , Nojun Kwak

In this paper, we propose a new Self-Supervised Learning (SSL) algorithm called data2vec-aqc, for speech representation learning from unlabeled speech data. Our goal is to improve SSL for speech in domains where both unlabeled and labeled…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-16 Vasista Sai Lodagala , Sreyan Ghosh , S. Umesh

With the success of self-supervised learning (SSL), it has become a mainstream paradigm to fine-tune from self-supervised pretrained models to boost the performance on downstream tasks. However, we find that current SSL models suffer severe…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Yun-Hao Cao , Peiqin Sun , Yechang Huang , Jianxin Wu , Shuchang Zhou

In this work, we are dedicated to leveraging the BERT pre-training success and modeling the domain-specific statistics to fertilize the sign language recognition~(SLR) model. Considering the dominance of hand and body in sign language…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Weichao Zhao , Hezhen Hu , Wengang Zhou , Jiaxin Shi , Houqiang Li

Deep learning models, e.g. supervised Encoder-Decoder style networks, exhibit promising performance in medical image segmentation, but come with a high labelling cost. We propose TriSegNet, a semi-supervised semantic segmentation framework.…

Image and Video Processing · Electrical Eng. & Systems 2022-08-15 Ziyang Wang , Irina Voiculescu

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jorge Quesada , Ghassan AlRegib

Deep learning based semi-supervised learning (SSL) algorithms have led to promising results in recent years. However, they tend to introduce multiple tunable hyper-parameters, making them less practical in real SSL scenarios where the…

Machine Learning · Computer Science 2024-10-30 Yulin Wang , Jiayi Guo , Shiji Song , Gao Huang

3D medical image segmentation methods have been successful, but their dependence on large amounts of voxel-level annotated data is a disadvantage that needs to be addressed given the high cost to obtain such annotation. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yuyuan Liu , Yu Tian , Chong Wang , Yuanhong Chen , Fengbei Liu , Vasileios Belagiannis , Gustavo Carneiro

To improve instance-level detection/segmentation performance, existing self-supervised and semi-supervised methods extract either task-unrelated or task-specific training signals from unlabeled data. We show that these two approaches, at…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Lu Qi , Jason Kuen , Zhe Lin , Jiuxiang Gu , Fengyun Rao , Dian Li , Weidong Guo , Zhen Wen , Ming-Hsuan Yang , Jiaya Jia

Semi-supervised learning (SSL) has witnessed remarkable progress, resulting in the emergence of numerous method variations. However, practitioners often encounter challenges when attempting to deploy these methods due to their subpar…

Machine Learning · Computer Science 2024-05-21 Kai Gan , Tong Wei

Confidence-based pseudo-labeling is among the dominant approaches in semi-supervised learning (SSL). It relies on including high-confidence predictions made on unlabeled data as additional targets to train the model. We propose ProtoCon, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Islam Nassar , Munawar Hayat , Ehsan Abbasnejad , Hamid Rezatofighi , Gholamreza Haffari

Most self-supervised learning (SSL) methods learn continuous visual representations by aligning different views of the same input, offering limited control over how information is structured across representation dimensions. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Kawtar Zaher , Ilyass Moummad , Olivier Buisson , Alexis Joly

Recent advances in domain adaptation show that deep self-training presents a powerful means for unsupervised domain adaptation. These methods often involve an iterative process of predicting on target domain and then taking the confident…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Yang Zou , Zhiding Yu , Xiaofeng Liu , B. V. K. Vijaya Kumar , Jinsong Wang

Recent progress in self-supervised (SSL) visual representation learning has led to the development of several different proposed frameworks that rely on augmentations of images but use different loss functions. However, there are few…

Machine Learning · Computer Science 2025-01-20 Kumar Krishna Agrawal , Arna Ghosh , Shagun Sodhani , Adam Oberman , Blake Richards

Self-supervised learning (SSL) has recently advanced through non-contrastive methods that couple an invariance term with variance, covariance, or redundancy-reduction penalties. While such objectives shape first- and second-order statistics…

Machine Learning · Computer Science 2026-05-18 Benyamin Ghojogh , M. Hadi Sepanj , Paul Fieguth

Deep learning models trained in a supervised setting have revolutionized audio and speech processing. However, their performance inherently depends on the quantity of human-annotated data, making them costly to scale and prone to poor…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Theo Lepage , Reda Dehak

Self-supervised learning (SSL) to learn high-level speech representations has been a popular approach to building Automatic Speech Recognition (ASR) systems in low-resource settings. However, the common assumption made in literature is that…

Computation and Language · Computer Science 2023-05-19 Ashish Seth , Lodagala V S V Durga Prasad , Sreyan Ghosh , S. Umesh

In this paper, we apply Semi-Supervised Learning (SSL) along with Data Augmentation (DA) for improving the accuracy of End-to-End ASR. We focus on the consistency regularization principle, which has been successfully applied to image…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Felix Weninger , Franco Mana , Roberto Gemello , Jesús Andrés-Ferrer , Puming Zhan

The development of semi-supervised learning (SSL) has in recent years largely focused on the development of new consistency regularization or entropy minimization approaches, often resulting in models with complex training strategies to…

Machine Learning · Computer Science 2025-07-01 Durgesh Singh , Ahcene Boubekki , Robert Jenssen , Michael C. Kampffmeyer

Self-supervised learning (SSL) is the latest breakthrough in speech processing, especially for label-scarce downstream tasks by leveraging massive unlabeled audio data. The noise robustness of the SSL is one of the important challenges to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-25 Hiroshi Sato , Ryo Masumura , Tsubasa Ochiai , Marc Delcroix , Takafumi Moriya , Takanori Ashihara , Kentaro Shinayama , Saki Mizuno , Mana Ihori , Tomohiro Tanaka , Nobukatsu Hojo