English
Related papers

Related papers: Augmented Contrastive Self-Supervised Learning for…

200 papers

Recently, deep learning has experienced rapid expansion, contributing significantly to the progress of supervised learning methodologies. However, acquiring labeled data in real-world settings can be costly, labor-intensive, and sometimes…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jicheng Yuan , Anh Le-Tuan , Ali Ganbarov , Manfred Hauswirth , Danh Le-Phuoc

Recent advances in supervised deep learning methods are enabling remote measurements of photoplethysmography-based physiological signals using facial videos. The performance of these supervised methods, however, are dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Hao Wang , Euijoon Ahn , Jinman Kim

Deep learning on graphs has recently achieved remarkable success on a variety of tasks, while such success relies heavily on the massive and carefully labeled data. However, precise annotations are generally very expensive and…

Machine Learning · Computer Science 2021-09-30 Lirong Wu , Haitao Lin , Zhangyang Gao , Cheng Tan , Stan. Z. Li

Self-supervised learning (SSL) has emerged as a promising solution for addressing the challenge of limited labeled data in deep neural networks (DNNs), offering scalability potential. However, the impact of design dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Shruthi Gowda , Elahe Arani , Bahram Zonooz

In this paper, we propose a new Self-Supervised Learning (SSL) algorithm called data2vec-aqc, for speech representation learning from unlabeled speech data. Our goal is to improve SSL for speech in domains where both unlabeled and labeled…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-16 Vasista Sai Lodagala , Sreyan Ghosh , S. Umesh

Recommender systems play a crucial role in tackling the challenge of information overload by delivering personalized recommendations based on individual user preferences. Deep learning techniques, such as RNNs, GNNs, and Transformer…

Information Retrieval · Computer Science 2025-12-16 Xubin Ren , Wei Wei , Lianghao Xia , Chao Huang

Jointly learning from a small labeled set and a larger unlabeled set is an active research topic under semi-supervised learning (SSL). In this paper, we propose a novel SSL method based on a two-stage framework for leveraging a large…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-26 Tanmay Khandelwal , Rohan Kumar Das , Andrew Koh , Eng Siong Chng

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

Information Retrieval · Computer Science 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

Machine Learning · Computer Science 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

This paper studies learning fair encoders in a self-supervised learning (SSL) setting, in which all data are unlabeled and only a small portion of them are annotated with sensitive attribute. Adversarial fair representation learning is well…

Machine Learning · Computer Science 2024-06-11 Qi Qi , Quanqi Hu , Qihang Lin , Tianbao Yang

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

Machine Learning · Computer Science 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

Recently, cross domain transfer has been applied for unsupervised image restoration tasks. However, directly applying existing frameworks would lead to domain-shift problems in translated images due to lack of effective supervision.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Wenchao Du , Hu Chen , Hongyu Yang

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Shentong Mo , Zhun Sun , Chao Li

This paper introduces a semi-supervised contrastive learning framework and its application to text-independent speaker verification. The proposed framework employs generalized contrastive loss (GCL). GCL unifies losses from two different…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-09 Nakamasa Inoue , Keita Goto

Speaker verification system trained on one domain usually suffers performance degradation when applied to another domain. To address this challenge, researchers commonly use feature distribution matching-based methods in unsupervised domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Wen Huang , Bing Han , Zhengyang Chen , Shuai Wang , Yanmin Qian

This paper addresses the persistent challenge in Keyword Spotting (KWS), a fundamental component in speech technology, regarding the acquisition of substantial labeled data for training. Given the difficulty in obtaining large quantities of…

Sound · Computer Science 2024-09-04 Weinan Dai , Yifeng Jiang , Yuanjing Liu , Jinkun Chen , Xin Sun , Jinglei Tao

In this paper, we introduce UnFuSeD, a novel approach to leverage self-supervised learning and reduce the need for large amounts of labeled data for audio classification. Unlike prior works, which directly fine-tune a self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-19 Ashish Seth , Sreyan Ghosh , S. Umesh , Dinesh Manocha

Unlabeled data learning has attracted considerable attention recently. However, it is still elusive to extract the expected high-level semantic feature with mere unsupervised learning. In the meantime, semi-supervised learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Tao Han , Junyu Gao , Yuan Yuan , Qi Wang

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow
‹ Prev 1 8 9 10 Next ›