English
Related papers

Related papers: Revolutionizing Wireless Networks with Self-Superv…

200 papers

Artificial intelligence (AI) and machine learning (ML) are nowadays mature technologies considered essential for driving the evolution of future communications systems. Simultaneously, Wi-Fi technology has constantly evolved over the past…

Networking and Internet Architecture · Computer Science 2024-09-02 Francesc Wilhelmi , Szymon Szott , Katarzyna Kosek-Szott , Boris Bellalta

Self-supervised learning (SSL) algorithms have emerged as powerful tools that can leverage large quantities of unlabeled audio data to pre-train robust representations that support strong performance on diverse downstream tasks. Up to now…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-05 Mattson Ogg

The fifth generation (5G) of wireless communication is in its infancy, and its evolving versions will be launched over the coming years. However, according to exposing the inherent constraints of 5G and the emerging applications and…

Networking and Internet Architecture · Computer Science 2020-10-07 Md. Jalil Piran , Doug Young Suh

Deep learning based semi-supervised learning (SSL) algorithms have led to promising results in recent years. However, they tend to introduce multiple tunable hyper-parameters, making them less practical in real SSL scenarios where the…

Machine Learning · Computer Science 2024-10-30 Yulin Wang , Jiayi Guo , Shiji Song , Gao Huang

The recent proposed self-supervised learning (SSL) approaches successfully demonstrate the great potential of supplementing learning algorithms with additional unlabeled data. However, it is still unclear whether the existing SSL algorithms…

Machine Learning · Statistics 2022-02-16 Yue Xing , Qifan Song , Guang Cheng

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Foundation models (FMs), powered by self-supervised learning (SSL), have redefined the capabilities of artificial intelligence, demonstrating exceptional performance in domains like natural language processing and computer vision. These…

Machine Learning · Computer Science 2025-06-23 Hamdi Altaheri , Fakhri Karray , Md. Milon Islam , S M Taslim Uddin Raju , Amir-Hossein Karimi

Advances in deep learning are re-defining how visual data is processed and understand by the machines. Vision Transformers (ViTs) have recently demonstrated prominent performance in computer vision related tasks. However, their performance…

Clustered Federated Multitask Learning (CFL) has gained considerable attention as an effective strategy for overcoming statistical challenges, particularly when dealing with non independent and identically distributed (non IID) data across…

Networking and Internet Architecture · Computer Science 2024-01-22 Moqbel Hamood , Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha

The advent of next-generation wireless communication systems heralds an era characterized by high data rates, low latency, massive connectivity, and superior energy efficiency. These systems necessitate innovative and adaptive strategies…

Signal Processing · Electrical Eng. & Systems 2024-08-07 Wei Huo , Huiwen Yang , Nachuan Yang , Zhaohua Yang , Jiuzhou Zhang , Fuhai Nan , Xingzhou Chen , Yifan Mao , Suyang Hu , Pengyu Wang , Xuanyu Zheng , Mingming Zhao , Ling Shi

We focus on developing a novel scalable graph-based semi-supervised learning (SSL) method for a small number of labeled data and a large amount of unlabeled data. Due to the lack of labeled data and the availability of large-scale unlabeled…

Machine Learning · Computer Science 2019-12-06 Zitong Wang , Li Wang , Raymond Chan , Tieyong Zeng

Self-supervised learning (SSL), which utilizes the input data itself for representation learning, has achieved state-of-the-art results for various downstream speech tasks. However, most of the previous studies focused on offline…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-11 Zili Huang , Zhuo Chen , Naoyuki Kanda , Jian Wu , Yiming Wang , Jinyu Li , Takuya Yoshioka , Xiaofei Wang , Peidong Wang

Keyword Spotting (KWS) is a critical aspect of audio-based applications on mobile devices and virtual assistants. Recent developments in Federated Learning (FL) have significantly expanded the ability to train machine learning models by…

Machine Learning · Computer Science 2023-05-10 Enmao Diao , Eric W. Tramel , Jie Ding , Tao Zhang

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

Self-supervised learning (SSL) is a growing torrent that has recently transformed machine learning and its many real world applications, by learning on massive amounts of unlabeled data via self-generated supervisory signals. Unsupervised…

Machine Learning · Computer Science 2023-08-29 Leman Akoglu , Jaemin Yoo

Developing generalizable models that can effectively learn from limited data and with minimal reliance on human supervision is a significant objective within the machine learning community, particularly in the era of deep neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Wenxuan Ma , Shuang Li , Lincan Cai , Jingxuan Kang

As a key technique for enabling artificial intelligence, machine learning (ML) is capable of solving complex problems without explicit programming. Motivated by its successful applications to many practical tasks like image recognition,…

Networking and Internet Architecture · Computer Science 2019-03-04 Yaohua Sun , Mugen Peng , Yangcheng Zhou , Yuzhe Huang , Shiwen Mao

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

Prior works have shown that semi-supervised learning algorithms can leverage unlabeled data to improve over the labeled sample complexity of supervised learning (SL) algorithms. However, existing theoretical analyses focus on regimes where…

Machine Learning · Computer Science 2023-12-01 Alexandru Ţifrea , Gizem Yüce , Amartya Sanyal , Fanny Yang

With the great success of artificial intelligence (AI) technologies in pattern recognitions and signal processing, it is interesting to introduce AI technologies into wireless communication systems. Currently, most of studies are focused on…

Networking and Internet Architecture · Computer Science 2018-09-18 Xiaohu Ge