English
Related papers

Related papers: Revolutionizing Wireless Networks with Self-Superv…

200 papers

In recent years, speech-based self-supervised learning (SSL) has made significant progress in various tasks, including automatic speech recognition (ASR). An ASR model with decent performance can be realized by fine-tuning an SSL model with…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-30 Zhisheng Zheng , Ziyang Ma , Yu Wang , Xie Chen

State-of-the-art deep learning models are often trained with a large amount of costly labeled training data. However, requiring exhaustive manual annotations may degrade the model's generalizability in the limited-label regime.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yanbei Chen , Massimiliano Mancini , Xiatian Zhu , Zeynep Akata

Federated Learning allows the training of machine learning models by using the computation and private data resources of many distributed clients. Most existing results on Federated Learning (FL) assume the clients have ground-truth labels.…

Machine Learning · Computer Science 2022-10-12 Enmao Diao , Jie Ding , Vahid Tarokh

Self-supervised learning (SSL) has emerged as a promising paradigm in medical imaging, addressing the chronic challenge of limited labeled data in healthcare settings. While SSL has shown impressive results, existing studies in the medical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Valay Bundele , Karahan Sarıtaş , Bora Kargi , Oğuz Ata Çal , Kıvanç Tezören , Zohreh Ghaderi , Hendrik Lensch

Keyword Spotting (KWS) models are becoming increasingly integrated into various systems, e.g. voice assistants. To achieve satisfactory performance, these models typically rely on a large amount of labelled data, limiting their applications…

Sound · Computer Science 2023-05-25 Holger Severin Bovbjerg , Zheng-Hua Tan

In recent years, semi-supervised learning (SSL) has gained significant attention due to its ability to leverage both labeled and unlabeled data to improve model performance, especially when labeled data is scarce. However, most current SSL…

Machine Learning · Computer Science 2024-05-06 Marzi Heidari , Hanping Zhang , Yuhong Guo

Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and reinforcement learning approaches are ill suited…

Robotics · Computer Science 2024-10-18 Ankit Shaw

Despite the impressive progress of self-supervised learning (SSL), its applicability to low-compute networks has received limited attention. Reported performance has trailed behind standard supervised pre-training by a large margin, barring…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Fuwen Tan , Fatemeh Saleh , Brais Martinez

Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective…

Machine Learning · Computer Science 2024-12-06 Mingyuan Zhou , Xudong Jian , Ye Xia , Zhilu Lai

In recent years, semi-supervised learning (SSL) has shown tremendous success in leveraging unlabeled data to improve the performance of deep learning models, which significantly reduces the demand for large amounts of labeled data. Many SSL…

Machine Learning · Computer Science 2020-06-02 Song-Bo Yang , Tian-li Yu

Artificial intelligence (AI) powered wireless networks promise to revolutionize the conventional operation and structure of current networks from network design to infrastructure management, cost reduction, and user performance improvement.…

Information Theory · Computer Science 2020-05-05 Ursula Challita , Henrik A. Ryden , Hugo Tullberg

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

Next-generation wireless networks must support ultra-reliable, low-latency communication and intelligently manage a massive number of Internet of Things (IoT) devices in real-time, within a highly dynamic environment. This need for…

Information Theory · Computer Science 2019-07-02 Mingzhe Chen , Ursula Challita , Walid Saad , Changchuan Yin , Mérouane Debbah

The anticipated integration of large artificial intelligence (AI) models with wireless communications is estimated to usher a transformative wave in the forthcoming information age. As wireless networks grow in complexity, the traditional…

Information Theory · Computer Science 2026-01-13 Chong Huang , Gaojie Chen , Pei Xiao , Zhu Han , Rahim Tafazolli

Learning with supervision has achieved remarkable success in numerous artificial intelligence (AI) applications. In the current literature, by referring to the properties of the labels prepared for the training dataset, learning with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Yongquan Yang

We present a general methodology for using unlabeled data to design semi supervised learning (SSL) variants of the Empirical Risk Minimization (ERM) learning process. Focusing on generalized linear regression, we analyze of the…

Machine Learning · Statistics 2022-03-08 Oren Yuval , Saharon Rosset

Semi-supervised learning (SSL) methods effectively leverage unlabeled data to improve model generalization. However, SSL models often underperform in open-set scenarios, where unlabeled data contain outliers from novel categories that do…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Yue Fan , Anna Kukleva , Dengxin Dai , Bernt Schiele

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Detecting medical conditions from speech acoustics is fundamentally a weakly-supervised learning problem: a single, often noisy, session-level label must be linked to nuanced patterns within a long, complex audio recording. This task is…

Sound · Computer Science 2026-04-21 Xingyuan Li , Mengyue Wu

This vision paper addresses the research challenges of integrating traditional signal processing with Artificial Intelligence (AI) to enable energy-efficient, programmable, and scalable wireless connectivity infrastructures. While prior…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Haris Gacanin