English
Related papers

Related papers: Informative missingness and its implications in se…

200 papers

Semi-supervised learning (SSL) arises in practice when labeled data are scarce or expensive to obtain, while large quantities of unlabeled data are readily available. With the growing adoption of machine learning techniques, it has become…

Machine Learning · Statistics 2026-05-29 Jiawei Shan , Zhifeng Chen , Yiming Dong , Yazhen Wang , Jiwei Zhao

A common assumption in semi-supervised learning is that the labeled, unlabeled, and test data are drawn from the same distribution. However, this assumption is not satisfied in many applications. In many scenarios, the data is collected…

Information Theory · Computer Science 2022-02-25 Gholamali Aminian , Mahed Abroshan , Mohammad Mahdi Khalili , Laura Toni , Miguel R. D. Rodrigues

While semi-supervised learning (SSL) has proven to be a promising way for leveraging unlabeled data when labeled data is scarce, the existing SSL algorithms typically assume that training class distributions are balanced. However, these SSL…

Machine Learning · Computer Science 2021-09-14 Jaehyung Kim , Youngbum Hur , Sejun Park , Eunho Yang , Sung Ju Hwang , Jinwoo Shin

Semi-supervised learning (SSL) is an active area of research which aims to utilize unlabelled data in order to improve the accuracy of speech recognition systems. The current study proposes a methodology for integration of two key ideas: 1)…

Computation and Language · Computer Science 2020-08-11 Prakhar Swarup , Debmalya Chakrabarty , Ashtosh Sapru , Hitesh Tulsiani , Harish Arsikere , Sri Garimella

The paradigm of data programming, which uses weak supervision in the form of rules/labelling functions, and semi-supervised learning, which augments small amounts of labelled data with a large unlabelled dataset, have shown great promise in…

Machine Learning · Computer Science 2021-06-15 Ayush Maheshwari , Oishik Chatterjee , KrishnaTeja Killamsetty , Ganesh Ramakrishnan , Rishabh Iyer

What is the role of unlabeled data in an inference problem, when the presumed underlying distribution is adversarially perturbed? To provide a concrete answer to this question, this paper unifies two major learning frameworks:…

Machine Learning · Statistics 2019-05-31 Amir Najafi , Shin-ichi Maeda , Masanori Koyama , Takeru Miyato

Active learning (AL) combines data labeling and model training to minimize the labeling cost by prioritizing the selection of high value data that can best improve model performance. In pool-based active learning, accessible unlabeled data…

Machine Learning · Computer Science 2020-07-21 Mingfei Gao , Zizhao Zhang , Guo Yu , Sercan O. Arik , Larry S. Davis , Tomas Pfister

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

Many existing federated learning (FL) algorithms are designed for supervised learning tasks, assuming that the local data owned by the clients are well labeled. However, in many practical situations, it could be difficult and expensive to…

Machine Learning · Computer Science 2021-11-02 Zhiguo Wang , Xintong Wang , Ruoyu Sun , Tsung-Hui Chang

Learning algorithms normally assume that there is at most one annotation or label per data point. However, in some scenarios, such as medical diagnosis and on-line collaboration,multiple annotations may be available. In either case,…

Machine Learning · Computer Science 2012-03-19 Yan Yan , Romer Rosales , Glenn Fung , Jennifer Dy

Audio classification has seen great progress with the increasing availability of large-scale datasets. These large datasets, however, are often only partially labeled as collecting full annotations is a tedious and expensive process. This…

Sound · Computer Science 2021-11-29 Siddharth Gururani , Alexander Lerch

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

Machine Learning · Computer Science 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Learning with supervision has achieved remarkable success in numerous artificial intelligence (AI) applications. In the current literature, by referring to the properties of the labels prepared for the training dataset, learning with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Yongquan Yang

In this paper we revisit the idea of pseudo-labeling in the context of semi-supervised learning where a learning algorithm has access to a small set of labeled samples and a large set of unlabeled samples. Pseudo-labeling works by applying…

Machine Learning · Computer Science 2020-12-11 Paola Cascante-Bonilla , Fuwen Tan , Yanjun Qi , Vicente Ordonez

Localizing keypoints of an object is a basic visual problem. However, supervised learning of a keypoint localization network often requires a large amount of data, which is expensive and time-consuming to obtain. To remedy this, there is an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Can Wang , Sheng Jin , Yingda Guan , Wentao Liu , Chen Qian , Ping Luo , Wanli Ouyang

Annotating datasets is one of the main costs in nowadays supervised learning. The goal of weak supervision is to enable models to learn using only forms of labelling which are cheaper to collect, as partial labelling. This is a type of…

Machine Learning · Computer Science 2021-02-02 Vivien Cabannes , Alessandro Rudi , Francis Bach

A weakly-supervised learning framework named as complementary-label learning has been proposed recently, where each sample is equipped with a single complementary label that denotes one of the classes the sample does not belong to. However,…

Machine Learning · Statistics 2020-07-24 Yuzhou Cao , Shuqi Liu , Yitian Xu

The lack of labeled data is a major obstacle in many music information retrieval tasks such as melody extraction, where labeling is extremely laborious or costly. Semi-supervised learning (SSL) provides a solution to alleviate the issue by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-17 Sangeun Kum , Jing-Hua Lin , Li Su , Juhan Nam

Self-supervised learning (SSL) aims to find meaningful representations from unlabeled data by encoding semantic similarities through data augmentations. Despite its current popularity, theoretical insights about SSL are still scarce. For…

Machine Learning · Computer Science 2025-05-27 Maximilian Fleissner , Pascal Esser , Debarghya Ghoshdastidar