English
Related papers

Related papers: Self-Supervised Learning for Data Scarcity in a Fa…

200 papers

Offline reinforcement learning (RL) aims to learn an optimal policy from pre-collected data. However, it faces challenges of distributional shift, where the learned policy may encounter unseen scenarios not covered in the offline data.…

Machine Learning · Computer Science 2025-05-27 Jin Zhu , Xin Zhou , Jiaang Yao , Gholamali Aminian , Omar Rivasplata , Simon Little , Lexin Li , Chengchun Shi

Stress is widely recognized as a major contributor to a variety of health issues. Stress prediction using biosignal data recorded by wearables is a key area of study in mobile sensing research because real-time stress prediction can enable…

Machine Learning · Computer Science 2023-08-14 Tanvir Islam , Peter Washington

Semi-supervised learning (SSL) is a class of supervised learning tasks and techniques that also exploits the unlabeled data for training. SSL significantly reduces labeling related costs and is able to handle large data sets. The primary…

Machine Learning · Computer Science 2016-06-30 Eftychios Protopapadakis

Semi-supervised learning lately has shown much promise in improving deep learning models when labeled data is scarce. Common among recent approaches is the use of consistency training on a large amount of unlabeled data to constrain model…

Machine Learning · Computer Science 2020-11-06 Qizhe Xie , Zihang Dai , Eduard Hovy , Minh-Thang Luong , Quoc V. Le

Labeling training examples at scale is a perennial challenge in machine learning. Self-supervision methods compensate for the lack of direct supervision by leveraging prior knowledge to automatically generate noisy labeled examples. Deep…

Machine Learning · Computer Science 2020-12-24 Hunter Lang , Hoifung Poon

Federated learning aims to tackle the ``isolated data island" problem, where it trains a collective model from physically isolated clients while safeguarding the privacy of users' data. However, supervised federated learning necessitates…

Artificial Intelligence · Computer Science 2024-04-18 Hao Yan , Yuhong Guo

Self-training is one of the earliest and simplest semi-supervised methods. The key idea is to augment the original labeled dataset with unlabeled data paired with the model's prediction (i.e. the pseudo-parallel data). While self-training…

Machine Learning · Computer Science 2020-10-20 Junxian He , Jiatao Gu , Jiajun Shen , Marc'Aurelio Ranzato

Active Learning (AL) and Semi-supervised Learning are two techniques that have been studied to reduce the high cost of deep learning by using a small amount of labeled data and a large amount of unlabeled data. To improve the accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Jaeseung Lim , Jongkeun Na , Nojun Kwak

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Although this paradigm uses unlabeled data in a task-agnostic way,…

Machine Learning · Computer Science 2020-10-27 Ting Chen , Simon Kornblith , Kevin Swersky , Mohammad Norouzi , Geoffrey Hinton

What is the role of unlabeled data in an inference problem, when the presumed underlying distribution is adversarially perturbed? To provide a concrete answer to this question, this paper unifies two major learning frameworks:…

Machine Learning · Statistics 2019-05-31 Amir Najafi , Shin-ichi Maeda , Masanori Koyama , Takeru Miyato

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

Multimodal learning, which aims to understand and analyze information from multiple modalities, has achieved substantial progress in the supervised regime in recent years. However, the heavy dependence on data paired with expensive human…

Machine Learning · Computer Science 2024-08-19 Yongshuo Zong , Oisin Mac Aodha , Timothy Hospedales

Deep networks are successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are usually much less suited for semi-supervised problems because of…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Nir Ailon

As acquiring manual labels on data could be costly, unsupervised domain adaptation (UDA), which transfers knowledge learned from a rich-label dataset to the unlabeled target dataset, is gaining increasing popularity. While extensive studies…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Wanqing Zhu , Jia-Li Yin , Bo-Hao Chen , Ximeng Liu

With the increasing computing power of edge devices, Federated Learning (FL) emerges to enable model training without privacy concerns. The majority of existing studies assume the data are fully labeled on the client side. In practice,…

Machine Learning · Computer Science 2022-05-31 Woojung Kim , Keondo Park , Kihyuk Sohn , Raphael Shu , Hyung-Sin Kim

In recent years, neural architecture-based recommender systems have achieved tremendous success, but they still fall short of expectation when dealing with highly sparse data. Self-supervised learning (SSL), as an emerging technique for…

Information Retrieval · Computer Science 2023-06-05 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Jundong Li , Zi Huang

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Self-Supervised Learning (SSL) is a valuable and robust training methodology for contemporary Deep Neural Networks (DNNs), enabling unsupervised pretraining on a 'pretext task' that does not require ground-truth labels/annotation. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sotirios Konstantakos , Jorgen Cani , Ioannis Mademlis , Despina Ioanna Chalkiadaki , Yuki M. Asano , Efstratios Gavves , Georgios Th. Papadopoulos

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe