English
Related papers

Related papers: Unlabeled Data Help: Minimax Analysis and Adversar…

200 papers

Semi-Supervised Learning (SSL) has been proved to be an effective way to leverage both labeled and unlabeled data at the same time. Recent semi-supervised approaches focus on deep neural networks and have achieved promising results on…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Hong-Yu Zhou , Avital Oliver , Jianxin Wu , Yefeng Zheng

Class-agnostic motion prediction methods aim to comprehend motion within open-world scenarios, holding significance for autonomous driving systems. However, training a high-performance model in a fully-supervised manner always requires…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Kewei Wang , Yizheng Wu , Zhiyu Pan , Xingyi Li , Ke Xian , Zhe Wang , Zhiguo Cao , Guosheng Lin

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Semi-supervised learning (SSL) is an important theme in machine learning, in which we have a few labeled samples and many unlabeled samples. In this paper, for SSL in a regression problem, we consider a method of incorporating information…

Machine Learning · Computer Science 2024-11-20 Katsuyuki Hagiwara

We study the data-generating mechanism for reconstructive SSL to shed light on its effectiveness. With an infinite amount of labeled samples, we provide a sufficient and necessary condition for perfect linear approximation. The condition…

Machine Learning · Statistics 2024-05-29 Kang Du , Yu Xiang

Contrastive learning (CL) has recently emerged as an alternative to traditional supervised machine learning solutions by enabling rich representations from unstructured and unlabeled data. However, CL and, more broadly, self-supervised…

Machine Learning · Computer Science 2025-07-10 Roberto Pereira , Fernanda Famá , Asal Rangrazi , Marco Miozzo , Charalampos Kalalas , Paolo Dini

Natural Language Inference (NLI) or Recognizing Textual Entailment (RTE) aims at predicting the relation between a pair of sentences (premise and hypothesis) as entailment, contradiction or semantic independence. Although deep learning…

Computation and Language · Computer Science 2022-11-08 Mobashir Sadat , Cornelia Caragea

Machine learning, satellites or local sensors are key factors for a sustainable and resource-saving optimisation of agriculture and proved its values for the management of agricultural land. Up to now, the main focus was on the enlargement…

Machine Learning · Computer Science 2022-04-06 Michael L. Marszalek , Bertrand Le Saux , Pierre-Philippe Mathieu , Artur Nowakowski , Daniel Springer

To address semi-supervised learning from both labeled and unlabeled data, we present a novel meta-learning scheme. We particularly consider that labeled and unlabeled data share disjoint ground truth label sets, which can be seen tasks like…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Yun-Chun Chen , Chao-Te Chou , Yu-Chiang Frank Wang

Existing semi-supervised learning (SSL) methods assume that labeled and unlabeled data share the same class space. However, in real-world applications, unlabeled data always contain classes not present in the labeled set, which may cause…

Machine Learning · Computer Science 2024-01-17 Wenjuan Xi , Xin Song , Weili Guo , Yang Yang

Existing semi-supervised learning (SSL) algorithms typically assume class-balanced datasets, although the class distributions of many real-world datasets are imbalanced. In general, classifiers trained on a class-imbalanced dataset are…

Machine Learning · Computer Science 2021-10-22 Hyuck Lee , Seungjae Shin , Heeyoung Kim

Semi-supervised learning (SSL) is one of the dominant approaches to address the annotation bottleneck of supervised learning. Recent SSL methods can effectively leverage a large repository of unlabeled data to improve performance while…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

Large amounts of labeled data are typically required to train deep learning models. For many real-world problems, however, acquiring additional data can be expensive or even impossible. We present semi-supervised deep kernel learning…

Machine Learning · Computer Science 2019-03-05 Neal Jean , Sang Michael Xie , Stefano Ermon

With the rapid proliferation of mobile devices and data, next-generation wireless communication systems face stringent requirements for ultra-low latency, ultra-high reliability, and massive connectivity. Traditional AI-driven wireless…

Signal Processing · Electrical Eng. & Systems 2024-06-12 Zhixiang Yang , Hongyang Du , Dusit Niyato , Xudong Wang , Yu Zhou , Lei Feng , Fanqin Zhou , Wenjing Li , Xuesong Qiu

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yun-Hao Cao , Jianxin Wu

Semi-supervised learning (SSL) uses unlabeled data to improve the performance of machine learning models when labeled data is scarce. However, its real-world applications often face the label distribution mismatch problem, in which the…

Machine Learning · Computer Science 2025-08-05 Jinsoo Bae , Seoung Bum Kim , Hyungrok Do

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

Machine Learning · Computer Science 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

Self-Supervised Learning (SSL) using huge unlabeled data has been successfully explored for image and natural language processing. Recent works also investigated SSL from speech. They were notably successful to improve performance on…

Semi-supervised learning is a powerful technique for leveraging unlabeled data to improve machine learning models, but it can be affected by the presence of ``informative'' labels, which occur when some classes are more likely to be labeled…

Machine Learning · Statistics 2023-02-16 Aude Sportisse , Hugo Schmutz , Olivier Humbert , Charles Bouveyron , Pierre-Alexandre Mattei