English
Related papers

Related papers: Semi-supervised learning by search of optimal targ…

200 papers

In this paper, we propose a new wrapper feature selection approach with partially labeled training examples where unlabeled observations are pseudo-labeled using the predictions of an initial classifier trained on the labeled training set.…

Machine Learning · Computer Science 2020-03-11 Vasilii Feofanov , Emilie Devijver , Massih-Reza Amini

We introduce the notion of optimal target vector, and describe how it creates a link between supervised and unsupervised learning. We exploit this notion to construct Ising models, for dichotomic clustering, whose couplings are (i) both…

Disordered Systems and Neural Networks · Physics 2009-11-11 Leonardo Angelini , Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

We address the problems of multi-domain and single-domain regression based on distinct and unpaired labeled training sets for each of the domains and a large unlabeled training set from all domains. We formulate these problems as a Bayesian…

Machine Learning · Statistics 2012-03-21 Tomer Michaeli , Yonina C. Eldar , Guillermo Sapiro

In the 21st-century information age, with the development of big data technology, effectively extracting valuable information from massive data has become a key issue. Traditional data mining methods are inadequate when faced with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Aoran Shen , Minghao Dai , Jiacheng Hu , Yingbin Liang , Shiru Wang , Junliang Du

We propose and analyze a method for semi-supervised learning from partially-labeled network-structured data. Our approach is based on a graph signal recovery interpretation under a clustering hypothesis that labels of data points belonging…

Machine Learning · Computer Science 2020-01-08 Alexander Jung , Alfred O. Hero , Alexandru Mara , Saeed Jahromi , Ayelet Heimowitz , Yonina C. Eldar

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

In this work, we propose a simple yet effective meta-learning algorithm in semi-supervised learning. We notice that most existing consistency-based approaches suffer from overfitting and limited model generalization ability, especially when…

Machine Learning · Computer Science 2021-03-18 Xin-Yu Zhang , Taihong Xiao , Haolin Jia , Ming-Ming Cheng , Ming-Hsuan Yang

This paper considers semi-supervised learning for tabular data. It is widely known that Xgboost based on tree model works well on the heterogeneous features while transductive support vector machine can exploit the low density separation…

Machine Learning · Computer Science 2020-06-09 Zhiguo Wang , Liusha Yang , Feng Yin , Ke Lin , Qingjiang Shi , Zhi-Quan Luo

Self-training is an effective approach to semi-supervised learning. The key idea is to let the learner itself iteratively generate "pseudo-supervision" for unlabeled instances based on its current hypothesis. In combination with consistency…

Machine Learning · Statistics 2021-11-05 Julian Lienen , Eyke Hüllermeier

We propose a method for semi-supervised semantic segmentation using an adversarial network. While most existing discriminators are trained to classify input images as real or fake on the image level, we design a discriminator in a fully…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Wei-Chih Hung , Yi-Hsuan Tsai , Yan-Ting Liou , Yen-Yu Lin , Ming-Hsuan Yang

A key challenge for machine intelligence is to learn new visual concepts without forgetting the previously acquired knowledge. Continual learning is aimed towards addressing this challenge. However, there is a gap between existing…

Machine Learning · Computer Science 2024-02-01 Yan Luo , Yongkang Wong , Mohan Kankanhalli , Qi Zhao

In this paper, Kernel PCA is reinterpreted as the solution to a convex optimization problem. Actually, there is a constrained convex problem for each principal component, so that the constraints guarantee that the principal component is…

Machine Learning · Computer Science 2017-10-25 Carlos M. Alaíz , Michaël Fanuel , Johan A. K. Suykens

Semi-supervised learning (SSL) is an important theme in machine learning, in which we have a few labeled samples and many unlabeled samples. In this paper, for SSL in a regression problem, we consider a method of incorporating information…

Machine Learning · Computer Science 2024-11-20 Katsuyuki Hagiwara

Neural networks have been successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are more difficult to train successfully for semi-supervised…

Machine Learning · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Recent studies have shown that the benefits provided by self-supervised pre-training and self-training (pseudo-labeling) are complementary. Semi-supervised fine-tuning strategies under the pre-training framework, however, remain…

Sound · Computer Science 2022-06-28 Bowen Zhang , Songjun Cao , Xiaoming Zhang , Yike Zhang , Long Ma , Takahiro Shinozaki

We delve into the challenge of semi-supervised node classification on the Contextual Stochastic Block Model (CSBM) dataset. Here, nodes from the two-cluster Stochastic Block Model (SBM) are coupled with feature vectors, which are derived…

Machine Learning · Computer Science 2024-12-19 Hai-Xiao Wang , Zhichao Wang

Due to the growing ubiquity of unlabeled data, learning with unlabeled data is attracting increasing attention in machine learning. In this paper, we propose a novel semi-supervised kernel learning method which can seamlessly combine…

Machine Learning · Computer Science 2012-03-19 Qi Mao , Ivor W. Tsang

The available data in semi-supervised learning usually consists of relatively small sized labeled data and much larger sized unlabeled data. How to effectively exploit unlabeled data is the key issue. In this paper, we write the regression…

Methodology · Statistics 2024-11-13 Ziwen Gao , Huihang Liu , Xinyu Zhang

Semisupervised learning is a learning standard which deals with the study of how computers and natural systems such as human beings acquire knowledge in the presence of both labeled and unlabeled data. Semisupervised learning based methods…

Machine Learning · Computer Science 2014-02-20 V. Jothi Prakash , Dr. L. M. Nithya

Compared to supervised learning, semi-supervised learning reduces the dependence of deep learning on a large number of labeled samples. In this work, we use a small number of labeled samples and perform data augmentation on unlabeled…

Machine Learning · Computer Science 2020-01-14 Qiuyu Zhu , Tiantian Li