English
Related papers

Related papers: Online Semi-Supervised Learning on Quantized Graph…

200 papers

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

In this paper, we propose a novel graph-based approach for semi-supervised learning problems, which considers an adaptive adjacency of the examples throughout the unsupervised portion of the training. Adjacency of the examples is inferred…

Machine Learning · Computer Science 2020-08-06 Ozsel Kilinc , Ismail Uysal

This paper looks at semi-supervised learning (SSL) for image-based text recognition. One of the most popular SSL approaches is pseudo-labeling (PL). PL approaches assign labels to unlabeled data before re-training the model with a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Gaurav Patel , Jan Allebach , Qiang Qiu

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Self-supervised learning (SSL) has empirically shown its data representation learnability in many downstream tasks. There are only a few theoretical works on data representation learnability, and many of those focus on final data…

Machine Learning · Computer Science 2024-01-09 Ruofeng Yang , Xiangyuan Li , Bo Jiang , Shuai Li

Deep Learning is often depicted as a trio of data-architecture-loss. Yet, recent Self Supervised Learning (SSL) solutions have introduced numerous additional design choices, e.g., a projector network, positive views, or teacher-student…

Machine Learning · Computer Science 2024-06-18 Mark Ibrahim , David Klindt , Randall Balestriero

Recently, self-supervised learning (SSL) has achieved tremendous success in learning image representation. Despite the empirical success, most self-supervised learning methods are rather "inefficient" learners, typically taking hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shengbang Tong , Yubei Chen , Yi Ma , Yann Lecun

Semi-Supervised Learning (SSL) algorithms have shown great potential in training regimes when access to labeled data is scarce but access to unlabeled data is plentiful. However, our experiments illustrate several shortcomings that prior…

Machine Learning · Computer Science 2019-12-19 Varun Nair , Javier Fuentes Alonso , Tony Beltramelli

In recent decades, science and engineering have been revolutionized by a momentous growth in the amount of available data. However, despite the unprecedented ease with which data are now collected and stored, labeling data by supplementing…

Machine Learning · Statistics 2022-07-05 Nicolas García Trillos , Daniel Sanz-Alonso , Ruiyi Yang

In this work, we propose a simple yet effective meta-learning algorithm in semi-supervised learning. We notice that most existing consistency-based approaches suffer from overfitting and limited model generalization ability, especially when…

Machine Learning · Computer Science 2021-03-18 Xin-Yu Zhang , Taihong Xiao , Haolin Jia , Ming-Ming Cheng , Ming-Hsuan Yang

This paper introduces a novel approach to improving the training stability of self-supervised learning (SSL) methods by leveraging a non-parametric memory of seen concepts. The proposed method involves augmenting a neural network with a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

Graph-based semi-supervised learning is one of the most popular methods in machine learning. Some of its theoretical properties such as bounds for the generalization error and the convergence of the graph Laplacian regularizer have been…

Machine Learning · Statistics 2019-04-12 Chengan Du , Yunpeng Zhao , Feng Wang

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

The success of deep learning notoriously requires larger amounts of costly annotated data. This has led to the development of self-supervised learning (SSL) that aims to alleviate this limitation by creating domain specific pretext tasks on…

Machine Learning · Computer Science 2020-06-19 Wei Jin , Tyler Derr , Haochen Liu , Yiqi Wang , Suhang Wang , Zitao Liu , Jiliang Tang

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

We investigate the generalization of semi-supervised learning (SSL) to diverse pixel-wise tasks. Although SSL methods have achieved impressive results in image classification, the performances of applying them to pixel-wise tasks are…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Zhanghan Ke , Di Qiu , Kaican Li , Qiong Yan , Rynson W. H. Lau

Self-supervised learning (SSL) has recently achieved tremendous empirical advancements in learning image representation. However, our understanding of the principle behind learning such a representation is still limited. This work shows…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Yubei Chen , Adrien Bardes , Zengyi Li , Yann LeCun

In this work we address graph based semi-supervised learning using the theory of the spatial segregation of competitive systems. First, we define a discrete counterpart over connected graphs by using direct analogue of the corresponding…

Numerical Analysis · Mathematics 2022-11-30 Farid Bozorgnia , Morteza Fotouhi , Avetik Arakelyan , Abderrahim Elmoataz

Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and reinforcement learning approaches are ill suited…

Robotics · Computer Science 2024-10-18 Ankit Shaw

Generative Adversarial Networks (GANs) based semi-supervised learning (SSL) approaches are shown to improve classification performance by utilizing a large number of unlabeled samples in conjunction with limited labeled samples. However,…

Machine Learning · Computer Science 2020-09-16 Zexi Chen , Bharathkumar Ramachandra , Ranga Raju Vatsavai