English
Related papers

Related papers: Semi-supervised deep learning by metric embedding

200 papers

Semi-supervised few-shot learning consists in training a classifier to adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Many sophisticated methods have been developed to address the challenges this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xiu-Shen Wei , He-Yang Xu , Faen Zhang , Yuxin Peng , Wei Zhou

Pre-trained word embeddings learned from unlabeled text have become a standard component of neural network architectures for NLP tasks. However, in most cases, the recurrent network that operates on word-level representations to produce…

Computation and Language · Computer Science 2017-05-02 Matthew E. Peters , Waleed Ammar , Chandra Bhagavatula , Russell Power

Self-supervised metric learning has been a successful approach for learning a distance from an unlabeled dataset. The resulting distance is broadly useful for improving various distance-based downstream tasks, even when no information from…

Machine Learning · Statistics 2022-03-18 Shulei Wang

In this paper, we study the problem of semi-supervised image recognition, which is to learn classifiers using both labeled and unlabeled images. We present Deep Co-Training, a deep learning based method inspired by the Co-Training…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Siyuan Qiao , Wei Shen , Zhishuai Zhang , Bo Wang , Alan Yuille

A straightforward application of semi-supervised machine learning to the problem of treatment effect estimation would be to consider data as "unlabeled" if treatment assignment and covariates are observed but outcomes are unobserved.…

Methodology · Statistics 2020-09-15 Andrew Herren , P. Richard Hahn

In this paper we revisit the idea of pseudo-labeling in the context of semi-supervised learning where a learning algorithm has access to a small set of labeled samples and a large set of unlabeled samples. Pseudo-labeling works by applying…

Machine Learning · Computer Science 2020-12-11 Paola Cascante-Bonilla , Fuwen Tan , Yanjun Qi , Vicente Ordonez

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Self-training, a semi-supervised learning algorithm, leverages a large amount of unlabeled data to improve learning when the labeled data are limited. Despite empirical successes, its theoretical characterization remains elusive. To the…

Machine Learning · Computer Science 2022-02-15 Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Deep convolutional neural networks are widely used in medical image segmentation but require many labeled images for training. Annotating three-dimensional medical images is a time-consuming and costly process. To overcome this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Weiyi Xie , Nathalie Willems , Nikolas Lessmann , Tom Gibbons , Daniele De Massari

Transductive graph-based semi-supervised learning methods usually build an undirected graph utilizing both labeled and unlabeled samples as vertices. Those methods propagate label information of labeled samples to neighbors through their…

Machine Learning · Computer Science 2013-12-25 Fengqi Li , Chuang Yu , Nanhai Yang , Feng Xia , Guangming Li , Fatemeh Kaveh-Yazdy

Parameter prediction is essential for many applications, facilitating insightful interpretation and decision-making. However, in many real life domains, such as power systems, medicine, and engineering, it can be very expensive to acquire…

Machine Learning · Computer Science 2024-02-16 Zimeng Lyu , Alexander Ororbia , Rui Li , Travis Desell

Semi-supervised learning leverages unlabeled data to enhance model performance, addressing the limitations of fully supervised approaches. Among its strategies, pseudo-supervision has proven highly effective, typically relying on one or…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Negin Ghamsarian , Sahar Nasirihaghighi , Klaus Schoeffmann , Raphael Sznitman

In this paper, we propose a semi-supervised deep learning method for detecting the specific types of reads that impede the de novo genome assembly process. Instead of dealing directly with sequenced reads, we analyze their coverage graphs…

Machine Learning · Computer Science 2019-04-24 Tomislav Šebrek , Jan Tomljanović , Josip Krapac , Mile Šikić

One of the greatest obstacles in the adoption of deep neural networks for new applications is that training the network typically requires a large number of manually labeled training samples. We empirically investigate the scenario where…

Machine Learning · Computer Science 2020-04-09 Leslie N. Smith , Adam Conovaloff

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Large amounts of labeled data are typically required to train deep learning models. For many real-world problems, however, acquiring additional data can be expensive or even impossible. We present semi-supervised deep kernel learning…

Machine Learning · Computer Science 2019-03-05 Neal Jean , Sang Michael Xie , Stefano Ermon

Semi-supervised learning (SSL) alleviates the cost of data labeling process by exploiting unlabeled data and has achieved promising results. Meanwhile, with the development of large foundation models, exploiting pre-trained models becomes a…

Machine Learning · Computer Science 2025-10-28 Song-Lin Lv , Rui Zhu , Tong Wei , Yu-Feng Li , Lan-Zhe Guo

We propose to address the issue of sample efficiency, in Deep Convolutional Neural Networks (DCNN), with a semi-supervised training strategy that combines Hebbian learning with gradient descent: all internal layers (both convolutional and…

Neural and Evolutionary Computing · Computer Science 2021-09-21 Gabriele Lagani , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Due to abundance of data from multiple modalities, cross-modal retrieval tasks with image-text, audio-image, etc. are gaining increasing importance. Of the different approaches proposed, supervised methods usually give significant…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Devraj Mandal , Pramod Rao , Soma Biswas

The implementation of deep learning based computer aided diagnosis systems for the classification of mammogram images can help in improving the accuracy, reliability, and cost of diagnosing patients. However, training a deep learning model…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Saul Calderon-Ramirez , Diego Murillo-Hernandez , Kevin Rojas-Salazar , David Elizondo , Shengxiang Yang , Miguel Molina-Cabello