English
Related papers

Related papers: Iterative self-transfer learning: A general method…

200 papers

Few-shot learning amounts to learning representations and acquiring knowledge such that novel tasks may be solved with both supervision and data being limited. Improved performance is possible by transductive inference, where the entire…

Machine Learning · Computer Science 2023-03-29 Michalis Lazarou , Tania Stathaki , Yannis Avrithis

Self-training is a standard approach to semi-supervised learning where the learner's own predictions on unlabeled data are used as supervision during training. In this paper, we reinterpret this label assignment process as an optimal…

Machine Learning · Computer Science 2021-06-15 Kai Sheng Tai , Peter Bailis , Gregory Valiant

We consider a novel data driven approach for designing learning algorithms that can effectively learn with only a small number of labeled examples. This is crucial for modern machine learning applications where labels are scarce or…

Machine Learning · Computer Science 2021-10-01 Maria-Florina Balcan , Dravyansh Sharma

A practical shortcoming of deep neural networks is their specialization to a single task and domain. While recent techniques in domain adaptation and multi-domain learning enable the learning of more domain-agnostic features, their success…

Machine Learning · Computer Science 2020-06-02 Lucas Deecke , Timothy Hospedales , Hakan Bilen

Training a good deep learning model requires substantial data and computing resources, which makes the resulting neural model a valuable intellectual property. To prevent the neural network from being undesirably exploited, non-transferable…

Computation and Language · Computer Science 2023-02-21 Guangtao Zeng , Wei Lu

We propose a new deep learning approach for medical imaging that copes with the problem of a small training set, the main bottleneck of deep learning, and apply it for classification of healthy and cancer cells acquired by quantitative…

Image and Video Processing · Electrical Eng. & Systems 2018-12-31 Moran Rubin , Omer Stein , Nir A. Turko , Yoav Nygate , Darina Roitshtain , Lidor Karako , Itay Barnea , Raja Giryes , Natan T. Shaked

Through deep learning and computer vision techniques, driving manoeuvres can be predicted accurately a few seconds in advance. Even though adapting a learned model to new drivers and different vehicles is key for robust driver-assistance…

Machine Learning · Computer Science 2019-03-12 Michele Tonutti , Emanuele Ruffaldi , Alessandro Cattaneo , Carlo Alberto Avizzano

Training deep neural networks (DNNs) is computationally expensive, which is problematic especially when performing duplicated or similar training runs in model ensemble or fine-tuning pre-trained models, for example. Once we have trained…

Machine Learning · Computer Science 2023-10-04 Daiki Chijiwa

Tabular data, structured as rows and columns, is among the most prevalent data types in machine learning classification and regression applications. Models for learning from tabular data have continuously evolved, with Deep Neural Networks…

Machine Learning · Computer Science 2025-04-24 Jun-Peng Jiang , Si-Yang Liu , Hao-Run Cai , Qile Zhou , Han-Jia Ye

Recent studies reveal that a deep neural network can learn transferable features which generalize well to novel tasks for domain adaptation. However, as deep features eventually transition from general to specific along the network, the…

Machine Learning · Computer Science 2015-05-28 Mingsheng Long , Yue Cao , Jianmin Wang , Michael I. Jordan

Transfer learning is a recent field of machine learning research that aims to resolve the challenge of dealing with insufficient training data in the domain of interest. This is a particular issue with traditional deep neural networks where…

Computer Vision and Pattern Recognition · Computer Science 2015-12-21 Mohammad Javad Shafiee , Parthipan Siva , Paul Fieguth , Alexander Wong

Deep learning methods have advanced quickly in brain imaging analysis over the past few years, but they are usually restricted by the limited labeled data. Pre-trained model on unlabeled data has presented promising improvement in feature…

Neurons and Cognition · Quantitative Biology 2024-08-22 Jinlong Hu , Yangmin Huang , Nan Wang , Shoubin Dong

Most uses of machine learning today involve training a model from scratch for a particular task, or sometimes starting with a model pretrained on a related task and then fine-tuning on a downstream task. Both approaches offer limited…

Machine Learning · Computer Science 2022-05-26 Andrea Gesmundo , Jeff Dean

This paper addresses the problem of transferring useful knowledge from a source network to predict node labels in a newly formed target network. While existing transfer learning research has primarily focused on vector-based data, in which…

Machine Learning · Computer Science 2016-11-15 Meng Fang , Jie Yin , Xingquan Zhu

Surrogate models provide efficient alternatives to computationally demanding real world processes but often require large datasets for effective training. A promising solution to this limitation is the transfer of pre-trained surrogate…

Machine Learning · Computer Science 2025-05-14 Shuaiqun Pan , Diederick Vermetten , Manuel López-Ibáñez , Thomas Bäck , Hao Wang

Recent deep learning-based methods outperform traditional learning methods on remote sensing (RS) semantic segmentation/classification tasks. However, they require large training datasets and are generally known for lack of transferability…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Rongjun Qin , Guixiang Zhang , Yang Tang

This paper provides a starting point for Software Engineering (SE) researchers and practitioners faced with the problem of training machine learning models on small datasets. Due to the high costs associated with labeling data, in Software…

Software Engineering · Computer Science 2021-06-30 Julian Aron Prenner , Romain Robbes

Self-supervised learning achieves superior performance in many domains by extracting useful representations from the unlabeled data. However, most of traditional self-supervised methods mainly focus on exploring the inter-sample structure…

Machine Learning · Computer Science 2020-11-30 Haoyi Fan , Fengbin Zhang , Yue Gao

Re-training a deep learning model each time a single data point receives a new label is impractical due to the inherent complexity of the training process. Consequently, existing active learning (AL) algorithms tend to adopt a batch-based…

Machine Learning · Computer Science 2023-12-19 Yunpyo An , Suyeong Park , Kwang In Kim

We propose a novel GAN training scheme that can handle any level of labeling in a unified manner. Our scheme introduces a form of artificial labeling that can incorporate manually defined labels, when available, and induce an alignment…

Machine Learning · Computer Science 2021-06-21 Tomoki Watanabe , Paolo Favaro