English
Related papers

Related papers: Avoiding Your Teacher's Mistakes: Training Neural …

200 papers

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Xinzhe Li , Qianru Sun , Yaoyao Liu , Shibao Zheng , Qin Zhou , Tat-Seng Chua , Bernt Schiele

Neural abstractive summarization methods often require large quantities of labeled training data. However, labeling large amounts of summarization data is often prohibitive due to time, financial, and expertise constraints, which has…

Computation and Language · Computer Science 2022-02-09 Junnan Liu , Qianren Mao , Bang Liu , Hao Peng , Hongdong Zhu , Jianxin Li

Annotating the dataset with high-quality labels is crucial for performance of deep network, but in real world scenarios, the labels are often contaminated by noise. To address this, some methods were proposed to automatically split clean…

Machine Learning · Computer Science 2022-12-20 Daehwan Kim , Kwangrok Ryoo , Hansang Cho , Seungryong Kim

Improving a semi-supervised image segmentation task has the option of adding more unlabelled images, labelling the unlabelled images or combining both, as neither image acquisition nor expert labelling can be considered trivial in most…

Image and Video Processing · Electrical Eng. & Systems 2019-08-23 Yunguan Fu , Maria R. Robu , Bongjin Koo , Crispin Schneider , Stijn van Laarhoven , Danail Stoyanov , Brian Davidson , Matthew J. Clarkson , Yipeng Hu

Semi-supervised learning (SSL) has proven to be effective at leveraging large-scale unlabeled data to mitigate the dependency on labeled data in order to learn better models for visual recognition and classification tasks. However, recent…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Hasib Zunair , Yan Gobeil , Samuel Mercier , A. Ben Hamza

Semi-supervised learning lately has shown much promise in improving deep learning models when labeled data is scarce. Common among recent approaches is the use of consistency training on a large amount of unlabeled data to constrain model…

Machine Learning · Computer Science 2020-11-06 Qizhe Xie , Zihang Dai , Eduard Hovy , Minh-Thang Luong , Quoc V. Le

There has been a growing concern about the fairness of decision-making systems based on machine learning. The shortage of labeled data has been always a challenging problem facing machine learning based systems. In such scenarios,…

Machine Learning · Computer Science 2020-01-01 Vahid Noroozi , Sara Bahaadini , Samira Sheikhi , Nooshin Mojab , Philip S. Yu

When data is generated by multiple sources, conventional training methods update models assuming equal reliability for each source and do not consider their individual data quality. However, in many applications, sources have varied levels…

Machine Learning · Computer Science 2025-02-17 Alexander Capstick , Francesca Palermo , Tianyu Cui , Payam Barnaghi

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Yangdi Lu , Wenbo He

Semi-supervised learning methods are motivated by the availability of large datasets with unlabeled features in addition to labeled data. Unlabeled data is, however, not guaranteed to improve classification performance and has in fact been…

Machine Learning · Statistics 2019-10-25 Xiuming Liu , Dave Zachariah , Johan Wågberg , Thomas B. Schön

Recent semi-supervised learning methods have shown to achieve comparable results to their supervised counterparts while using only a small portion of labels in image classification tasks thanks to their regularization strategies. In this…

Machine Learning · Computer Science 2020-09-25 Wei-Hong Li , Chuan-Sheng Foo , Hakan Bilen

Semi-supervised learning frameworks usually adopt mutual learning approaches with multiple submodels to learn from different perspectives. To avoid transferring erroneous pseudo labels between these submodels, a high threshold is usually…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Hao Xu , Hui Xiao , Huazheng Hao , Li Dong , Xiaojie Qiu , Chengbin Peng

While convolutional neural networks need large labeled sets for training images, expert human supervision of such datasets can be very laborious. Proposed solutions propagate labels from a small set of supervised images to a large set of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Barbara Caroline Benato , Jancarlo Ferreira Gomes , Alexandru Cristian Telea , Alexandre Xavier Falcão

Self-training is a classical approach in semi-supervised learning which is successfully applied to a variety of machine learning problems. Self-training algorithm generates pseudo-labels for the unlabeled examples and progressively refines…

Machine Learning · Computer Science 2020-06-22 Samet Oymak , Talha Cihad Gulcu

The limited availability of ground truth relevance labels has been a major impediment to the application of supervised methods to ad-hoc retrieval. As a result, unsupervised scoring methods, such as BM25, remain strong competitors to deep…

Information Retrieval · Computer Science 2019-07-23 Dany Haddad , Joydeep Ghosh

In many machine learning applications, labeled data is scarce and obtaining more labels is expensive. We introduce a new approach to supervising neural networks by specifying constraints that should hold over the output space, rather than…

Artificial Intelligence · Computer Science 2016-09-20 Russell Stewart , Stefano Ermon

Graph Neural Networks (GNNs) have been widely applied in the semi-supervised node classification task, where a key point lies in how to sufficiently leverage the limited but valuable label information. Most of the classical GNNs solely use…

Machine Learning · Computer Science 2022-12-26 Le Yu , Leilei Sun , Bowen Du , Tongyu Zhu , Weifeng Lv

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervised learning have…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan

Semi- and weakly-supervised learning have recently attracted considerable attention in the object detection literature since they can alleviate the cost of annotation needed to successfully train deep learning models. State-of-art…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Akhil Meethal , Marco Pedersoli , Zhongwen Zhu , Francisco Perdigon Romero , Eric Granger

Neural networks have been successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are more difficult to train successfully for semi-supervised…

Machine Learning · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer