English
Related papers

Related papers: Semi-Supervised Learning Enabled by Multiscale Dee…

200 papers

Deep convolutional neural networks (CNNs) have demonstrated remarkable success in computer vision by supervisedly learning strong visual feature representations. However, training CNNs relies heavily on the availability of exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Jiabo Huang , Qi Dong , Shaogang Gong , Xiatian Zhu

Deep Convolutional Neural Networks (CNN) enforces supervised information only at the output layer, and hidden layers are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Zhuolin Jiang , Yaming Wang , Larry Davis , Walt Andrews , Viktor Rozgic

We propose to address the issue of sample efficiency, in Deep Convolutional Neural Networks (DCNN), with a semi-supervised training strategy that combines Hebbian learning with gradient descent: all internal layers (both convolutional and…

Neural and Evolutionary Computing · Computer Science 2021-09-21 Gabriele Lagani , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Recent advancements in semi-supervised deep learning have introduced effective strategies for leveraging both labeled and unlabeled data to improve classification performance. This work proposes a semi-supervised framework that utilizes a…

Machine Learning · Computer Science 2025-05-21 Aydin Abedinia , Shima Tabakhi , Vahid Seydi

Deep neural networks achieve remarkable performances on a wide range of tasks with the aid of large-scale labeled datasets. Yet these datasets are time-consuming and labor-exhaustive to obtain on realistic tasks. To mitigate the requirement…

Machine Learning · Computer Science 2022-11-10 Baixu Chen , Junguang Jiang , Ximei Wang , Pengfei Wan , Jianmin Wang , Mingsheng Long

For many practical problems and applications, it is not feasible to create a vast and accurately labeled dataset, which restricts the application of deep learning in many areas. Semi-supervised learning algorithms intend to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Mert Kayhan , Okan Köpüklü , Mhd Hasan Sarhan , Mehmet Yigitsoy , Abouzar Eslami , Gerhard Rigoll

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

Machine Learning · Computer Science 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick

While convolutional neural networks need large labeled sets for training images, expert human supervision of such datasets can be very laborious. Proposed solutions propagate labels from a small set of supervised images to a large set of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Barbara Caroline Benato , Jancarlo Ferreira Gomes , Alexandru Cristian Telea , Alexandre Xavier Falcão

Recent semi-supervised learning methods have shown to achieve comparable results to their supervised counterparts while using only a small portion of labels in image classification tasks thanks to their regularization strategies. In this…

Machine Learning · Computer Science 2020-09-25 Wei-Hong Li , Chuan-Sheng Foo , Hakan Bilen

A significant issue in training deep neural networks to solve supervised learning tasks is the need for large numbers of labelled datapoints. The goal of semi-supervised learning is to leverage ubiquitous unlabelled data, together with…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Chengxu Zhuang , Xuehao Ding , Divyanshu Murli , Daniel Yamins

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

Machine Learning · Computer Science 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

Machine Learning · Computer Science 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

Semi-supervised learning holds great promise for many real-world applications, due to its ability to leverage both unlabeled and expensive labeled data. However, most semi-supervised learning algorithms still heavily rely on the limited…

Machine Learning · Computer Science 2023-12-29 Huiling Qin , Xianyuan Zhan , Yuanxun Li , Yu Zheng

Reaching the performance of fully supervised learning with unlabeled data and only labeling one sample per class might be ideal for deep learning applications. We demonstrate for the first time the potential for building one-shot…

Machine Learning · Computer Science 2021-01-27 Leslie N. Smith , Adam Conovaloff

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Large-scale labeled data are generally required to train deep neural networks in order to obtain better performance in visual feature learning from images or videos for computer vision applications. To avoid extensive cost of collecting and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Longlong Jing , Yingli Tian

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to…

Machine Learning · Computer Science 2020-07-03 Huanru Henry Mao

Deep learning based semi-supervised learning (SSL) algorithms have led to promising results in recent years. However, they tend to introduce multiple tunable hyper-parameters, making them less practical in real SSL scenarios where the…

Machine Learning · Computer Science 2024-10-30 Yulin Wang , Jiayi Guo , Shiji Song , Gao Huang

In semi-supervised learning for classification, it is assumed that every ground truth class of data is present in the small labelled dataset. Many real-world sparsely-labelled datasets are plausibly not of this type. It could easily be the…

Machine Learning · Statistics 2021-01-11 Matthew Willetts , Stephen J Roberts , Christopher C Holmes