English
Related papers

Related papers: On the pitfalls of entropy-based uncertainty for m…

200 papers

Various strategies for active learning have been proposed in the machine learning literature. In uncertainty sampling, which is among the most popular approaches, the active learner sequentially queries the label of those instances for…

Machine Learning · Computer Science 2019-09-04 Vu-Linh Nguyen , Sébastien Destercke , Eyke Hüllermeier

Semi-supervised learning aims to learn prediction models from both labeled and unlabeled samples. There has been extensive research in this area. Among existing work, generative mixture models with Expectation-Maximization (EM) is a popular…

Machine Learning · Computer Science 2020-08-31 Wenchong He , Zhe Jiang

Deep learning has become a crucial technology for making breakthroughs in many fields. Nevertheless, it still faces two important challenges in theoretical and applied aspects. The first lies in the shortcomings of gradient descent based…

Machine Learning · Computer Science 2024-07-09 Binghong Liu , Ziqi Zhao , Shupan Li , Ke Wang

It has been shown that deep learning models can under certain circumstances outperform traditional statistical methods at forecasting. Furthermore, various techniques have been developed for quantifying the forecast uncertainty (prediction…

Machine Learning · Computer Science 2021-10-08 Thabang Mathonsi , Terence L. van Zyl

This article addresses the challenge of adapting data-based models over time. We propose a novel two-fold modelling architecture designed to correct plant-model mismatch caused by two types of uncertainty. Out-of-domain uncertainty arises…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Laura Boca de Giuli , Alessio La Bella , Riccardo Scattolini

Semi-supervised segmentation tackles the scarcity of annotations by leveraging unlabeled data with a small amount of labeled data. A prominent way to utilize the unlabeled data is by consistency training which commonly uses a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Sukesh Adiga , Jose Dolz , Herve Lombaert

Training deep convolutional neural networks usually requires a large amount of labeled data. However, it is expensive and time-consuming to annotate data for medical image segmentation tasks. In this paper, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Lequan Yu , Shujun Wang , Xiaomeng Li , Chi-Wing Fu , Pheng-Ann Heng

Recent advancements in semi-supervised deep learning have introduced effective strategies for leveraging both labeled and unlabeled data to improve classification performance. This work proposes a semi-supervised framework that utilizes a…

Machine Learning · Computer Science 2025-05-21 Aydin Abedinia , Shima Tabakhi , Vahid Seydi

Semi-supervised learning has made significant progress in medical image segmentation. However, existing methods primarily utilize information acquired from a single dimensionality (2D/3D), resulting in sub-optimal performance on challenging…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Jiayi Zhu , Bart Bolsterlee , Brian V. Y. Chow , Yang Song , Erik Meijering

Despite the availability of large datasets for tasks like image classification and image-text alignment, labeled data for more complex recognition tasks, such as detection and segmentation, is less abundant. In particular, for instance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 François Porcher , Camille Couprie , Marc Szafraniec , Jakob Verbeek

Entity alignment is to find identical entities in different knowledge graphs. Although embedding-based entity alignment has recently achieved remarkable progress, training data insufficiency remains a critical challenge. Conventional…

Artificial Intelligence · Computer Science 2022-03-15 Kexuan Xin , Zequn Sun , Wen Hua , Bing Liu , Wei Hu , Jianfeng Qu , Xiaofang Zhou

Three important issues are often encountered in Supervised and Semi-Supervised Classification: class-memberships are unreliable for some training units (label noise), a proportion of observations might depart from the main structure of the…

Applications · Statistics 2020-07-02 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

To achieve high performance of a machine learning (ML) task, a deep learning-based model must implicitly capture the entire distribution from data. Thus, it requires a huge amount of training samples, and data are expected to fully present…

Machine Learning · Computer Science 2021-11-17 Hung Nguyen , Morris Chang

Deep neural networks excel in perception tasks such as semantic segmentation and monocular depth estimation, making them indispensable in safety-critical applications like autonomous driving and industrial inspection. However, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Steven Landgraf , Markus Hillemann , Theodor Kapler , Markus Ulrich

The problem of fully supervised classification is that it requires a tremendous amount of annotated data, however, in many datasets a large portion of data is unlabeled. To alleviate this problem semi-supervised learning (SSL) leverages the…

Machine Learning · Computer Science 2022-07-26 Ehsan Kazemi

In this paper we propose a novel method which leverages the uncertainty measures provided by Bayesian deep networks through curriculum learning so that the uncertainty estimates are fed back to the system to resample the training data more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Sora Iwamoto , Bisser Raytchev , Toru Tamaki , Kazufumi Kaneda

Despite the remarkable performance of supervised medical image segmentation models, relying on a large amount of labeled data is impractical in real-world situations. Semi-supervised learning approaches aim to alleviate this challenge using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yunyao Lu , Yihang Wu , Ahmad Chaddad , Tareef Daqqaq , Reem Kateb

Data scarcity poses a serious threat to modern machine learning and artificial intelligence, as their practical success typically relies on the availability of big datasets. One effective strategy to mitigate the issue of insufficient data…

Machine Learning · Computer Science 2026-05-14 Chaozhi Zhang , Lin Liu , Xiaoqun Zhang

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

Jointly extracting entity pairs and their relations is challenging when working on distantly-supervised data with ambiguous or noisy labels. To mitigate such impact, we propose uncertainty-aware bootstrap learning, which is motivated by the…

Computation and Language · Computer Science 2023-06-12 Yufei Li , Xiao Yu , Yanchi Liu , Haifeng Chen , Cong Liu