English
Related papers

Related papers: An Empirical Study of Uncertainty Estimation Techn…

200 papers

Machine learning (ML) systems are increasingly deployed in high-stakes domains where reliability is paramount. This thesis investigates how uncertainty estimation can enhance the safety and trustworthiness of ML, focusing on selective…

Machine Learning · Computer Science 2025-09-09 Stephan Rabanser

In data streams, the data distribution of arriving observations at different time points may change - a phenomenon called concept drift. While detecting concept drift is a relatively mature area of study, solutions to the uncertainty…

Machine Learning · Computer Science 2020-08-11 Anjin Liu , Jie Lu , Guangquan Zhang

In the classic machine learning framework, models are trained on historical data and used to predict future values. It is assumed that the data distribution does not change over time (stationarity). However, in real-world scenarios, the…

Machine Learning · Statistics 2023-06-13 Mansour Zoubeirou A Mayaki , Michel Riveill

Practical applications of artificial intelligence increasingly often have to deal with the streaming properties of real data, which, considering the time factor, are subject to phenomena such as periodicity and more or less chaotic…

Machine Learning · Computer Science 2025-03-05 Joanna Komorniczak , Paweł Ksieniewicz

Deep neural networks (DNNs) are one of the most widely used machine learning algorithm. DNNs requires the training data to be available beforehand with true labels. This is not feasible for many real-world problems where data arrives in the…

Machine Learning · Computer Science 2024-06-10 Ayush K. Varshney , Vicenc Torra

Drift diffusion models (DDMs) have found widespread use in computational neuroscience and other fields. They model evidence accumulation in simple decision tasks as a stochastic process drifting towards a decision barrier. In models where…

Methodology · Statistics 2025-12-12 Sicheng Liu , Alexander Fengler , Michael J. Frank , Matthew T. Harrison

Concept drift refers to the change of data distributions over time. While drift poses a challenge for learning models, requiring their continual adaption, it is also relevant in system monitoring to detect malfunctions, system failures, and…

Machine Learning · Computer Science 2025-02-07 Fabian Hinder , Valerie Vaquet , Barbara Hammer

The dynamicity of real-world systems poses a significant challenge to deployed predictive machine learning (ML) models. Changes in the system on which the ML model has been trained may lead to performance degradation during the system's…

Machine Learning · Computer Science 2022-03-22 Firas Bayram , Bestoun S. Ahmed , Andreas Kassler

Data stream processing has become a landmark in modern machine learning applications, with concept drifts and novel class appearances posing the primary challenges faced by sophisticated recognition methods. This work proposes an…

Machine Learning · Computer Science 2026-05-29 Joanna Komorniczak

Classifiers and other statistics-based machine learning (ML) techniques generalize, or learn, based on various statistical properties of the training data. The assumption underlying statistical ML resulting in theoretical or empirical…

Machine Learning · Computer Science 2021-11-11 Samuel Ackerman , Orna Raz , Marcel Zalmanovici , Aviad Zlotnick

Classifying streaming data requires the development of methods which are computationally efficient and able to cope with changes in the underlying distribution of the stream, a phenomenon known in the literature as concept drift. We propose…

Machine Learning · Statistics 2012-12-27 Gordon J. Ross , Niall M. Adams , Dimitris K. Tasoulis , David J. Hand

Mining data streams is one of the main studies in machine learning area due to its application in many knowledge areas. One of the major challenges on mining data streams is concept drift, which requires the learner to discard the current…

Machine Learning · Computer Science 2023-04-20 Jean Paul Barddal , Heitor Murilo Gomes , Fabrício Enembreck

Recent research yielded a wide array of drift detectors. However, in order to achieve remarkable performance, the true class labels must be available during the drift detection phase. This paper targets at detecting drift when the ground…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-15 Maxime Fuccellaro , Laurent Simon , Akka Zemmari

Detecting concept drift is a well known problem that affects production systems. However, two important issues that are frequently not addressed in the literature are 1) the detection of drift when the labels are not immediately available;…

Machine Learning · Computer Science 2019-08-13 Fábio Pinto , Marco O. P. Sampaio , Pedro Bizarro

Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called concept drift.…

Machine Learning · Computer Science 2024-07-09 Ke Wan , Yi Liang , Susik Yoon

A significant part of contemporary research in autonomous vehicles is dedicated to the development of safety critical systems where state-of-the-art artificial intelligence (AI) algorithms, like computer vision (CV), can play a major role.…

One of the ways to make artificial intelligence more natural is to give it some room for doubt. Two main questions should be resolved in that way. First, how to train a model to estimate uncertainties of its own predictions? And then, what…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Alexey Kornaev , Elena Kornaeva , Oleg Ivanov , Ilya Pershin , Danis Alukaev

Detecting drift in performance of Machine Learning (ML) models is an acknowledged challenge. For ML models to become an integral part of business applications it is essential to detect when an ML model drifts away from acceptable operation.…

Machine Learning · Computer Science 2021-08-12 Samuel Ackerman , Parijat Dube , Eitan Farchi , Orna Raz , Marcel Zalmanovici

Many real-world applications adopt multi-label data streams as the need for algorithms to deal with rapidly changing data increases. Changes in data distribution, also known as concept drift, cause the existing classification models to…

Machine Learning · Computer Science 2022-02-02 Ege Berkay Gulcan , Fazli Can

This work presents a probabilistic deep neural network that combines LiDAR point clouds and RGB camera images for robust, accurate 3D object detection. We explicitly model uncertainties in the classification and regression tasks, and…

Robotics · Computer Science 2020-02-04 Di Feng , Yifan Cao , Lars Rosenbaum , Fabian Timm , Klaus Dietmayer