English
Related papers

Related papers: Deep sub-ensembles meets quantile regression: unce…

200 papers

Intrusion Detection Systems (IDSs) must maintain high detection sensitivity while operating under strict false-positive constraints, a challenge intensified by class imbalance and heterogeneous IoT traffic. This work investigates whether…

Quantum Physics · Physics 2026-05-29 Ritvik Bhatnagar , Nouhaila Innan , Angel Arul Jothi J. , Muhammad Shafique

Quantile Regression (QR) provides a way to approximate a single conditional quantile. To have a more informative description of the conditional distribution, QR can be merged with deep learning techniques to simultaneously estimate multiple…

Machine Learning · Computer Science 2022-02-01 Axel Brando , Joan Gimeno , Jose A. Rodríguez-Serrano , Jordi Vitrià

Decomposing prediction uncertainty into aleatoric (irreducible) and epistemic (reducible) components is critical for the reliable deployment of machine learning systems. While the mutual information between the response variable and model…

Machine Learning · Statistics 2026-02-10 Anchit Jain , Stephen Bates

Missing data presents a critical challenge in real-world datasets, significantly degrading the performance of machine learning models. While Large Language Models (LLMs) have recently demonstrated remarkable capabilities in tabular data…

Machine Learning · Computer Science 2025-07-14 Hossein Jamali

This paper presents a novel probabilistic forecasting method called ensemble conformalized quantile regression (EnCQR). EnCQR constructs distribution-free and approximately marginally valid prediction intervals (PIs), which are suitable for…

Machine Learning · Computer Science 2022-11-08 Vilde Jensen , Filippo Maria Bianchi , Stian Norman Anfinsen

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

Ensemble methods in machine learning aim to improve prediction accuracy by combining multiple models. This is achieved by ensuring diversity among predictors to capture different data aspects. Homogeneous ensembles use identical models,…

Quantum Physics · Physics 2025-11-04 Emiliano Tolotti , Enrico Blanzieri , Davide Pastorello

Data imbalance is ubiquitous when applying machine learning to real-world problems, particularly regression problems. If training data are imbalanced, the learning is dominated by the densely covered regions of the target distribution and…

Machine Learning · Computer Science 2024-10-29 Yuchang Jiang , Vivien Sainte Fare Garnot , Konrad Schindler , Jan Dirk Wegner

We introduce a new methodology for analyzing serial data by quantile regression assuming that the underlying quantile function consists of constant segments. The procedure does not rely on any distributional assumption besides serial…

Methodology · Statistics 2020-09-09 Laura Jula Vanegas , Merle Behr , Axel Munk

As machine learning models grow increasingly competent, their predictions can supplement scarce or expensive data in various important domains. In support of this paradigm, algorithms have emerged to combine a small amount of high-fidelity…

Machine Learning · Computer Science 2025-07-08 Zhun Deng , Thomas P Zollo , Benjamin Eyre , Amogh Inamdar , David Madras , Richard Zemel

Missing data is a fundamental challenge in data science, significantly hindering analysis and decision-making across a wide range of disciplines, including healthcare, bioinformatics, social science, e-commerce, and industrial monitoring.…

Machine Learning · Statistics 2026-05-12 Jicong Fan

In this paper, we adopt conformal prediction, a distribution-free uncertainty quantification (UQ) framework, to obtain confidence prediction intervals with coverage guarantees for Deep Operator Network (DeepONet) regression. Initially, we…

Machine Learning · Computer Science 2024-02-26 Christian Moya , Amirhossein Mollaali , Zecheng Zhang , Lu Lu , Guang Lin

In modern process industries, data-driven models are important tools for real-time monitoring when key performance indicators are difficult to measure directly. While accurate predictions are essential, reliable uncertainty quantification…

Machine Learning · Computer Science 2026-04-07 Yiran Ma , Jerome Le Ny , Zhichao Chen , Zhihuan Song

Uncertainty quantification plays an important role in achieving trustworthy and reliable learning-based computational imaging. Recent advances in generative modeling and Bayesian neural networks have enabled the development of…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Canberk Ekmekci , Mujdat Cetin

While causal models are becoming one of the mainstays of machine learning, the problem of uncertainty quantification in causal inference remains challenging. In this paper, we study the causal data fusion problem, where datasets pertaining…

Machine Learning · Statistics 2021-06-08 Siu Lun Chau , Jean-François Ton , Javier González , Yee Whye Teh , Dino Sejdinovic

Deep ensembles have been empirically shown to be a promising approach for improving accuracy, uncertainty and out-of-distribution robustness of deep learning models. While deep ensembles were theoretically motivated by the bootstrap,…

Machine Learning · Statistics 2020-06-26 Stanislav Fort , Huiyi Hu , Balaji Lakshminarayanan

Deep Learning methods are known to suffer from calibration issues: they typically produce over-confident estimates. These problems are exacerbated in the low data regime. Although the calibration of probabilistic models is well studied,…

Machine Learning · Statistics 2021-11-30 Rahul Rahaman , Alexandre H. Thiery

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

Machine Learning · Computer Science 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

Real-world clinical time series data sets exhibit a high prevalence of missing values. Hence, there is an increasing interest in missing data imputation. Traditional statistical approaches impose constraints on the data-generating process…

Machine Learning · Computer Science 2020-01-13 Yang Guo , Zhengyuan Liu , Pavitra Krishnswamy , Savitha Ramasamy