English
Related papers

Related papers: Flexible Uncertainty Calibration for Machine-Learn…

200 papers

Climate models are generally calibrated manually by comparing selected climate statistics, such as the global top-of-atmosphere energy balance, to observations. The manual tuning only targets a limited subset of observational data and…

Atmospheric and Oceanic Physics · Physics 2022-04-06 Michael F. Howland , Oliver R. A. Dunbar , Tapio Schneider

Machine learning interatomic potentials (MLIPs) enable atomistic simulations with near ab initio accuracy at significantly reduced computational cost, but their broader adoption is often limited by fragmented tooling, limited scalability,…

Machine learning (ML) is transforming healthcare, but safe clinical decisions demand reliable uncertainty estimates that standard ML models fail to provide. Conformal prediction (CP) is a popular tool that allows users to turn heuristic…

Machine Learning · Computer Science 2025-12-18 Klaus-Rudolf Kladny , Bernhard Schölkopf , Lisa Koch , Christian F. Baumgartner , Michael Muehlebach

This paper presents an uncertainty compensation-based robust adaptive model predictive control (MPC) framework for linear systems with both matched and unmatched nonlinear uncertainties subject to both state and input constraints. In…

Systems and Control · Electrical Eng. & Systems 2024-09-27 Ran Tao , Pan Zhao , Ilya Kolmanovsky , Naira Hovakimyan

An accurate description of information is relevant for a range of problems in atomistic machine learning (ML), such as crafting training sets, performing uncertainty quantification (UQ), or extracting physical insights from large datasets.…

Materials Science · Physics 2025-05-02 Daniel Schwalbe-Koda , Sebastien Hamel , Babak Sadigh , Fei Zhou , Vincenzo Lordi

Irradiation-induced void swelling is a critical degradation mechanism for structural materials in nuclear reactors, dictating component operational lifespan and safety. While recent machine learning (ML) approaches have improved the…

Applications · Statistics 2026-03-03 Minhee Kim , Yong Yang

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…

As with many parts of the natural sciences, machine learning interatomic potentials (MLIPs) are revolutionizing the modeling of molecular crystals. However, challenges remain for the accurate and efficient calculation of sublimation…

Computational Physics · Physics 2025-09-03 Flaviano Della Pia , Benjamin X. Shi , Venkat Kapil , Andrea Zen , Dario Alfè , Angelos Michaelides

The practice of uncertainty quantification (UQ) validation, notably in machine learning for the physico-chemical sciences, rests on several graphical methods (scattering plots, calibration curves, reliability diagrams and confidence curves)…

Chemical Physics · Physics 2023-03-31 Pascal Pernot

Reliable uncertainty quantification (UQ) is essential when employing large language models (LLMs) in high-risk domains such as clinical question answering (QA). In this work, we evaluate uncertainty estimation methods for clinical QA…

Computation and Language · Computer Science 2026-01-27 Alberto Testoni , Iacer Calixto

We present a "module-based hybrid" Uncertainty Quantification (UQ) framework for general nonlinear multi-physics simulation. The proposed methodology, introduced in [\hyperlink{ref1}{1}], supports the independent development of each…

Computational Physics · Physics 2014-10-21 Akshay Mittal , Xiao Chen , Charles Tong , Gianluca Iaccarino

Precise estimation of predictive uncertainty in deep neural networks is a critical requirement for reliable decision-making in machine learning and statistical modeling, particularly in the context of medical AI. Conformal Prediction (CP)…

Machine Learning · Computer Science 2024-01-05 Hamed Karimi , Reza Samavi

Successful application of machine learning models to real-world prediction problems, e.g. financial forecasting and personalized medicine, has proved to be challenging, because such settings require limiting and quantifying the uncertainty…

Machine Learning · Computer Science 2020-09-15 Yao Zhang , William Zame , Mihaela van der Schaar

Uncertainty Quantification (UQ) for Natural Language Generation (NLG) is crucial for assessing the performance of Large Language Models (LLMs), as it reveals confidence in predictions, identifies failure modes, and gauges output…

Computation and Language · Computer Science 2025-04-09 Sean Wang , Yicheng Jiang , Yuxin Tang , Lu Cheng , Hanjie Chen

This paper explores uncertainty quantification (UQ) methods in the context of Kolmogorov-Arnold Networks (KANs). We apply an ensemble approach to KANs to obtain a heuristic measure of UQ, enhancing interpretability and robustness in…

Machine Learning · Computer Science 2025-04-22 Amirhossein Mollaali , Christian Bolivar Moya , Amanda A. Howard , Alexander Heinlein , Panos Stinis , Guang Lin

Machine-learning techniques are essential in modern collider research, yet their probabilistic outputs often lack calibrated uncertainty estimates and finite-sample guarantees, limiting their direct use in statistical inference and…

High Energy Physics - Phenomenology · Physics 2025-12-22 Jack Y. Araz , Michael Spannowsky

Machine learning interatomic potentials (MLIPs) have introduced a new paradigm for atomic simulations. Recent advancements have seen the emergence of universal MLIPs (uMLIPs) that are pre-trained on diverse materials datasets, providing…

This short study presents an opportunistic approach to a (more) reliable validation method for prediction uncertainty average calibration. Considering that variance-based calibration metrics (ZMS, NLL, RCE...) are quite sensitive to the…

Machine Learning · Statistics 2024-08-27 Pascal Pernot

Machine-learning (ML) interatomic potentials (IPs) trained on first-principles datasets are becoming increasingly popular since they promise to treat larger system sizes and longer time scales, compared to the {\em ab initio} techniques…

Materials Science · Physics 2023-09-04 Shuaihua Lu , Luca M. Ghiringhelli , Christian Carbogno , Jinlan Wang , Matthias Scheffler

The Best Estimate plus Uncertainty (BEPU) approach for nuclear systems modeling and simulation requires that the prediction uncertainty must be quantified in order to prove that the investigated design stays within acceptance criteria. A…

Computation · Statistics 2023-03-24 Ziyu Xie , Farah Alsafadi , Xu Wu