English
Related papers

Related papers: How Certain are Uncertainty Estimates? Three Novel…

200 papers

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model performance silently…

Machine Learning · Computer Science 2024-03-18 Arthur Thuy , Dries F. Benoit

Large language models (LLMs) are increasingly utilized for machine translation, yet their predictions often exhibit uncertainties that hinder interpretability and user trust. Effectively visualizing these uncertainties can enhance the…

Computation and Language · Computer Science 2025-02-26 Jin Hyun Park , Utsawb Laminchhane , Umer Farooq , Uma Sivakumar , Arpan Kumar

Motivation: Recent work has demonstrated the feasibility of using non-numerical, qualitative data to parameterize mathematical models. However, uncertainty quantification (UQ) of such parameterized models has remained challenging because of…

Methodology · Statistics 2019-09-04 Eshan D. Mitra , William S. Hlavacek

The opaque nature of transformer-based models, particularly in applications susceptible to unethical practices such as dark-patterns in user interfaces, requires models that integrate uncertainty quantification to enhance trust in…

Machine Learning · Computer Science 2024-12-09 Javier Muñoz , Álvaro Huertas-García , Carlos Martí-González , Enrique De Miguel Ambite

Most machine learning techniques are based upon statistical learning theory, often simplified for the sake of computing speed. This paper is focused on the uncertainty aspect of mathematical modeling in machine learning. Regression analysis…

Machine Learning · Computer Science 2022-06-07 Valentin Arkov

Activity recognition in wearable computing faces two key challenges: i) activity characteristics may be context-dependent and change under different contexts or situations; ii) unknown contexts and activities may occur from time to time,…

Machine Learning · Computer Science 2020-03-05 Zepeng Huo , Arash PakBin , Xiaohan Chen , Nathan Hurley , Ye Yuan , Xiaoning Qian , Zhangyang Wang , Shuai Huang , Bobak Mortazavi

We present a critical survey on the consistency of uncertainty quantification used in deep learning and highlight partial uncertainty coverage and many inconsistencies. We then provide a comprehensive and statistically consistent framework…

Machine Learning · Computer Science 2026-01-14 Peter Jan van Leeuwen , J. Christine Chiu , C. Kevin Yang

The inability of artificial neural networks to assess the uncertainty of their predictions is an impediment to their widespread use. We distinguish two types of learnable uncertainty: model uncertainty due to a lack of training data and…

Machine Learning · Computer Science 2022-06-14 Hans Weytjens , Jochen De Weerdt

We have recently proposed a rigorous framework for Uncertainty Quantification (UQ) in which UQ objectives and assumption/information set are brought into the forefront, providing a framework for the communication and comparison of UQ…

Discrete Mathematics · Computer Science 2012-02-07 M. McKerns , H. Owhadi , C. Scovel , T. J. Sullivan , M. Ortiz

Large language models (LLMs) exhibit impressive fluency, but often produce critical errors known as "hallucinations". Uncertainty quantification (UQ) methods are a promising tool for coping with this fundamental shortcoming. Yet, existing…

A wide range of sustainability and grid-integration strategies depend on workload shifting, which aligns the timing of energy consumption with external signals such as grid curtailment events, carbon intensity, or time-of-use electricity…

Data Structures and Algorithms · Computer Science 2025-10-01 Ezra Johnson , Adam Lechowicz , Mohammad Hajiesmaili

Uncertainty Quantification (UQ) is crucial for ensuring the reliability of automated image segmentations in safety-critical domains like biomedical image analysis or autonomous driving. In segmentation, UQ generates pixel-wise uncertainty…

The development of large databases of material properties, together with the availability of powerful computers, has allowed machine learning (ML) modeling to become a widely used tool for predicting material performances. While confidence…

Materials Science · Physics 2023-10-23 Francesca Tavazza , Kamal Choudhary , Brian DeCost

The adaptation and use of Machine Learning (ML) in our daily lives has led to concerns in lack of transparency, privacy, reliability, among others. As a result, we are seeing research in niche areas such as interpretability, causality, bias…

Machine Learning · Computer Science 2024-06-04 Fahimeh Fakour , Ali Mosleh , Ramin Ramezani

In inverse problems, uncertainty quantification (UQ) deals with a probabilistic description of the solution nonuniqueness and data noise sensitivity. Setting seismic imaging into a Bayesian framework allows for a principled way of studying…

Geophysics · Physics 2020-04-16 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

We propose a novel framework for uncertainty quantification via information bottleneck (IB-UQ) for scientific machine learning tasks, including deep neural network (DNN) regression and neural operator learning (DeepONet). Specifically, we…

Numerical Analysis · Mathematics 2023-05-31 Ling Guo , Hao Wu , Wenwen Zhou , Yan Wang , Tao Zhou

Climate models are generally calibrated manually by comparing selected climate statistics, such as the global top-of-atmosphere energy balance, to observations. The manual tuning only targets a limited subset of observational data and…

Atmospheric and Oceanic Physics · Physics 2022-04-06 Michael F. Howland , Oliver R. A. Dunbar , Tapio Schneider

Many problems in engineering and sciences require the solution of large scale optimization constrained by partial differential equations (PDEs). Though PDE-constrained optimization is itself challenging, most applications pose additional…

Optimization and Control · Mathematics 2020-01-06 Joseph Hart , Bart van Bloemen Waanders , Roland Herzog

Increasingly high-stakes decisions are made using neural networks in order to make predictions. Specifically, meteorologists and hedge funds apply these techniques to time series data. When it comes to prediction, there are certain…

Machine Learning · Computer Science 2022-11-14 Levente Foldesi , Matias Valdenegro-Toro

Despite the massive advancements in large language models (LLMs), they still suffer from producing plausible but incorrect responses. To improve the reliability of LLMs, recent research has focused on uncertainty quantification to predict…

Artificial Intelligence · Computer Science 2025-04-01 Yongjin Yang , Haneul Yoo , Hwaran Lee