English
Related papers

Related papers: Optimal uncertainty quantification for legacy data…

200 papers

As machine learning (ML) models are increasingly deployed in high-stakes domains, trustworthy uncertainty quantification (UQ) is critical for ensuring the safety and reliability of these models. Traditional UQ methods rely on specifying a…

Machine Learning · Statistics 2025-05-14 Abhineet Agarwal , Michael Xiao , Rebecca Barter , Omer Ronen , Boyu Fan , Bin Yu

This paper concerns the study of optimal (supremum and infimum) uncertainty bounds for systems where the input (or prior) probability measure is only partially/imperfectly known (e.g., with only statistical moments and/or on a coarse…

Machine Learning · Computer Science 2023-01-02 Xingsheng Sun , Burigede Liu

If Uncertainty Quantification (UQ) is crucial to achieve trustworthy Machine Learning (ML), most UQ methods suffer from disparate and inconsistent evaluation protocols. We claim this inconsistency results from the unclear requirements the…

Machine Learning · Computer Science 2022-07-28 Victor Bouvier , Simona Maggio , Alexandre Abraham , Léo Dreyfus-Schmidt

Large language models (LLMs) exhibit impressive fluency, but often produce critical errors known as "hallucinations". Uncertainty quantification (UQ) methods are a promising tool for coping with this fundamental shortcoming. Yet, existing…

Uncertainty quantification (UQ) is a crucial but challenging task in many high-dimensional regression or learning problems to increase the confidence of a given predictor. We develop a new data-driven approach for UQ in regression that…

Machine Learning · Computer Science 2024-07-19 Frederik Hoppe , Claudio Mayrink Verdun , Hannah Laus , Felix Krahmer , Holger Rauhut

Large Language Models (LLMs) excel in text generation, reasoning, and decision-making, enabling their adoption in high-stakes domains such as healthcare, law, and transportation. However, their reliability is a major concern, as they often…

Computation and Language · Computer Science 2025-06-05 Xiaoou Liu , Tiejin Chen , Longchao Da , Chacha Chen , Zhen Lin , Hua Wei

The burgeoning field of algorithms with predictions studies the problem of using possibly imperfect machine learning predictions to improve online algorithm performance. While nearly all existing algorithms in this framework make no…

Machine Learning · Computer Science 2024-06-05 Bo Sun , Jerry Huang , Nicolas Christianson , Mohammad Hajiesmaili , Adam Wierman , Raouf Boutaba

Uncertainty quantification (UQ) methods for Large Language Models (LLMs) encompass a variety of approaches, with two major types being particularly prominent: information-based, which focus on model confidence expressed as token…

Computation and Language · Computer Science 2025-12-10 Roman Vashurin , Maiya Goloburda , Albina Ilina , Aleksandr Rubashevskii , Preslav Nakov , Artem Shelmanov , Maxim Panov

While standard approaches to optimisation focus on producing a single high-performing solution, Quality-Diversity (QD) algorithms allow large diverse collections of such solutions to be found. If QD has proven promising across a large…

Neural and Evolutionary Computing · Computer Science 2023-04-27 Manon Flageat , Luca Grillotti , Antoine Cully

Graphical models have demonstrated their exceptional capabilities across numerous applications. However, their performance, confidence, and trustworthiness are often limited by the inherent randomness in data generation and the lack of…

Machine Learning · Computer Science 2026-04-15 Chao Chen , Chenghua Guo , Rui Xu , Jiujiu Chen , Xiangwen Liao , Xi Zhang , Sihong Xie , Hui Xiong , Philip Yu

Uncertainty quantification (UQ) is essential for assessing the reliability of Earth observation (EO) products. However, the extensive use of machine learning models in EO introduces an additional layer of complexity, as those models…

Machine Learning · Computer Science 2024-12-10 Yuanyuan Wang , Qian Song , Dawood Wasif , Muhammad Shahzad , Christoph Koller , Jonathan Bamber , Xiao Xiang Zhu

Reliable uncertainty quantification (UQ) in machine learning (ML) regression tasks is becoming the focus of many studies in materials and chemical science. It is now well understood that average calibration is insufficient, and most studies…

Machine Learning · Statistics 2024-01-25 Pascal Pernot

Many problems in engineering and sciences require the solution of large scale optimization constrained by partial differential equations (PDEs). Though PDE-constrained optimization is itself challenging, most applications pose additional…

Optimization and Control · Mathematics 2020-01-06 Joseph Hart , Bart van Bloemen Waanders , Roland Herzog

The calibration of complex computer codes using uncertainty quantification (UQ) methods is a rich area of statistical methodological development. When applying these techniques to simulators with spatial output, it is now standard to use…

Methodology · Statistics 2019-03-25 James M Salter , Daniel B Williamson , John Scinocca , Viatcheslav Kharin

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

Machine Learning · Statistics 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta

Accurately quantifying a large language model's (LLM) predictive uncertainty is crucial for judging the reliability of its answers. While most existing research focuses on short, directly answerable questions with closed-form outputs (e.g.,…

Computation and Language · Computer Science 2025-08-08 Yinghao Li , Rushi Qiang , Lama Moukheiber , Chao Zhang

Uncertainty Quantification (UQ) is essential for creating trustworthy machine learning models. Recent years have seen a steep rise in UQ methods that can flag suspicious examples, however, it is often unclear what exactly these methods…

Machine Learning · Computer Science 2023-10-31 Hao Sun , Boris van Breugel , Jonathan Crabbe , Nabeel Seedat , Mihaela van der Schaar

Multifidelity forward uncertainty quantification (UQ) problems often involve multiple quantities of interest and heterogeneous models (e.g., different grids, equations, dimensions, physics, surrogate and reduced-order models). While…

Numerical Analysis · Mathematics 2023-06-26 M. Croci , K. E. Willcox , S. J. Wright

Uncertainty quantification (UQ) plays a pivotal role in reduction of uncertainties during both optimization and decision making processes. It can be applied to solve a variety of real-world applications in science and engineering. Bayesian…

Uncertainty quantification (UQ) techniques are frequently used to ascertain output variability in systems with parametric uncertainty. Traditional algorithms for UQ are either system-agnostic and slow (such as Monte Carlo) or fast with…

Computation · Statistics 2015-03-19 Tuhin Sahai , Jose Miguel Pasini