English
Related papers

Related papers: Uncertainty Quantification and Risk Control for Mu…

200 papers

Sound source localization (SSL) technology plays a crucial role in various application areas such as fault diagnosis, speech separation, and vibration noise reduction. Although beamforming algorithms are widely used in SSL, their resolution…

Sound · Computer Science 2024-10-01 Wenbo Ma , Yan Lu , Yijun Liu

Large Language Models (LLMs) are increasingly assisting users in the real world, yet their reliability remains a concern. Uncertainty quantification (UQ) has been heralded as a tool to enhance human-LLM collaboration by enabling users to…

Computation and Language · Computer Science 2025-06-10 Siddartha Devic , Tejas Srinivasan , Jesse Thomason , Willie Neiswanger , Vatsal Sharan

Estimating the confidence of large language model (LLM) outputs is essential for real-world applications requiring high user trust. Black-box uncertainty quantification (UQ) methods, relying solely on model API access, have gained…

Computation and Language · Computer Science 2025-06-30 Quan Xiao , Debarun Bhattacharjya , Balaji Ganesan , Radu Marinescu , Katsiaryna Mirylenka , Nhan H Pham , Michael Glass , Junkyu Lee

Large Language Models (LLMs) are commonly used in Question Answering (QA) settings, increasingly in the natural sciences if not science at large. Reliable Uncertainty Quantification (UQ) is critical for the trustworthy uptake of generated…

Computation and Language · Computer Science 2026-02-03 Philip Müller , Nicholas Popovič , Michael Färber , Peter Steinbach

Uncertainty quantification (UQ) is important for reliability assessment and enhancement of machine learning models. In deep learning, uncertainties arise not only from data, but also from the training procedure that often injects…

Machine Learning · Statistics 2023-11-13 Ziyi Huang , Henry Lam , Haofeng Zhang

Large Language Models (LLMs) are increasingly deployed to autonomously solve real-world tasks. A key ingredient for this is the LLM Function-Calling paradigm, a widely used approach for equipping LLMs with tool-use capabilities. However, an…

Computation and Language · Computer Science 2026-04-28 Zihuiwen Ye , Lukas Aichberger , Michael Kirchhof , Sinead Williamson , Luca Zappella , Yarin Gal , Arno Blaas , Adam Golinski

Uncertainty Quantification (UQ) is essential in probabilistic machine learning models, particularly for assessing the reliability of predictions. In this paper, we present a systematic framework for estimating both epistemic and aleatoric…

Machine Learning · Statistics 2025-09-11 Marzieh Ajirak , Anand Ravishankar , Petar M. Djuric

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks due to large training datasets and powerful transformer architecture. However, the reliability of responses from LLMs remains a question.…

Computation and Language · Computer Science 2025-02-26 Tiejin Chen , Xiaoou Liu , Longchao Da , Jia Chen , Vagelis Papalexakis , Hua Wei

Quantifying uncertainties for machine learning (ML) models is a foundational challenge in modern data analysis. This challenge is compounded by at least two key aspects of the field: (a) inconsistent terminology surrounding uncertainty and…

Machine Learning · Computer Science 2025-06-04 Shubhendu Trivedi , Brian D. Nord

Reliable uncertainty quantification (UQ) is essential for deploying large language models (LLMs) in safety-critical scenarios, as it enables them to abstain from responding when uncertain, thereby avoiding hallucinations, i.e., plausible…

Computation and Language · Computer Science 2026-02-09 Xingtao Zhao , Hao Peng , Dingli Su , Xianghua Zeng , Chunyang Liu , Jinzhi Liao , Philip S. Yu

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with…

Machine Learning · Computer Science 2023-02-08 Apostolos F Psaros , Xuhui Meng , Zongren Zou , Ling Guo , George Em Karniadakis

This review is designed to introduce mathematicians and computational scientists to quantum computing (QC) through the lens of uncertainty quantification (UQ) by presenting a mathematically rigorous and accessible narrative for…

Quantum Physics · Physics 2026-03-30 Ryan Bennink , Olena Burkovska , Konstantin Pieper , Jorge Ramirez , Elaine Wong

Reliable uncertainty quantification is essential for deploying machine learning systems in high-stakes domains. Conformal prediction provides distribution-free coverage guarantees but often produces overly large prediction sets, limiting…

Machine Learning · Computer Science 2026-04-28 Yunpeng Xu , Wenge Guo , Zhi Wei

The Best Estimate plus Uncertainty (BEPU) approach for nuclear systems modeling and simulation requires that the prediction uncertainty must be quantified in order to prove that the investigated design stays within acceptance criteria. A…

Computation · Statistics 2023-03-24 Ziyu Xie , Farah Alsafadi , Xu Wu

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning,…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Xu Wu , Lesego E. Moloko , Pavel M. Bokov , Gregory K. Delipei , Joshua Kaizer , Kostadin N. Ivanov

Sound source localization (SSL) adds a spatial dimension to auditory perception, allowing a system to pinpoint the origin of speech, machinery noise, warning tones, or other acoustic events, capabilities that facilitate robot navigation,…

Robotics · Computer Science 2025-08-29 Reza Jalayer , Masoud Jalayer , Amirali Baniasadi

Self-Supervised Learning (SSL) is crucial for real-world applications, especially in data-hungry domains such as healthcare and self-driving cars. In addition to a lack of labeled data, these applications also suffer from distributional…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Ha Manh Bui , Iliana Maifeld-Carucci

Accurately quantifying a large language model's (LLM) predictive uncertainty is crucial for judging the reliability of its answers. While most existing research focuses on short, directly answerable questions with closed-form outputs (e.g.,…

Computation and Language · Computer Science 2025-08-08 Yinghao Li , Rushi Qiang , Lama Moukheiber , Chao Zhang

Assessing classification confidence is critical for leveraging large language models (LLMs) in automated labeling tasks, especially in the sensitive domains presented by Computational Social Science (CSS) tasks. In this paper, we make three…

Human-Computer Interaction · Computer Science 2024-11-05 David Farr , Iain Cruickshank , Nico Manzonelli , Nicholas Clark , Kate Starbird , Jevin West

Sound source localization (SSL) is the task of locating the source of sound within an image. Due to the lack of localization labels, the de facto standard in SSL has been to represent an image and audio as a single embedding vector each,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Inho Kim , Youngkil Song , Jicheol Park , Won Hwa Kim , Suha Kwak