English
Related papers

Related papers: Language Model Uncertainty Quantification with Att…

200 papers

Large Language Diffusion Models (LLDMs) are emerging as an alternative to autoregressive models, offering faster inference through higher parallelism. Similar to autoregressive LLMs, they remain prone to hallucinations, making reliable…

Computation and Language · Computer Science 2026-05-15 Artem Vazhentsev , Vladislav Smirnov , David Li , Maxim Panov , Timothy Baldwin , Artem Shelmanov

Uncertainty Quantification (UQ) research has primarily focused on closed-book factual question answering (QA), while contextual QA remains unexplored, despite its importance in real-world applications. In this work, we focus on UQ for the…

Retrieval Augmented Generation (RAG) improves the question answering capabilities of Large Language Models (LLMs) by incorporating external knowledge and has recently been extended to multimodal settings through Vision-Language Models…

Information Retrieval · Computer Science 2026-05-29 Simon Binz , Heydar Soudani , Faegheh Hasibi

If Uncertainty Quantification (UQ) is crucial to achieve trustworthy Machine Learning (ML), most UQ methods suffer from disparate and inconsistent evaluation protocols. We claim this inconsistency results from the unclear requirements the…

Machine Learning · Computer Science 2022-07-28 Victor Bouvier , Simona Maggio , Alexandre Abraham , Léo Dreyfus-Schmidt

Language model (LM) "reasoning", commonly described as Chain-of-Thought or test-time scaling, often improves benchmark performance, but the dynamics underlying this process remain poorly understood. We study these dynamics through the lens…

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural…

High Energy Physics - Experiment · Physics 2023-11-02 Dae Heun Koh , Aashwin Mishra , Kazuhiro Terao

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

As large language models (LLMs) are increasingly integrated into high-stakes decision-making, the ability to reliably quantify uncertainty has become a critical requirement for safety and trust. However, current uncertainty quantification…

Artificial Intelligence · Computer Science 2026-05-28 Seongjun Lee , Suwan Yoon , Changhee Lee

While Large Language Models (LLMs) have demonstrated impressive capabilities, their output quality remains inconsistent across various application scenarios, making it difficult to identify trustworthy responses, especially in complex tasks…

As reasoning modules, such as the chain-of-thought mechanism, are applied to large language models, they achieve strong performance on various tasks such as answering common-sense questions and solving math problems. The main challenge now…

Computation and Language · Computer Science 2026-01-21 Zhenjiang Mao , Anirudhh Venkat

Large language models (LLMs) have transformed natural language processing, but their reliable deployment requires effective uncertainty quantification (UQ). Existing UQ methods are often heuristic and lack a probabilistic interpretation.…

Computation and Language · Computer Science 2025-11-06 Haoyi Song , Ruihan Ji , Naichen Shi , Fan Lai , Raed Al Kontar

Uncertainty quantification (UQ) is vital for ensuring that vision-language models (VLMs) behave safely and reliably. A central challenge is to localize uncertainty to its source, determining whether it arises from the image, the text, or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Chenyu Wang , Tianle Chen , H. M. Sabbir Ahmad , Kayhan Batmanghelich , Wenchao Li

As machine learning (ML) models are increasingly deployed in high-stakes domains, trustworthy uncertainty quantification (UQ) is critical for ensuring the safety and reliability of these models. Traditional UQ methods rely on specifying a…

Machine Learning · Statistics 2025-05-14 Abhineet Agarwal , Michael Xiao , Rebecca Barter , Omer Ronen , Boyu Fan , Bin Yu

This review is designed to introduce mathematicians and computational scientists to quantum computing (QC) through the lens of uncertainty quantification (UQ) by presenting a mathematically rigorous and accessible narrative for…

Quantum Physics · Physics 2026-03-30 Ryan Bennink , Olena Burkovska , Konstantin Pieper , Jorge Ramirez , Elaine Wong

Large Language Models (LLMs) are known to produce very high-quality tests and responses to our queries. But how much can we trust this generated text? In this paper, we study the problem of uncertainty quantification in LLMs. We propose a…

Computation and Language · Computer Science 2025-04-28 Muhammad Mubashar , Shireen Kudukkil Manchingal , Fabio Cuzzolin

Uncertainty quantification (UQ) for large language models (LLMs) is a key building block for safety guardrails of daily LLM applications. Yet, even as LLM agents are increasingly deployed in highly complex tasks, most UQ research still…

Artificial Intelligence · Computer Science 2026-04-21 Changdae Oh , Seongheon Park , To Eun Kim , Jiatong Li , Wendi Li , Samuel Yeh , Xuefeng Du , Hamed Hassani , Paul Bogdan , Dawn Song , Sharon Li

Retrieval-augmented reasoning (RAR) is a recent evolution of retrieval-augmented generation (RAG) that employs multiple reasoning steps for retrieval and generation. While effective for some complex queries, RAR remains vulnerable to errors…

Information Retrieval · Computer Science 2026-05-28 Heydar Soudani , Hamed Zamani , Faegheh Hasibi

Uncertainty Quantification (UQ) is an important building block for the reliable use of neural networks in real-world scenarios, as it can be a useful tool in identifying faulty predictions. Speech emotion recognition (SER) models can suffer…

Sound · Computer Science 2024-07-02 Oliver Schrüfer , Manuel Milling , Felix Burkhardt , Florian Eyben , Björn Schuller

The rise of large language models (LLMs) and their tight integration into our daily life make it essential to dedicate efforts towards their trustworthiness. Uncertainty quantification for LLMs can establish more human trust into their…

Computation and Language · Computer Science 2026-05-06 Daniel Yang , Yao-Hung Hubert Tsai , Makoto Yamada

Large Language Models (LLMs) display formidable capabilities in generative tasks but also pose potential risks due to their tendency to generate hallucinatory responses. Uncertainty Quantification (UQ), the evaluation of model output…

Computation and Language · Computer Science 2024-12-11 Qinhong Lin , Linna Zhou , Zhongliang Yang , Yuang Cai