English
Related papers

Related papers: Upper Entropy for 2-Monotone Lower Probabilities

200 papers

Entropic uncertainty relations in a finite dimensional Hilbert space are investigated. Making use of the majorization technique we derive explicit lower bounds for the sum of R\'enyi entropies describing probability distributions associated…

Quantum Physics · Physics 2015-11-20 Zbigniew Puchała , Łukasz Rudnicki , Karol Życzkowski

Uncertainty estimation is essential to make neural networks trustworthy in real-world applications. Extensive research efforts have been made to quantify and reduce predictive uncertainty. However, most existing works are designed for…

Machine Learning · Computer Science 2022-10-07 Myong Chol Jung , He Zhao , Joanna Dipnall , Belinda Gabbe , Lan Du

A new combinatorial-probabilistic diagnostic entropy has been introduced. It describes the pair-wise sum of probabilities of system conditions that have to be distinguished during the diagnosing process. The proposed measure describes the…

Information Theory · Computer Science 2009-09-29 Henryk Borowczyk

This paper discusses the importance of uncovering uncertainty in end-to-end dialog tasks, and presents our experimental results on uncertainty classification on the Ubuntu Dialog Corpus. We show that, instead of retraining models for this…

Computation and Language · Computer Science 2020-05-18 Yulan Feng , Shikib Mehri , Maxine Eskenazi , Tiancheng Zhao

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do…

Machine Learning · Computer Science 2023-02-21 Romit Maulik , Romain Egele , Krishnan Raghavan , Prasanna Balaprakash

Uncertainty reduction is vital for improving system reliability and reducing risks. To identify the best target for uncertainty reduction, uncertainty importance measure is commonly used to prioritize the significance of input variable…

Applications · Statistics 2025-06-12 Shi-Shun Chen , Xiao-Yang Li

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty…

Computation and Language · Computer Science 2025-05-30 Zhiqiu Xia , Jinxuan Xu , Yuqian Zhang , Hang Liu

This paper considers uncertainty quantification for an elliptic nonlocal equation. In particular, it is assumed that the parameters which define the kernel in the nonlocal operator are uncertain and a priori distributed according to a…

Computation · Statistics 2016-03-22 Ajay Jasra , Kody Law , Yan Zhou

Robust optimization has been established as a leading methodology to approach decision problems under uncertainty. To derive a robust optimization model, a central ingredient is to identify a suitable model for uncertainty, which is called…

Optimization and Control · Mathematics 2021-09-10 Marc Goerigk , Jannis Kurtz

A key factor for ensuring safety in Autonomous Vehicles (AVs) is to avoid any abnormal behaviors under undesirable and unpredicted circumstances. As AVs increasingly rely on Deep Neural Networks (DNNs) to perform safety-critical tasks,…

Machine Learning · Computer Science 2020-07-03 Fabio Arnez , Huascar Espinoza , Ansgar Radermacher , François Terrier

Uncertainty estimation bears the potential to make deep learning (DL) systems more reliable. Standard techniques for uncertainty estimation, however, come along with specific combinations of strengths and weaknesses, e.g., with respect to…

Machine Learning · Computer Science 2022-05-02 Joachim Sicking , Maram Akila , Jan David Schneider , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

The Principle of Maximum Entropy is a rigorous technique for estimating an unknown distribution given partial information while simultaneously minimizing bias. However, an important requirement for applying the principle is that the…

Information Theory · Computer Science 2026-02-03 Kenneth Bogert , Matthew Kothe

Uncertainty quantification in image retrieval is crucial for downstream decisions, yet it remains a challenging and largely unexplored problem. Current methods for estimating uncertainties are poorly calibrated, computationally expensive,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Frederik Warburg , Martin Jørgensen , Javier Civera , Søren Hauberg

Robust model predictive control algorithms are essential for addressing unavoidable errors due to the uncertainty in predicting real-world systems. However, the formulation of such algorithms typically results in a trade-off between…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Moritz Heinlein , Sankaranarayanan Subramanian , Sergio Lucia

Entropy measures quantify the amount of information and correlation present in a quantum system. In practice, when the quantum state is unknown and only copies thereof are available, one must resort to the estimation of such entropy…

Quantum Physics · Physics 2024-03-27 Ziv Goldfeld , Dhrumil Patel , Sreejith Sreekumar , Mark M. Wilde

Deep neural networks have significantly contributed to the success in predictive accuracy for classification tasks. However, they tend to make over-confident predictions in real-world settings, where domain shifting and out-of-distribution…

Artificial Intelligence · Computer Science 2021-07-16 Yibo Hu , Latifur Khan

Entropic uncertainty relations are powerful tools, especially in quantum cryptography. They typically bound the amount of uncertainty a third-party adversary may hold on a measurement outcome as a result of the measurement overlap. However,…

Quantum Physics · Physics 2023-05-18 Walter O. Krawec

Quantifying uncertainty is important for actionable predictions in real-world applications. A crucial part of predictive uncertainty quantification is the estimation of epistemic uncertainty, which is defined as an integral of the product…

Machine Learning · Computer Science 2023-10-25 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Günter Klambauer , Sepp Hochreiter

Photoplethysmography (PPG) signals encode information about relative changes in blood volume that can be used to assess various aspects of cardiac health non-invasively, e.g.\ to detect atrial fibrillation (AF) or predict blood pressure…

Machine Learning · Computer Science 2025-05-19 Ciaran Bench , Vivek Desai , Mohammad Moulaeifard , Nils Strodthoff , Philip Aston , Andrew Thompson

Learning-augmented algorithms have been attracting increasing interest, but have only recently been considered in the setting of explorable uncertainty where precise values of uncertain input elements can be obtained by a query and the goal…

Data Structures and Algorithms · Computer Science 2023-05-17 Thomas Erlebach , Murilo Santos de Lima , Nicole Megow , Jens Schlöter