English
Related papers

Related papers: Sample-based Uncertainty Quantification with a Sin…

200 papers

For computational efficiency, surrogate models have been used to emulate mathematical simulators for physical or biological processes. High-speed simulation is crucial for conducting uncertainty quantification (UQ) when the simulation is…

Machine Learning · Computer Science 2022-11-21 Lixiang Zhang , Jia Li

Uncertainty quantification is a critical yet unsolved challenge for deep learning, especially for the time series imputation with irregularly sampled measurements. To tackle this problem, we propose a novel framework based on the principles…

Machine Learning · Computer Science 2023-06-05 Shweta Dahale , Sai Munikoti , Balasubramaniam Natarajan

Quantizing deep neural networks is an effective method for reducing memory consumption and improving inference speed, and is thus useful for implementation in resource-constrained devices. However, it is still hard for extremely low-bit…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Kohei Yamamoto

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

Machine Learning · Computer Science 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

Uncertainty quantification (UQ) is a prominent approach for eliciting truthful answers from large language models (LLMs). To date, information-based and consistency-based UQ have been the dominant UQ methods for text generation via LLMs.…

Computation and Language · Computer Science 2026-04-29 Artem Vazhentsev , Lyudmila Rvanova , Ivan Lazichny , Alexander Panchenko , Maxim Panov , Timothy Baldwin , Artem Shelmanov

Mixed-precision quantization has been widely applied on deep neural networks (DNNs) as it leads to significantly better efficiency-accuracy tradeoffs compared to uniform quantization. Meanwhile, determining the exact precision of each layer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Lirui Xiao , Huanrui Yang , Zhen Dong , Kurt Keutzer , Li Du , Shanghang Zhang

Quality control (QC) of MR images is essential to ensure that downstream analyses such as segmentation can be performed successfully. Currently, QC is predominantly performed visually and subjectively, at significant time and operator cost.…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Richard Shaw , Carole H. Sudre , Sebastien Ourselin , M. Jorge Cardoso , Hugh G. Pemberton

Deep neural networks (DNNs) have witnessed great successes in semantic segmentation, which requires a large number of labeled data for training. We present a novel learning framework called Uncertainty guided Cross-head Co-training (UCC)…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Jiashuo Fan , Bin Gao , Huan Jin , Lihui Jiang

This paper proposes an Improved Noisy Deep Q-Network (Noisy DQN) to enhance the exploration and stability of Unmanned Aerial Vehicle (UAV) when applying deep reinforcement learning in simulated environments. This method enhances the…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Zhang Hengyu , Maryam Cheraghy , Liu Wei , Armin Farhadi , Meysam Soltanpour , Zhong Zhuoqing

Spatiotemporal prediction plays a critical role in numerous real-world applications such as urban planning, transportation optimization, disaster response, and pandemic control. In recent years, researchers have made significant progress by…

Machine Learning · Computer Science 2025-09-03 Dahai Yu , Dingyi Zhuang , Lin Jiang , Rongchao Xu , Xinyue Ye , Yuheng Bu , Shenhao Wang , Guang Wang

Network quantization is a dominant paradigm of model compression. However, the abrupt changes in quantized weights during training often lead to severe loss fluctuations and result in a sharp loss landscape, making the gradients unstable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Jing Liu , Jianfei Cai , Bohan Zhuang

In recent years, large language models (LLMs) have become increasingly prevalent, offering remarkable text generation capabilities. However, a pressing challenge is their tendency to make confidently wrong predictions, highlighting the…

Computation and Language · Computer Science 2024-03-06 Xiang Gao , Jiaxin Zhang , Lalla Mouatadid , Kamalika Das

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do…

Machine Learning · Computer Science 2023-02-21 Romit Maulik , Romain Egele , Krishnan Raghavan , Prasanna Balaprakash

How can we quantify uncertainty if our favorite computational tool - be it a numerical, a statistical, or a machine learning approach, or just any computer model - provides single-valued output only? In this article, we introduce the Easy…

Methodology · Statistics 2023-07-25 Eva-Maria Walz , Alexander Henzi , Johanna Ziegel , Tilmann Gneiting

Mixed precision quantization has become an important technique for optimizing the execution of deep neural networks (DNNs). Certified robustness, which provides provable guarantees about a model's ability to withstand different adversarial…

Machine Learning · Computer Science 2026-04-29 Yuchen Yang , Yifan Zhao , Shubham Ugare , Gagandeep Singh , Sasa Misailovic

Large language models (LLMs) exhibit impressive fluency, but often produce critical errors known as "hallucinations". Uncertainty quantification (UQ) methods are a promising tool for coping with this fundamental shortcoming. Yet, existing…

Diffusion MRI (dMRI) is the only non-invasive technique sensitive to tissue micro-architecture, which can, in turn, be used to reconstruct tissue microstructure and white matter pathways. The accuracy of such tasks is hampered by the low…

Image and Video Processing · Electrical Eng. & Systems 2022-03-08 Shreyas Fadnavis , Jens Sjölund , Anders Eklund , Eleftherios Garyfallidis

We provide single-model estimates of aleatoric and epistemic uncertainty for deep neural networks. To estimate aleatoric uncertainty, we propose Simultaneous Quantile Regression (SQR), a loss function to learn all the conditional quantiles…

Machine Learning · Statistics 2019-09-09 Natasa Tagasovska , David Lopez-Paz

To accelerate and compress deep neural networks (DNNs), many network quantization algorithms have been proposed. Although the quantization strategy of any algorithm from the state-of-the-arts may outperform others in some network…

Machine Learning · Computer Science 2024-04-16 Lianqiang Li , Chenqian Yan , Yefei Chen

Uncertainty quantification (UQ) in graph neural networks (GNNs) is crucial in high-stakes domains but remains a significant challenge. In graph settings, message passing often relies on strong assumptions such as exchangeability, which are…

Machine Learning · Computer Science 2026-05-07 Soyoung park , Hwanjun Song , Sungsu Lim