English
Related papers

Related papers: When should we trust the annotation? Selective pre…

200 papers

Measurement of uncertainty of predictions from machine learning methods is important across scientific domains and applications. We present, to our knowledge, the first such technique that quantifies the uncertainty of predictions from a…

Machine Learning · Statistics 2022-04-04 Alex Hagen , Karl Pazdernik , Nicole LaHaye , Marjolein Oostrom

Many analysis and prediction tasks require the extraction of structured data from unstructured texts. However, an annotation scheme and a training dataset have not been available for training machine learning models to mine structured data…

Information Retrieval · Computer Science 2025-06-24 Chaochao Zhou , Bo Yang

Uncertainty quantification is a key aspect in many tasks such as model selection/regularization, or quantifying prediction uncertainties to perform active learning or OOD detection. Within credal approaches that consider modeling…

Machine Learning · Computer Science 2026-03-26 Tuan-Anh Vu , Sébastien Destercke , Frédéric Pichon

This paper proposes a novel training scheme for fast matching models in Search Ads, which is motivated by the real challenges in model training. The first challenge stems from the pursuit of high throughput, which prohibits the deployment…

Information Retrieval · Computer Science 2019-04-23 Xue Li , Zhipeng Luo , Hao Sun , Jianjin Zhang , Weihao Han , Xianqi Chu , Liangjie Zhang , Qi Zhang

Coarsely-labeled semantic segmentation annotations are easy to obtain, but therefore bear the risk of losing edge details and introducing background pixels. Impeded by the inherent noise, existing coarse annotations are only taken as a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Jingchao Liu , Ye Du , Zehua Fu , Qingjie Liu , Yunhong Wang

Machine learning offers attractive solutions to challenging image processing tasks. Tedious development and parametrization of algorithmic solutions can be replaced by training a convolutional neural network or a random forest with a high…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Katja Schladitz , Claudia Redenbach , Tin Barisin , Christian Jung , Natascha Jeziorski , Lovro Bosnar , Juraj Fulir , Petra Gospodnetić

Many applications of machine learning methods involve an iterative protocol in which data are collected, a model is trained, and then outputs of that model are used to choose what data to consider next. For example, one data-driven approach…

Machine Learning · Computer Science 2025-04-07 Clara Fannjiang , Stephen Bates , Anastasios N. Angelopoulos , Jennifer Listgarten , Michael I. Jordan

Uncertainty propagation in high-dimensional nonlinear dynamic structural systems is pivotal in state-of-the-art performance-based design and risk assessment, where uncertainties from both excitations and structures, i.e., the aleatoric…

Machine Learning · Computer Science 2026-04-03 Manisha Sapkota , Min Li , Bowei Li

In this paper, we leverage predictive uncertainty of deep neural networks to answer challenging questions material scientists usually encounter in machine learning based materials applications workflows. First, we show that by leveraging…

Materials Science · Physics 2021-04-26 Jize Zhang , Bhavya Kailkhura , T. Yong-Jin Han

Magnetic Resonance Fingerprinting (MRF) is an emerging technology with the potential to revolutionize radiology and medical diagnostics. In comparison to traditional magnetic resonance imaging (MRI), MRF enables the rapid, simultaneous,…

Aleatoric uncertainty is an intrinsic property of ill-posed inverse and imaging problems. Its quantification is vital for assessing the reliability of relevant point estimates. In this paper, we propose an efficient framework for…

Image and Video Processing · Electrical Eng. & Systems 2020-01-16 Chen Zhang , Bangti Jin

Survival models are used in various fields, such as the development of cancer treatment protocols. Although many statistical and machine learning models have been proposed to achieve accurate survival predictions, little attention has been…

Machine Learning · Computer Science 2020-03-26 Hrushikesh Loya , Pranav Poduval , Deepak Anand , Neeraj Kumar , Amit Sethi

Machine learning interatomic potentials (MLIPs) enable atomistic simulations with near first-principles accuracy at substantially reduced computational cost, making them powerful tools for large-scale materials modeling. The accuracy of…

Materials Science · Physics 2025-08-11 Yonatan Kurniawan , Mingjian Wen , Ellad B. Tadmor , Mark K. Transtrum

Real-time reconstruction of conditional quantum states from continuous measurement records is a fundamental requirement for quantum feedback control, yet standard stochastic master equation (SME) solvers require exact model specification,…

Machine Learning · Computer Science 2026-03-06 Priyanshi Singh , Krishna Bhatia

Decomposing prediction uncertainty into aleatoric (irreducible) and epistemic (reducible) components is critical for the reliable deployment of machine learning systems. While the mutual information between the response variable and model…

Machine Learning · Statistics 2026-02-10 Anchit Jain , Stephen Bates

The vast majority of theoretical results in machine learning and statistics assume that the available training data is a reasonably reliable reflection of the phenomena to be learned or estimated. Similarly, the majority of machine learning…

Machine Learning · Computer Science 2017-06-13 Moses Charikar , Jacob Steinhardt , Gregory Valiant

Medical image segmentation supports clinical workflows by precisely delineating anatomical structures and lesions. However, medical image datasets medical image datasets suffer from acquisition noise and annotation ambiguity, causing…

Artificial Intelligence · Computer Science 2026-04-14 Ruiyang Li , Fang Liu , Licheng Jiao , Xinglin Xie , Jiayao Hao , Shuo Li , Xu Liu , Jingyi Yang , Lingling Li , Puhua Chen , Wenping Ma

Uncertainty quantification is a key pillar of trustworthy machine learning. It enables safe reactions under unsafe inputs, like predicting only when the machine learning model detects sufficient evidence, discarding anomalous data, or…

Machine Learning · Computer Science 2024-08-27 Michael Kirchhof

Reliable uncertainty quantification is essential for deploying machine learning systems in high-stakes domains. Conformal prediction provides distribution-free coverage guarantees but often produces overly large prediction sets, limiting…

Machine Learning · Computer Science 2026-04-28 Yunpeng Xu , Wenge Guo , Zhi Wei

Performance metrics for medical image segmentation models are used to measure the agreement between the reference annotation and the predicted segmentation. Usually, overlap metrics, such as the Dice, are used as a metric to evaluate the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Sophie Ostmeier , Brian Axelrod , Jeroen Bertels , Fabian Isensee , Maarten G. Lansberg , Soren Christensen , Gregory W. Albers , Li-Jia Li , Jeremy J. Heit