English
Related papers

Related papers: Uncertainty analysis and composite hypothesis unde…

200 papers

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

We consider a discrete latent variable model for two-way data arrays, which allows one to simultaneously produce clusters along one of the data dimensions (e.g. exchangeable observational units or features) and contiguous groups, or…

Modern data sets in various domains often include units that were sampled non-randomly from the population and have a latent correlation structure. Here we investigate a common form of this setting, where every unit is associated with a…

Methodology · Statistics 2019-07-25 Omer Weissbrod , Shachar Kaufman , David Golan , Saharon Rosset

This paper studies the problem of distributed classification with a network of heterogeneous agents. The agents seek to jointly identify the underlying target class that best describes a sequence of observations. The problem is first…

Artificial Intelligence · Computer Science 2020-11-24 James Z. Hare , Cesar A. Uribe , Lance Kaplan , Ali Jadbabaie

While the accuracy of modern deep learning models has significantly improved in recent years, the ability of these models to generate uncertainty estimates has not progressed to the same degree. Uncertainty methods are designed to provide…

Machine Learning · Statistics 2020-06-17 Adam M. Oberman , Chris Finlay , Alexander Iannantuono , Tiago Salvador

Accurately knowing uncertainties in appearance-based gaze tracking is critical for ensuring reliable downstream applications. Due to the lack of individual uncertainty labels, current uncertainty-aware approaches adopt probabilistic models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Qiaojie Zheng , Jiucai Zhang , Xiaoli Zhang

It is well-known that in some situations it is not easy to compute the likelihood function as the datasets might be large or the model is too complex. In that contexts composite likelihood, derived by multiplying the likelihoods of subjects…

Methodology · Statistics 2016-03-02 Nirian Martin , Leandro Pardo , Konstantinos Zografos

As large language models continue to be widely developed, robust uncertainty quantification techniques will become crucial for their safe deployment in high-stakes scenarios. In this work, we explore how conformal prediction can be used to…

Computation and Language · Computer Science 2023-07-11 Bhawesh Kumar , Charlie Lu , Gauri Gupta , Anil Palepu , David Bellamy , Ramesh Raskar , Andrew Beam

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of…

High Energy Physics - Phenomenology · Physics 2025-10-27 Sunil Jaiswal , Chun Shen , Richard J. Furnstahl , Ulrich Heinz , Matthew T. Pratola

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty…

Computation and Language · Computer Science 2025-05-30 Zhiqiu Xia , Jinxuan Xu , Yuqian Zhang , Hang Liu

I review the classical theory of likelihood based inference and consider how it is being extended and developed for use in complex models and sampling schemes.

Statistics Theory · Mathematics 2013-10-01 Nancy Reid

The last decade has seen max-stable processes emerge as a common tool for the statistical modeling of spatial extremes. However, their application is complicated due to the unavailability of the multivariate density function, and so…

Methodology · Statistics 2009-02-23 Simone A. Padoan , Mathieu Ribatet , Scott A. Sisson

Class imbalance poses a significant challenge in classification tasks, where traditional approaches often lead to biased models and unreliable predictions. Undersampling and oversampling techniques have been commonly employed to address…

Machine Learning · Computer Science 2025-10-22 Matt Clifford , Jonathan Erskine , Alexander Hepburn , Raúl Santos-Rodríguez , Dario Garcia-Garcia

The problem of incorporating information from observations received serially in time is widespread in the field of uncertainty quantification. Within a probabilistic framework, such problems can be addressed using standard filtering…

Methodology · Statistics 2024-12-02 Chatchuea Kimchaiwong , Jeremie Houssineau , Adam M. Johansen

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

Composite likelihood inference has gained much popularity thanks to its computational manageability and its theoretical properties. Unfortunately, performing composite likelihood ratio tests is inconvenient because of their awkward…

Computation · Statistics 2014-08-01 Manuela Cattelan , Nicola Sartori

The inability to correctly resolve rumours circulating online can have harmful real-world consequences. We present a method for incorporating model and data uncertainty estimates into natural language processing models for automatic rumour…

Computation and Language · Computer Science 2020-05-15 Elena Kochkina , Maria Liakata

How can we draw trustworthy scientific conclusions? One criterion is that a study can be replicated by independent teams. While replication is critically important, it is arguably insufficient. If a study is biased for some reason and other…

Methodology · Statistics 2025-02-06 Yujin Jeong , Dominik Rothenhäusler

Statistical estimation of the prediction uncertainty of physical models is typically hindered by the inadequacy of these models due to various approximations they are built upon. The prediction errors due to model inadequacy can be handled…

Data Analysis, Statistics and Probability · Physics 2017-09-11 Pascal Pernot

Uncertainty decomposition refers to the task of decomposing the total uncertainty of a predictive model into aleatoric (data) uncertainty, resulting from inherent randomness in the data-generating process, and epistemic (model) uncertainty,…

Computation and Language · Computer Science 2024-06-12 Bairu Hou , Yujian Liu , Kaizhi Qian , Jacob Andreas , Shiyu Chang , Yang Zhang