English
Related papers

Related papers: Generalized Bayes Quantification Learning under Da…

200 papers

In this paper, the Gaussian quasi likelihood ratio test (GQLRT) for non-Bayesian binary hypothesis testing is generalized by applying a transform to the probability distribution of the data. The proposed generalization, called…

Methodology · Statistics 2017-11-22 Nir Halay , Koby Todros , Alfred O. Hero

According to the principle of compositional generalization, the meaning of a complex expression can be understood as a function of the meaning of its parts and of how they are combined. This principle is crucial for human language…

Computation and Language · Computer Science 2024-03-19 Sungjun Han , Sebastian Padó

Given a multivariate function taking deterministic and uncertain inputs, we consider the problem of estimating a quantile set: a set of deterministic inputs for which the probability that the output belongs to a specific region remains…

Applications · Statistics 2025-07-25 Romain Ait Abdelmalek-Lomenech , Julien Bect , Emmanuel Vazquez

Recently, several Bayesian deep learning methods have been proposed for semi-supervised medical image segmentation. Although they have achieved promising results on medical benchmarks, some problems are still existing. Firstly, their…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Jianfeng Wang , Thomas Lukasiewicz

Ensemble algorithms offer state of the art performance in many machine learning applications. A common explanation for their excellent performance is due to the bias-variance decomposition of the mean squared error which shows that the…

Machine Learning · Computer Science 2020-12-10 Sebastian Buschjäger , Lukas Pfahler , Katharina Morik

We establish in-expectation and tail bounds on the generalization error of representation learning type algorithms. The bounds are in terms of the relative entropy between the distribution of the representations extracted from the training…

Machine Learning · Statistics 2025-03-21 Milad Sefidgaran , Abdellatif Zaidi , Piotr Krasnowski

While the Graybox characterization method allows for implicit noise models and is platform-agnostic, the method lacks uncertainty quantification. Characterization of quantum devices is a crucial process that enables researchers to gain…

Quantum Physics · Physics 2025-09-30 Poramet Pathumsoot , Michal Hajdušek , Rodney Van Meter

Generalization beyond the training distribution is a core challenge in machine learning. The common practice of mixing and shuffling examples when training neural networks may not be optimal in this regard. We show that partitioning the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Damien Teney , Ehsan Abbasnejad , Anton van den Hengel

Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated…

Machine Learning · Computer Science 2024-11-21 Sebastian Bieringer , Sascha Diefenbacher , Gregor Kasieczka , Mathias Trabs

Self-supervised learning has been a powerful approach for learning meaningful representations from unlabeled data across various domains, reducing the reliance on large labeled datasets. Inspired by BERT's success in capturing deep…

Machine Learning · Computer Science 2025-02-05 Hoang M. Nguyen , Satya N. Shukla , Qiang Zhang , Hanchao Yu , Sreya D. Roy , Taipeng Tian , Lingjiong Zhu , Yuchen Liu

Crowdsourcing has emerged as an effective means for performing a number of machine learning tasks such as annotation and labelling of images and other data sets. In most early settings of crowdsourcing, the task involved classification,…

Machine Learning · Computer Science 2020-06-03 Desmond Cai , Duc Thien Nguyen , Shiau Hong Lim , Laura Wynter

Quantification is a supervised learning task that consists in predicting, given a set of classes C and a set D of unlabelled items, the prevalence (or relative frequency) p(c|D) of each class c in C. Quantification can in principle be…

Machine Learning · Computer Science 2021-09-22 Andrea Esuli , Alejandro Moreo Fernández , Fabrizio Sebastiani

Bayesian transfer learning (BTL) is defined in this paper as the task of conditioning a target probability distribution on a transferred source distribution. The target globally models the interaction between the source and target, and…

Machine Learning · Computer Science 2021-01-19 Milan Papež , Anthony Quinn

In machine learning, if the training data is an unbiased sample of an underlying distribution, then the learned classification function will make accurate predictions for new samples. However, if the training data is not an unbiased sample,…

Machine Learning · Computer Science 2019-01-15 Wouter M. Kouw , Marco Loog

Quantification, also known as class prevalence estimation, is the supervised learning task in which a model is trained to predict the prevalence of each class in a given bag of examples. This paper investigates the application of deep…

Machine Learning · Computer Science 2024-03-25 Olaya Pérez-Mon , Alejandro Moreo , Juan José del Coz , Pablo González

Quantile regression is a fundamental problem in statistical learning motivated by a need to quantify uncertainty in predictions, or to model a diverse population without being overly reductive. For instance, epidemiological forecasts, cost…

Machine Learning · Statistics 2023-04-18 Rasool Fakoor , Taesup Kim , Jonas Mueller , Alexander J. Smola , Ryan J. Tibshirani

In prediction problems, it is common to model the data-generating process and then use a model-based procedure, such as a Bayesian predictive distribution, to quantify uncertainty about the next observation. However, if the posited model is…

Methodology · Statistics 2021-07-06 Pei-Shien Wu , Ryan Martin

Climate models are generally calibrated manually by comparing selected climate statistics, such as the global top-of-atmosphere energy balance, to observations. The manual tuning only targets a limited subset of observational data and…

Atmospheric and Oceanic Physics · Physics 2022-04-06 Michael F. Howland , Oliver R. A. Dunbar , Tapio Schneider

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

Machine Learning · Statistics 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull