English
Related papers

Related papers: Efficient Bayesian Inference from Noisy Pairwise C…

200 papers

We study density estimation from pairwise comparisons, motivated by expert knowledge elicitation and learning from human feedback. We relate the unobserved target density to a tempered winner density (marginal density of preferred choices),…

Machine Learning · Computer Science 2026-03-26 Petrus Mikkola , Luigi Acerbi , Arto Klami

As machine learning becomes more prominent there is a growing demand to perform several inference tasks in parallel. Running a dedicated model for each task is computationally expensive and therefore there is a great interest in multi-task…

Machine Learning · Computer Science 2024-05-14 Idan Achituve , Idit Diamant , Arnon Netzer , Gal Chechik , Ethan Fetaya

Noisy-OR Bayesian Networks (BNs) are a family of probabilistic graphical models which express rich statistical dependencies in binary data. Variational inference (VI) has been the main method proposed to learn noisy-OR BNs with complex…

Machine Learning · Computer Science 2023-02-02 Antoine Dedieu , Guangyao Zhou , Dileep George , Miguel Lazaro-Gredilla

Causal inference using observational text data is becoming increasingly popular in many research areas. This paper presents the Bayesian Topic Regression (BTR) model that uses both text and numerical information to model an outcome…

Machine Learning · Statistics 2021-09-14 Maximilian Ahrens , Julian Ashwin , Jan-Peter Calliess , Vu Nguyen

Modern data analysis increasingly requires flexible conditional inference P(X_B | X_A) where (X_A, X_B) is an arbitrary partition of observed variable X. Existing approaches are either restricted to a fixed conditioning structure or depend…

Machine Learning · Statistics 2026-03-11 Qiao Liu , Wing Hung Wong

Count outcomes in longitudinal studies are frequent in clinical and engineering studies. In frequentist and Bayesian statistical analysis, methods such as Mixed linear models allow the variability or correlation within individuals to be…

Methodology · Statistics 2024-07-15 Alejandra Estefanía Patiño Hoyos , Johnatan Cardona Jiménez

We introduce a novel noisy sorting model motivated by the Just Noticeable Difference (JND) model from experimental psychology. The goal of our model is to capture the low quality of the data that are collected from crowdsourcing…

Data Structures and Algorithms · Computer Science 2023-10-24 Ellen Vitercik , Manolis Zampetakis , David Zhang

Preferential Bayesian optimization allows optimization of objectives that are either expensive or difficult to measure directly, by relying on a minimal number of comparative evaluations done by a human expert. Generating candidate…

Contaminant observations and outliers often cause problems when estimating the parameters of cognitive models, which are statistical models representing cognitive processes. In this study, we test and improve the robustness of parameter…

Machine Learning · Statistics 2025-11-13 Yufei Wu , Stefan T. Radev , Francis Tuerlinckx

With the increased interest in machine learning and big data problems, the need for large amounts of labelled data has also grown. However, it is often infeasible to get experts to label all of this data, which leads many practitioners to…

Machine Learning · Computer Science 2021-05-31 Pierce Burke , Richard Klein

Comparing competing mathematical models of complex natural processes is a shared goal among many branches of science. The Bayesian probabilistic framework offers a principled way to perform model comparison and extract useful metrics for…

Gradient boosting machines (GBMs) based on decision trees consistently demonstrate state-of-the-art results on regression and classification tasks with tabular data, often outperforming deep neural networks. However, these models do not…

Machine Learning · Computer Science 2023-02-23 Tristan Cinquin , Tammo Rukat , Philipp Schmidt , Martin Wistuba , Artur Bekasov

Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated…

Machine Learning · Computer Science 2024-11-21 Sebastian Bieringer , Sascha Diefenbacher , Gregor Kasieczka , Mathias Trabs

This paper deals with the estimation of the unknown distribution of hidden random variables from the observation of pairwise comparisons between these variables. This problem is inspired by recent developments on Bradley-Terry models in…

Statistics Theory · Mathematics 2018-08-27 Sylvain Le Corff , Matthieu Lerasle , Elodie Vernet

We propose a novel combinatorial inference framework to conduct general uncertainty quantification in ranking problems. We consider the widely adopted Bradley-Terry-Luce (BTL) model, where each item is assigned a positive preference score…

Machine Learning · Statistics 2021-10-04 Yue Liu , Ethan X. Fang , Junwei Lu

The deployment of large-scale generative models is often restricted by their potential risk of causing harm to users in unpredictable ways. We focus on the problem of black-box red teaming, where a red team generates test cases and…

Artificial Intelligence · Computer Science 2023-05-30 Deokjae Lee , JunYeong Lee , Jung-Woo Ha , Jin-Hwa Kim , Sang-Woo Lee , Hwaran Lee , Hyun Oh Song

A common problem faced in statistical inference is drawing conclusions from paired comparisons, in which two objects compete and one is declared the victor. A probabilistic approach to such a problem is the Bradley-Terry model, first…

Applications · Statistics 2017-12-19 Gabriel C. Phelan , John T. Whelan

Active learning methods for neural networks are usually based on greedy criteria which ultimately give a single new design point for the evaluation. Such an approach requires either some heuristics to sample a batch of design points at one…

Machine Learning · Computer Science 2020-01-28 Evgenii Tsymbalov , Sergei Makarychev , Alexander Shapeev , Maxim Panov

We pursue tractable Bayesian analysis of generalized linear models (GLMs) for categorical data. Thus far, GLMs are difficult to scale to more than a few dozen categories due to non-conjugacy or strong posterior dependencies when using…

Machine Learning · Statistics 2022-06-02 Michael T. Wojnowicz , Shuchin Aeron , Eric L. Miller , Michael C. Hughes

Modern deterministic retrieval pipelines prioritize achieving state-of-the-art performance but often lack interpretability in decision-making. These models face challenges in assessing uncertainty, leading to overconfident predictions. To…

Information Retrieval · Computer Science 2024-02-06 EuiYul Song , Philhoon Oh , Sangryul Kim , James Thorne