English
Related papers

Related papers: Knowledge Elicitation via Sequential Probabilistic…

200 papers

In this work we study the problem of inferring a discrete probability distribution using both expert knowledge and empirical data. This is an important issue for many applications where the scarcity of data prevents a purely empirical…

Machine Learning · Computer Science 2020-01-08 Rémi Besson , Erwan Le Pennec , Stéphanie Allassonnière

Background: The uptake of formalized prior elicitation from experts in Bayesian clinical trials has been limited due to challenges such as complex statistical modeling, lack of practical tools, and the cognitive burden placed on experts…

Methodology · Statistics 2025-09-15 Yongdong Ouyang , Janice J Eng , Denghuang Zhan , Hubert Wong , The WnW Research Team

Decision making or scientific discovery pipelines such as job hiring and drug discovery often involve multiple stages: before any resource-intensive step, there is often an initial screening that uses predictions from a machine learning…

Methodology · Statistics 2023-05-30 Ying Jin , Emmanuel J. Candès

Sequential recommendation models user interests based on historical behaviors to provide personalized recommendation. Previous sequential recommendation algorithms primarily employ neural networks to extract features of user interests,…

Information Retrieval · Computer Science 2024-09-24 Li Li , Mingyue Cheng , Zhiding Liu , Hao Zhang , Qi Liu , Enhong Chen

In this paper we propose efficient methods for elicitation of complexly structured preferences and utilize these in problems of decision making under (severe) uncertainty. Based on the general framework introduced in Jansen, Schollmeyer and…

Artificial Intelligence · Computer Science 2022-02-02 Christoph Jansen , Hannah Blocher , Thomas Augustin , Georg Schollmeyer

Applications of machine learning often involve making predictions based on both model outputs and the opinions of human experts. In this context, we investigate the problem of querying experts for class label predictions, using as few human…

Machine Learning · Computer Science 2025-06-09 Markelle Kelly , Alex Boyd , Sam Showalter , Mark Steyvers , Padhraic Smyth

Within psychology, neuroscience and artificial intelligence, there has been increasing interest in the proposal that the brain builds probabilistic models of sensory and linguistic input: that is, to infer a probabilistic model from a…

Machine Learning · Computer Science 2017-08-08 Paul M. B. Vitanyi , Nick Chater

Large language models (LLMs) have been proposed as alternatives to human experts for estimating unknown quantities with associated uncertainty, a process known as Bayesian elicitation. We test this by asking eleven LLMs to estimate…

Artificial Intelligence · Computer Science 2026-04-03 Luka Hobor , Mario Brcic , Mihael Kovac , Kristijan Poje

Eliciting a high-dimensional probability distribution from an expert via noisy judgments is notoriously challenging, yet useful for many applications, such as prior elicitation and reward modeling. We introduce a method for eliciting the…

Machine Learning · Computer Science 2024-10-17 Petrus Mikkola , Luigi Acerbi , Arto Klami

As datasets grow larger, they are often distributed across multiple machines that compute in parallel and communicate with a central machine through short messages. In this paper, we focus on sparse regression and propose a new procedure…

Methodology · Statistics 2023-03-14 Sifan Liu , Snigdha Panigrahi

Species distribution models (SDMs) are key tools in ecology, conservation and management of natural resources. They are commonly trained by scientific survey data but, since surveys are expensive, there is a need for complementary sources…

Methodology · Statistics 2026-04-03 Karel Kaurila , Sanna Kuningas , Antti Lappalainen , Jarno Vanhatalo

This paper discusses predictive inference and feature selection for generalized linear models with scarce but high-dimensional data. We argue that in many cases one can benefit from a decision theoretically justified two-stage approach:…

Machine Learning · Statistics 2020-11-09 Juho Piironen , Markus Paasiniemi , Aki Vehtari

In building Bayesian belief networks, the elicitation of all probabilities required can be a major obstacle. We learned the extent of this often-cited observation in the construction of the probabilistic part of a complex influence diagram…

Artificial Intelligence · Computer Science 2013-01-30 Linda C. van der Gaag , Silja Renooij , Cilia L. M. Witteman , Berthe M. P. Aleman , Babs G. Taal

The integration of large language models (LLMs) and search engines represents a significant evolution in knowledge acquisition methodologies. However, determining the knowledge that an LLM already possesses and the knowledge that requires…

Computation and Language · Computer Science 2024-05-31 Jiejun Tan , Zhicheng Dou , Yutao Zhu , Peidong Guo , Kun Fang , Ji-Rong Wen

User preferences for automated assistance often vary widely, depending on the situation, and quality or presentation of help. Developing effectivemodels to learn individual preferences online requires domain models that associate…

Artificial Intelligence · Computer Science 2012-06-18 Bowen Hui , Craig Boutilier

We develop a model-based empirical Bayes approach to variable selection problems in which the number of predictors is very large, possibly much larger than the number of responses (the so-called 'large p, small n' problem). We consider the…

Methodology · Statistics 2015-10-14 Haim Y. Bar , James G. Booth , Martin T. Wells

Accurate prediction of user consumption is a key part not only in understanding consumer flexibility and behavior patterns, but in the design of robust and efficient energy saving programs as well. Existing prediction methods usually have…

Machine Learning · Statistics 2017-02-22 Pan Li , Baosen Zhang , Yang Weng , Ram Rajagopal

We study the problem of eliciting and aggregating probabilistic information from multiple agents. In order to successfully aggregate the predictions of agents, the principal needs to elicit some notion of confidence from agents, capturing…

Computer Science and Game Theory · Computer Science 2014-10-03 Rafael M. Frongillo , Yiling Chen , Ian A. Kash

A key distinguishing feature of conversational recommender systems over traditional recommender systems is their ability to elicit user preferences using natural language. Currently, the predominant approach to preference elicitation is to…

Information Retrieval · Computer Science 2025-04-09 Ivica Kostric , Krisztian Balog , Filip Radlinski

A statistical method for the elicitation of priors in Bayesian generalised linear models (GLMs) and extensions is proposed. Probabilistic predictions are elicited from the expert to parametrise a multivariate t prior distribution for the…

Methodology · Statistics 2025-02-21 Geoffrey R. Hosack