English
Related papers

Related papers: Bayesian active learning for choice models with de…

200 papers

Neural networks and Gaussian processes are complementary in their strengths and weaknesses. Having a better understanding of their relationship comes with the promise to make each method benefit from the strengths of the other. In this…

Modelling human function learning has been the subject of in-tense research in cognitive sciences. The topic is relevant in black-box optimization where information about the objective and/or constraints is not available and must be learned…

Computers and Society · Computer Science 2020-03-10 Antonio Candelieri , Riccardo Perego , Ilaria Giordani , Andrea Ponti , Francesco Archetti

We study stochastic optimization with data-adaptive sampling schemes to train pairwise learning models. Pairwise learning is ubiquitous, and it covers several popular learning tasks such as ranking, metric learning and AUC maximization. A…

Machine Learning · Computer Science 2025-04-10 Sijia Zhou , Yunwen Lei , Ata Kabán

Data generation and labeling are often expensive in robot learning. Preference-based learning is a concept that enables reliable labeling by querying users with preference questions. Active querying methods are commonly employed in…

Machine Learning · Computer Science 2024-02-27 Erdem Bıyık , Nima Anari , Dorsa Sadigh

Active learning is able to reduce the amount of labelling effort by using a machine learning model to query the user for specific inputs. While there are many papers on new active learning techniques, these techniques rarely satisfy the…

Machine Learning · Computer Science 2020-06-18 Parmida Atighehchian , Frédéric Branchaud-Charron , Alexandre Lacoste

While the choice of prior is one of the most critical parts of the Bayesian inference workflow, recent Bayesian deep learning models have often fallen back on vague priors, such as standard Gaussians. In this review, we highlight the…

Machine Learning · Statistics 2022-03-21 Vincent Fortuin

We study pool-based active learning with abstention feedbacks where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian…

Machine Learning · Computer Science 2021-01-01 Cuong V. Nguyen , Lam Si Tung Ho , Huan Xu , Vu Dinh , Binh Nguyen

We argue for the use of active learning methods for player modelling. In active learning, the learning algorithm chooses where to sample the search space so as to optimise learning progress. We hypothesise that player modelling based on…

Machine Learning · Computer Science 2013-12-11 Julian Togelius , Noor Shaker , Georgios N. Yannakakis

In machine learning, active class selection (ACS) algorithms aim to actively select a class and ask the oracle to provide an instance for that class to optimize a classifier's performance while minimizing the number of requests. In this…

This paper proposes a method for solving optimization problems in which the decision-maker cannot evaluate the objective function, but rather can only express a preference such as "this is better than that" between two candidate decision…

Machine Learning · Computer Science 2019-10-01 Alberto Bemporad , Dario Piga

Large language models (LLMs) have shown remarkable success, but aligning them with human preferences remains a core challenge. As individuals have their own, multi-dimensional preferences, recent studies have explored multi-dimensional…

Machine Learning · Computer Science 2025-06-03 Minhyeon Oh , Seungjoon Lee , Jungseul Ok

We devise an algorithm using a Bayesian optimization framework in conjunction with contextual visual data for the efficient localization of objects in still images. Recent research has demonstrated substantial progress in object…

Computer Vision and Pattern Recognition · Computer Science 2017-09-21 Anthony D. Rhodes , Jordan Witte , Melanie Mitchell , Bruno Jedynak

We consider the problem of calibration and uncertainty analysis for activity-based transportation simulators. Activity-Based Models (ABMs) rely on statistical modeling of individual travelers' behavior to predict higher-order travel…

Applications · Statistics 2022-09-07 Laura Schultz , Joshua Auld , Vadim Sokolov

To identify a stationary action profile for a population of competitive agents, each executing private strategies, we introduce a novel active-learning scheme where a centralized external observer (or entity) can probe the agents' reactions…

Systems and Control · Electrical Eng. & Systems 2024-10-10 Filippo Fabiani , Alberto Bemporad

Typical models of learning assume incremental estimation of continuously-varying decision variables like expected rewards. However, this class of models fails to capture more idiosyncratic, discrete heuristics and strategies that people and…

Machine Learning · Computer Science 2024-02-27 Carlos G. Correa , Thomas L. Griffiths , Nathaniel D. Daw

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper

Agents that interact with other agents often do not know a priori what the other agents' strategies are, but have to maximise their own online return while interacting with and learning about others. The optimal adaptive behaviour under…

Machine Learning · Computer Science 2022-04-19 Luisa Zintgraf , Sam Devlin , Kamil Ciosek , Shimon Whiteson , Katja Hofmann

Estimating personalized treatment effects from high-dimensional observational data is essential in situations where experimental designs are infeasible, unethical, or expensive. Existing approaches rely on fitting deep models on outcomes…

Machine Learning · Computer Science 2022-02-02 Andrew Jesson , Panagiotis Tigas , Joost van Amersfoort , Andreas Kirsch , Uri Shalit , Yarin Gal

In heterogeneous rank aggregation problems, users often exhibit various accuracy levels when comparing pairs of items. Thus a uniform querying strategy over users may not be optimal. To address this issue, we propose an elimination-based…

Machine Learning · Computer Science 2021-10-11 Yue Wu , Tao Jin , Hao Lou , Pan Xu , Farzad Farnoud , Quanquan Gu

In many real world problems, control decisions have to be made with limited information. The controller may have no a priori (or even posteriori) data on the nonlinear system, except from a limited number of points that are obtained over…

Optimization and Control · Mathematics 2011-05-12 Tansu Alpcan