English
Related papers

Related papers: Active Algorithms For Preference Learning Problems…

200 papers

We construct and analyze active learning algorithms for the problem of binary classification with abstention. We consider three abstention settings: \emph{fixed-cost} and two variants of \emph{bounded-rate} abstention, and for each of them…

Machine Learning · Computer Science 2019-06-04 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

We consider the problem of learning the preferences of a heterogeneous population by observing choices from an assortment of products, ads, or other offerings. Our observation model takes a form common in assortment planning applications:…

Machine Learning · Statistics 2016-06-09 Nathan Kallus , Madeleine Udell

We study a class of private learning problems in which the data is a join of private and public features. This is often the case in private personalization tasks such as recommendation or ad prediction, in which features related to…

Machine Learning · Computer Science 2023-10-25 Walid Krichene , Nicolas Mayoraz , Steffen Rendle , Shuang Song , Abhradeep Thakurta , Li Zhang

This paper considers the task of learning users' preferences on a combinatorial set of alternatives, as generally used by online configurators, for example. In many settings, only a set of selected alternatives during past interactions is…

Artificial Intelligence · Computer Science 2022-09-26 Hélène Fargier , Pierre-François Gimenez , Jérôme Mengin , Bao Ngoc Le Nguyen

In consumer theory, ranking available objects by means of preference relations yields the most common description of individual choices. However, preference-based models assume that individuals: (1) give their preferences only between pairs…

Machine Learning · Computer Science 2023-02-02 Alessio Benavoli , Dario Azzimonti , Dario Piga

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

Machine Learning · Statistics 2023-09-19 Yaqi Duan , Kaizheng Wang

In many practical applications of learning algorithms, unlabeled data is cheap and abundant whereas labeled data is expensive. Active learning algorithms developed to achieve better performance with lower cost. Usually Representativeness…

Machine Learning · Computer Science 2016-08-26 Hossein Ghafarian , Hadi Sadoghi Yazdi

In machine learning, active class selection (ACS) algorithms aim to actively select a class and ask the oracle to provide an instance for that class to optimize a classifier's performance while minimizing the number of requests. In this…

Humans use social context to specify preferences over behaviors, i.e. their reward functions. Yet, algorithms for inferring reward models from preference data do not take this social learning view into account. Inspired by pragmatic human…

Machine Learning · Computer Science 2024-05-24 Andi Peng , Yuying Sun , Tianmin Shu , David Abel

We consider the problem of probably approximately correct (PAC) ranking $n$ items by adaptively eliciting subset-wise preference feedback. At each round, the learner chooses a subset of $k$ items and observes stochastic feedback indicating…

Machine Learning · Computer Science 2019-03-06 Aadirupa Saha , Aditya Gopalan

We study the active learning problem of top-$k$ ranking from multi-wise comparisons under the popular multinomial logit model. Our goal is to identify the top-$k$ items with high probability by adaptively querying sets for comparisons and…

Data Structures and Algorithms · Computer Science 2017-08-01 Xi Chen , Yuanzhi Li , Jieming Mao

The classical linear ordering problem seeks a single ranking representing a given preference matrix. While suitable for homogeneous populations, it fails when observed preferences arise from several latent groups with distinct ranking…

Optimization and Control · Mathematics 2026-05-15 Juan A. Aledo , Concepción Domínguez , Juan de Dios Jaime-Alcántara , Mercedes Landete

The problem of learning the structure of a high dimensional graphical model from data has received considerable attention in recent years. In many applications such as sensor networks and proteomics it is often expensive to obtain samples…

Machine Learning · Statistics 2016-04-08 Gautam Dasarathy , Aarti Singh , Maria-Florina Balcan , Jong Hyuk Park

Social choice has become a foundational component of modern machine learning systems. From auctions and resource allocation to the alignment of large generative models, machine learning pipelines increasingly aggregate heterogeneous…

Artificial Intelligence · Computer Science 2026-02-24 Zhiyu An , Wan Du

Active Learning is concerned with the question of how to identify the most useful samples for a Machine Learning algorithm to be trained with. When applied correctly, it can be a very powerful tool to counteract the immense data…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Lukas Hahn , Lutz Roese-Koerner , Peet Cremer , Urs Zimmermann , Ori Maoz , Anton Kummert

We introduce a model that learns active learning algorithms via metalearning. For a distribution of related tasks, our model jointly learns: a data representation, an item selection heuristic, and a method for constructing prediction…

Machine Learning · Computer Science 2017-08-02 Philip Bachman , Alessandro Sordoni , Adam Trischler

We study a ranking and selection problem of learning from choice-based feedback with dynamic assortments. In this problem, a company sequentially displays a set of items to a population of customers and collects their choices as feedback.…

Machine Learning · Computer Science 2025-01-03 Junwen Yang , Yifan Feng

Designing reward functions is a challenging problem in AI and robotics. Humans usually have a difficult time directly specifying all the desirable behaviors that a robot needs to optimize. One common approach is to learn reward functions…

Robotics · Computer Science 2020-06-05 Erdem Bıyık , Nicolas Huynh , Mykel J. Kochenderfer , Dorsa Sadigh

This paper studies the problem of finding the exact ranking from noisy comparisons. A comparison over a set of $m$ items produces a noisy outcome about the most preferred item, and reveals some information about the ranking. By repeatedly…

Machine Learning · Computer Science 2021-07-30 Wenbo Ren , Jia Liu , Ness B. Shroff

Hybrid crowd-machine classifiers can achieve superior performance by combining the cost-effectiveness of automatic classification with the accuracy of human judgment. This paper shows how crowd and machines can support each other in…

Machine Learning · Computer Science 2021-01-25 Evgeny Krivosheev , Fabio Casati , Alessandro Bozzon