English
Related papers

Related papers: Bayes-Optimal Entropy Pursuit for Active Choice-Ba…

200 papers

Real-life combinatorial optimization problems often involve several conflicting objectives, such as price, product quality and sustainability. A computationally-efficient way to tackle multiple objectives is to aggregate them into a…

Artificial Intelligence · Computer Science 2025-08-28 Marianne Defresne , Jayanta Mandi , Tias Guns

In coming years residential consumers will face real-time electricity tariffs with energy prices varying day to day, and effective energy saving will require automation - a recommender system, which learns consumer's preferences from her…

Machine Learning · Computer Science 2017-02-01 Mikhail V. Goubko , Sergey O. Kuznetsov , Alexey A. Neznanov , Dmitry I. Ignatov

Bayesian Reinforcement Learning (RL) is capable of not only incorporating domain knowledge, but also solving the exploration-exploitation dilemma in a natural way. As Bayesian RL is intractable except for special cases, previous work has…

Artificial Intelligence · Computer Science 2013-06-14 Kenji Kawaguchi , Mauricio Araya

Collaborative filtering is a useful technique for exploiting the preference patterns of a group of users to predict the utility of items for the active user. In general, the performance of collaborative filtering depends on the number of…

Machine Learning · Computer Science 2012-07-19 Rong Jin , Luo Si

We study the learning problem of revealed preference in a stochastic setting: a learner observes the utility-maximizing actions of a set of agents whose utility follows some unknown distribution, and the learner aims to infer the…

Optimization and Control · Mathematics 2022-06-06 John R. Birge , Xiaocheng Li , Chunlin Sun

Recommender systems trained in a continuous learning fashion are plagued by the feedback loop problem, also known as algorithmic bias. This causes a newly trained model to act greedily and favor items that have already been engaged by…

Machine Learning · Computer Science 2020-08-04 Dalin Guo , Sofia Ira Ktena , Ferenc Huszar , Pranay Kumar Myana , Wenzhe Shi , Alykhan Tejani

Modern recommendation systems rely on exploration to learn user preferences for new items, typically implementing uniform exploration policies (e.g., epsilon-greedy) due to their simplicity and compatibility with machine learning (ML)…

Machine Learning · Computer Science 2025-06-05 Ethan Che , Hakan Ceylan , James McInerney , Nathan Kallus

Science and Engineering applications are typically associated with expensive optimization problems to identify optimal design solutions and states of the system of interest. Bayesian optimization and active learning compute surrogate models…

Machine Learning · Computer Science 2024-07-09 Francesco Di Fiore , Michela Nardelli , Laura Mainini

Current music recommender systems typically act in a greedy fashion by recommending songs with the highest user ratings. Greedy recommendation, however, is suboptimal over the long term: it does not actively gather information on user…

Multimedia · Computer Science 2013-11-26 Xinxi Wang , Yi Wang , David Hsu , Ye Wang

We introduce a new incremental preference elicitation procedure able to deal with noisy responses of a Decision Maker (DM). The originality of the contribution is to propose a Bayesian approach for determining a preferred solution in a…

Artificial Intelligence · Computer Science 2020-07-30 Nadjet Bourdache , Patrice Perny , Olivier Spanjaard

We consider the problem of prediction by a machine learning algorithm, called learner, within an adversarial learning setting. The learner's task is to correctly predict the class of data passed to it as a query. However, along with queries…

Machine Learning · Computer Science 2020-02-11 Prithviraj Dasgupta , Joseph B. Collins , Michael McCarrick

Effective learning of user preferences is critical to easing user burden in various types of matching problems. Equally important is active query selection to further reduce the amount of preference information users must provide. We…

Machine Learning · Computer Science 2012-06-22 Laurent Charlin , Rich Zemel , Craig Boutilier

We consider sequential decision making problems for binary classification scenario in which the learner takes an active role in repeatedly selecting samples from the action pool and receives the binary label of the selected alternatives.…

Machine Learning · Statistics 2015-10-09 Yingfei Wang , Chu Wang , Warren Powell

We study the problem of eliciting the preferences of a decision-maker through a moderate number of pairwise comparison queries to make them a high quality recommendation for a specific problem. We are motivated by applications in high…

Optimization and Control · Mathematics 2021-12-09 Phebe Vayanos , Yingxiao Ye , Duncan McElfresh , John Dickerson , Eric Rice

A framework is introduced for actively and adaptively solving a sequence of machine learning problems, which are changing in bounded manner from one time step to the next. An algorithm is developed that actively queries the labels of the…

Machine Learning · Computer Science 2018-05-31 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization…

Probability · Mathematics 2018-03-30 C. Soizea , R. Ghanem , C. Safta , X. Huan , Z. P. Vane , J. Oefelein , G. Lacaz , H. N. Najm , Q. Tang , X. Chen

Semi-supervised classification, one of the most prominent fields in machine learning, studies how to combine the statistical knowledge of the often abundant unlabeled data with the often limited labeled data in order to maximize overall…

Information Theory · Computer Science 2020-02-07 Vahid Jamali , Antonia Tulino , Jaime Llorca , Elza Erkip

Computational preference elicitation methods are tools used to learn people's preferences quantitatively in a given context. Recent works on preference elicitation advocate for active learning as an efficient method to iteratively construct…

Human-Computer Interaction · Computer Science 2024-07-29 Vijay Keswani , Vincent Conitzer , Hoda Heidari , Jana Schaich Borg , Walter Sinnott-Armstrong

The ultimate goal of optimization is to find the minimizer of a target function.However, typical criteria for active optimization often ignore the uncertainty about the minimizer. We propose a novel criterion for global optimization and an…

Methodology · Statistics 2012-02-13 Il Memming Park , Marcel Nassar , Mijung Park

We consider the problem of group testing with sum observations and noiseless answers, in which we aim to locate multiple objects by querying the number of objects in each of a sequence of chosen sets. We study a probabilistic setting with…

Information Theory · Computer Science 2015-09-24 Weidong Han , Purnima Rajan , Peter I. Frazier , Bruno M. Jedynak