English
Related papers

Related papers: A Bayesian Choice Model for Eliminating Feedback L…

200 papers

Preferential Bayesian optimization allows optimization of objectives that are either expensive or difficult to measure directly, by relying on a minimal number of comparative evaluations done by a human expert. Generating candidate…

Accurate prediction of users' responses to items is one of the main aims of many computational advising applications. Examples include recommending movies, news articles, songs, jobs, clothes, books and so forth. Accurate prediction of…

Applications · Statistics 2022-12-20 Baode Gao , Guangpeng Zhan , Hanzhang Wang , Yiming Wang , Shengxin Zhu

Optimization of experimental materials synthesis and characterization through active learning methods has been growing over the last decade, with examples ranging from measurements of diffraction on combinatorial alloys at synchrotrons, to…

Here we focus on the description of the mechanisms behind the process of information aggregation and decision making, a basic step to understand emergent phenomena in society, such as trends, information spreading or the wisdom of crowds.…

Physics and Society · Physics 2015-04-15 Víctor M. Eguíluz , N. Masuda , J. Fernández-Gracia

It is common in recommendation systems that users both consume and produce information as they make strategic choices under uncertainty. While a social planner would balance "exploration" and "exploitation" using a multi-armed bandit…

Computer Science and Game Theory · Computer Science 2019-02-20 Nicole Immorlica , Jieming Mao , Aleksandrs Slivkins , Zhiwei Steven Wu

Recommender systems are used in variety of domains affecting people's lives. This has raised concerns about possible biases and discrimination that such systems might exacerbate. There are two primary kinds of biases inherent in recommender…

Information Retrieval · Computer Science 2018-09-25 Golnoosh Farnadi , Pigi Kouki , Spencer K. Thompson , Sriram Srinivasan , Lise Getoor

Bayesian persuasion studies how an informed sender should influence beliefs of rational receivers who take decisions through Bayesian updating of a common prior. We focus on the online Bayesian persuasion framework, in which the sender…

Computer Science and Game Theory · Computer Science 2023-03-03 Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Alberto Marchesi , Nicola Gatti , Francesco Trovò

Recommender systems are indispensable because they influence our day-to-day behavior and decisions by giving us personalized suggestions. Services like Kindle, Youtube, and Netflix depend heavily on the performance of their recommender…

Information Retrieval · Computer Science 2021-12-07 Shrikant Saxena , Shweta Jain

Designing recommendation systems that serve content aligned with time varying preferences requires proper accounting of the feedback effects of recommendations on human behavior and psychological condition. We argue that modeling the…

Information Retrieval · Computer Science 2022-08-09 Mihaela Curmei , Andreas Haupt , Dylan Hadfield-Menell , Benjamin Recht

Many approaches for optimizing decision making models rely on gradient based methods requiring informative feedback from the environment. However, in the case where such feedback is sparse or uninformative, such approaches may result in…

Machine Learning · Computer Science 2024-11-12 Mohit Rajpal , Lac Gia Tran , Yehong Zhang , Bryan Kian Hsiang Low

The rapid advancement of large language models (LLMs) has led to growing interest in using synthetic data to train future models. However, this creates a self-consuming retraining loop, where models are trained on their own outputs and may…

Artificial Intelligence · Computer Science 2026-01-09 Yaxuan Wang , Zhongteng Cai , Yujia Bao , Xueru Zhang , Yang Liu

Optimization with preference feedback is an active research area with many applications in engineering systems where humans play a central role, such as building control and autonomous vehicles. While most existing studies focus on…

Optimization and Control · Mathematics 2026-03-31 Wenbin Wang , Wenjie Xu , Colin N. Jones

The challenge of balancing user relevance and content diversity in recommender systems is increasingly critical amid growing concerns about content homogeneity and reduced user engagement. In this work, we propose a novel framework that…

Information Retrieval · Computer Science 2025-06-30 Hiba Bederina , Jill-Jênn Vie

Recommendation systems underlie a variety of online platforms. These recommendation systems and their users form a feedback loop, wherein the former aims to maximize user engagement through personalization and the promotion of popular…

Information Retrieval · Computer Science 2025-04-11 Atefeh Mollabagher , Parinaz Naghizadeh

We have developed a conversational recommendation system designed to help users navigate through a set of limited options to find the best choice. Unlike many internet scale systems that use a singular set of search terms and return a…

Computation and Language · Computer Science 2021-04-15 Victor S. Bursztyn , Jennifer Healey , Eunyee Koh , Nedim Lipka , Larry Birnbaum

Large language model-based agents are increasingly applied in the recommendation field due to their extensive knowledge and strong planning capabilities. While prior research has primarily focused on enhancing either the recommendation…

Information Retrieval · Computer Science 2025-05-05 Shihao Cai , Jizhi Zhang , Keqin Bao , Chongming Gao , Qifan Wang , Fuli Feng , Xiangnan He

Large language models struggle to accumulate evidence across multiple rounds of user interaction, failing to update their beliefs in a manner consistent with Bayesian inference. Existing solutions require fine-tuning on sensitive user…

Computation and Language · Computer Science 2026-04-07 Fangzhou Lin , Peiran Li , Shuo Xing , Siyuan Yang , Qianwen Ge , Kazunori Yamada , Ziming Zhang , Haichong Zhang , Zhengzhong Tu

We analyze the problem of learning a single user's preferences in an active learning setting, sequentially and adaptively querying the user over a finite time horizon. Learning is conducted via choice-based queries, where the user selects…

Machine Learning · Statistics 2017-02-27 Stephen N. Pallone , Peter I. Frazier , Shane G. Henderson

In consumer theory, ranking available objects by means of preference relations yields the most common description of individual choices. However, preference-based models assume that individuals: (1) give their preferences only between pairs…

Machine Learning · Computer Science 2023-02-02 Alessio Benavoli , Dario Azzimonti , Dario Piga

We consider approximate Bayesian model choice for model selection problems that involve models whose Fisher-information matrices may fail to be invertible along other competing submodels. Such singular models do not obey the regularity…

Methodology · Statistics 2016-03-24 Mathias Drton , Martyn Plummer