English
Related papers

Related papers: A Bayesian Choice Model for Eliminating Feedback L…

200 papers

We study a repeated information design setting in which the receiver, who is also the decision-maker, updates beliefs in a systematically biased way. More specifically, a distorted posterior in our model can be written as a convex…

Computer Science and Game Theory · Computer Science 2026-05-18 Yuqi Pan , Sadie Zhao , Milind Tambe , Yiling Chen

In this paper we consider the modern theory of the Bayesian brain from cognitive neurosciences in the light of recommender systems and expose potentials for our community. In particular, we elaborate on noisy user feedback and the thus…

Human-Computer Interaction · Computer Science 2017-06-28 Kevin Jasberg , Sergej Sizov

Recommender systems are essential for information access, allowing users to present their content for recommendation. With the rise of large language models (LLMs), AI-generated content (AIGC), primarily in the form of text, has become a…

Information Retrieval · Computer Science 2025-06-11 Yuqi Zhou , Sunhao Dai , Liang Pang , Gang Wang , Zhenhua Dong , Jun Xu , Ji-Rong Wen

Bayesian optimization is an effective method for finding extrema of a black-box function. We propose a new type of Bayesian optimization for learning user preferences in high-dimensional spaces. The central assumption is that the underlying…

Machine Learning · Statistics 2020-08-17 Petrus Mikkola , Milica Todorović , Jari Järvi , Patrick Rinke , Samuel Kaski

Optimal input settings vary across users due to differences in motor abilities and personal preferences, which are typically addressed by manual tuning or calibration. Although human-in-the-loop optimization has the potential to identify…

Human-Computer Interaction · Computer Science 2025-03-10 Yi-Chi Liao , Paul Streli , Zhipeng Li , Christoph Gebhardt , Christian Holz

Recursive Bayesian inference, in which posterior beliefs are updated in light of accumulating data, is a tool for implementing Bayesian models in applications with streaming and/or very large data sets. As the posterior of one iteration…

Methodology · Statistics 2025-08-05 Henry R. Scharf

Deep learning-based recommendation has become a widely adopted technique in various online applications. Typically, a deployed model undergoes frequent re-training to capture users' dynamic behaviors from newly collected interaction logs.…

Information Retrieval · Computer Science 2022-04-26 Guohao Cai , Jieming Zhu , Quanyu Dai , Zhenhua Dong , Xiuqiang He , Ruiming Tang , Rui Zhang

Recent advancements in explainable recommendation have greatly bolstered user experience by elucidating the decision-making rationale. However, the existing methods actually fail to provide effective feedback signals for potentially better…

Information Retrieval · Computer Science 2025-08-08 Jiakai Tang , Jingsen Zhang , Zihang Tian , Xueyang Feng , Lei Wang , Xu Chen

Semi-supervised learning by self-training heavily relies on pseudo-label selection (PLS). The selection often depends on the initial model fit on labeled data. Early overfitting might thus be propagated to the final model by selecting…

Machine Learning · Statistics 2023-06-27 Julian Rodemann , Jann Goschenhofer , Emilio Dorigatti , Thomas Nagler , Thomas Augustin

Bayesian persuasion studies how an informed sender should partially disclose information to influence the behavior of a self-interested receiver. Classical models make the stringent assumption that the sender knows the receiver's utility.…

Computer Science and Game Theory · Computer Science 2021-06-14 Matteo Castiglioni , Alberto Marchesi , Andrea Celli , Nicola Gatti

In real-world recommendation problems, especially those with a formidably large item space, users have to gradually learn to estimate the utility of any fresh recommendations from their experience about previously consumed items. This in…

Machine Learning · Computer Science 2022-02-07 Fan Yao , Chuanhao Li , Denis Nekipelov , Hongning Wang , Haifeng Xu

Modern information retrieval systems, including web search, ads placement, and recommender systems, typically rely on learning from user feedback. Click models, which study how users interact with a ranked list of items, provide a useful…

Information Retrieval · Computer Science 2021-04-20 Xinyi Dai , Jianghao Lin , Weinan Zhang , Shuai Li , Weiwen Liu , Ruiming Tang , Xiuqiang He , Jianye Hao , Jun Wang , Yong Yu

Decision-making is a cognitively intensive task that requires synthesizing relevant information from multiple unstructured sources, weighing competing factors, and incorporating subjective user preferences. Existing methods, including large…

Computation and Language · Computer Science 2026-04-21 Akriti Jain , Anish Mulay , Divyansh Verma , Aishani Pandey , Pritika Ramu , Aparna Garimella

Implicit feedback has been widely used to build commercial recommender systems. Because observed feedback represents users' click logs, there is a semantic gap between true relevance and observed feedback. More importantly, observed…

Information Retrieval · Computer Science 2022-07-27 Jae-woong Lee , Seongmin Park , Joonseok Lee , Jongwuk Lee

Recommender systems widely use implicit feedback such as click data because of its general availability. Although the presence of clicks signals the users' preference to some extent, the lack of such clicks does not necessarily indicate a…

Machine Learning · Statistics 2022-06-16 Yuta Saito , Suguru Yaginuma , Yuta Nishino , Hayato Sakata , Kazuhide Nakata

Reinforcement learning (RL) recommender systems often rely on static datasets that fail to capture the fluid, ever changing nature of user preferences in real-world scenarios. Meanwhile, generative AI techniques have emerged as powerful…

Information Retrieval · Computer Science 2025-09-10 Danial Ebrat , Eli Paradalis , Luis Rueda

Randomized controlled experiments assess new policy impacts on performance metrics to inform launch decisions. Traditional approaches evaluate metrics independently despite correlations, and mixed results (e.g., positive revenue impact,…

Applications · Statistics 2026-01-29 Hoiyi Ng , Guido Imbens

We present a novel approach to help decision-makers efficiently identify preferred solutions from the Pareto set of a multi-objective optimization problem. Our method uses a Bayesian model to estimate the decision-maker's utility function…

Machine Learning · Statistics 2025-11-13 Felix Huber , Sebastian Rojas Gonzalez , Raul Astudillo

Recommender systems operate in closed feedback loops, where user interactions reinforce popularity bias, leading to over-recommendation of already popular items while under-exposing niche or novel content. Existing bias mitigation methods,…

Information Retrieval · Computer Science 2025-06-10 Rahul Agarwal , Amit Jaspal , Saurabh Gupta , Omkar Vichare

In this letter, we propose a control framework for human-in-the-loop systems, in which many human decision makers are involved in the feedback loop composed of a plant and a controller. The novelty of the framework is that the decision…

Systems and Control · Computer Science 2020-03-11 Masaki Inoue , Vijay Gupta