English
Related papers

Related papers: Estimating and Penalizing Induced Preference Shift…

200 papers

Learning from human involvement aims to incorporate the human subject to monitor and correct agent behavior errors. Although most interactive imitation learning methods focus on correcting the agent's action at the current state, they do…

Machine Learning · Computer Science 2025-10-17 Haoyuan Cai , Zhenghao Peng , Bolei Zhou

Evaluation of policies in recommender systems typically involves A/B testing using live experiments on real users to assess a new policy's impact on relevant metrics. This ``gold standard'' comes at a high cost, however, in terms of cycle…

Information Retrieval · Computer Science 2024-09-27 Chih-Wei Hsu , Martin Mladenov , Ofer Meshi , James Pine , Hubert Pham , Shane Li , Xujian Liang , Anton Polishko , Li Yang , Ben Scheetz , Craig Boutilier

Recommender systems are essential for personalizing digital experiences on e-commerce sites, streaming services, and social media platforms. While these systems are necessary for modern digital interactions, they face fairness, bias,…

Information Retrieval · Computer Science 2024-09-20 Falguni Roy , Xiaofeng Ding , K. -K. R. Choo , Pan Zhou

Transformer-based agentic AI is rapidly being deployed on major platforms to help users shop, watch, and navigate content with less effort. While these systems can deliver impressive performance, a key concern is whether they may be less…

Computers and Society · Computer Science 2026-05-01 Jinhui Han , Ming Hu , Xilin Zhang

An internet network service provider manages its network with multiple objectives, such as high quality of service (QoS) and minimum computing resource usage. To achieve these objectives, a reinforcement learning-based (RL) algorithm has…

Networking and Internet Architecture · Computer Science 2025-06-17 DongNyeong Heo , Daniela Noemi Rim , Heeyoul Choi

Recommender systems daily influence our decisions on the Internet. While considerable attention has been given to issues such as recommendation accuracy and user privacy, the long-term mutual feedback between a recommender system and the…

Information Retrieval · Computer Science 2015-08-10 An Zeng , Chi Ho Yeung , Matus Medo , Yi-Cheng Zhang

Albeit the widespread application of recommender systems (RecSys) in our daily lives, rather limited research has been done on quantifying unfairness and biases present in such systems. Prior work largely focuses on determining whether a…

Computers and Society · Computer Science 2023-10-13 Valentijn Braun , Debarati Bhaumik , Diptish Dey

Recommender Systems have proliferated as general-purpose approaches to model a wide variety of consumer interaction data. Specific instances make use of signals ranging from user feedback, item relationships, geographic locality, social…

Information Retrieval · Computer Science 2018-08-31 Wang-Cheng Kang , Mengting Wan , Julian McAuley

This paper is an extended version of [Burashnikova et al., 2021, arXiv: 2012.06910], where we proposed a theoretically supported sequential strategy for training a large-scale Recommender System (RS) over implicit feedback, mainly in the…

Information Retrieval · Computer Science 2022-03-01 Aleksandra Burashnikova , Yury Maximov , Marianne Clausel , Charlotte Laclau , Franck Iutzeler , Massih-Reza Amini

The inputs and preferences of human users are important considerations in situations where these users interact with autonomous cyber or cyber-physical systems. In these scenarios, one is often interested in aligning behaviors of the system…

Machine Learning · Computer Science 2021-04-02 Bhaskar Ramasubramanian , Luyao Niu , Andrew Clark , Radha Poovendran

Synthetic data and simulators have the potential to markedly improve the performance and robustness of recommendation systems. These approaches have already had a beneficial impact in other machine-learning driven fields. We identify and…

Information Retrieval · Computer Science 2021-12-22 Adam Lesnikowski , Gabriel de Souza Pereira Moreira , Sara Rabhi , Karl Byleen-Higley

We consider the problem of learning preferences over trajectories for mobile manipulators such as personal robots and assembly line robots. The preferences we learn are more intricate than simple geometric constraints on trajectories; they…

Robotics · Computer Science 2016-01-06 Ashesh Jain , Shikhar Sharma , Thorsten Joachims , Ashutosh Saxena

Sequential recommendation (SR) models are typically trained on user-item interactions which are affected by the system exposure bias, leading to the user preference learned from the biased SR model not being fully consistent with the true…

Information Retrieval · Computer Science 2023-12-13 Jiyuan Yang , Yue Ding , Yidan Wang , Pengjie Ren , Zhumin Chen , Fei Cai , Jun Ma , Rui Zhang , Zhaochun Ren , Xin Xin

Driven by the need to capture users' evolving interests and optimize their long-term experiences, more and more recommender systems have started to model recommendation as a Markov decision process and employ reinforcement learning to…

Information Retrieval · Computer Science 2021-11-02 Dell Zhang , Jun Wang

Explainable Recommendation has been gaining attention over the last few years in industry and academia. Explanations provided along with recommendations in a recommender system framework have many uses: particularly reasoning why a…

Information Retrieval · Computer Science 2024-05-06 Sairamvinay Vijayaraghavan , Prasant Mohapatra

Machine learning systems are often used in settings where individuals adapt their features to obtain a desired outcome. In such settings, strategic behavior leads to a sharp loss in model performance in deployment. In this work, we aim to…

Machine Learning · Computer Science 2021-06-11 Yatong Chen , Jialu Wang , Yang Liu

Recommending items that solely cater to users' historical interests narrows users' horizons. Recent works have considered steering target users beyond their historical interests by directly adjusting items exposed to them. However, the…

Information Retrieval · Computer Science 2026-01-01 Hang Pan , Shuxian Bi , Wenjie Wang , Haoxuan Li , Peng Wu , Fuli Feng

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Information Retrieval · Computer Science 2018-08-13 Xiangyu Zhao , Liang Zhang , Zhuoye Ding , Long Xia , Jiliang Tang , Dawei Yin

Machine learning systems have been widely used to make decisions about individuals who may behave strategically to receive favorable outcomes, e.g., they may genuinely improve the true labels or manipulate observable features directly to…

Artificial Intelligence · Computer Science 2024-10-30 Tian Xie , Zhiqun Zuo , Mohammad Mahdi Khalili , Xueru Zhang

Many modern online services feature personalized recommendations. A central challenge when providing such recommendations is that the reason why an individual user accesses the service may change from visit to visit or even during an…

Information Retrieval · Computer Science 2024-10-22 Dietmar Jannach , Markus Zanker