English
Related papers

Related papers: Future Impact Decomposition in Request-level Recom…

200 papers

This paper augments the reward received by a reinforcement learning agent with potential functions in order to help the agent learn (possibly stochastic) optimal policies. We show that a potential-based reward shaping scheme is able to…

Machine Learning · Computer Science 2019-07-23 Baicen Xiao , Bhaskar Ramasubramanian , Andrew Clark , Hannaneh Hajishirzi , Linda Bushnell , Radha Poovendran

Following the pivotal success of learning strategies to win at tasks, solely by interacting with an environment without any supervision, agents have gained the ability to make sequential decisions in complex MDPs. Yet, reinforcement…

Machine Learning · Computer Science 2026-03-18 Ezgi Korkmaz

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…

Interactive segmentation has recently been explored to effectively and efficiently harvest high-quality segmentation masks by iteratively incorporating user hints. While iterative in nature, most existing interactive segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Chaofan Ma , Qisen Xu , Xiangfeng Wang , Bo Jin , Xiaoyun Zhang , Yanfeng Wang , Ya Zhang

Uplift modeling aims to directly model the incremental impact of a treatment on an individual response. In this work, we address the problem from a new angle and reformulate it as a Markov Decision Process (MDP). We conducted extensive…

Machine Learning · Computer Science 2019-02-06 Chenchen Li , Xiang Yan , Xiaotie Deng , Yuan Qi , Wei Chu , Le Song , Junlong Qiao , Jianshan He , Junwu Xiong

As Recommender Systems (RS) influence more and more people in their daily life, the issue of fairness in recommendation is becoming more and more important. Most of the prior approaches to fairness-aware recommendation have been situated in…

Information Retrieval · Computer Science 2021-01-12 Yingqiang Ge , Shuchang Liu , Ruoyuan Gao , Yikun Xian , Yunqi Li , Xiangyu Zhao , Changhua Pei , Fei Sun , Junfeng Ge , Wenwu Ou , Yongfeng Zhang

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

Artificial Intelligence · Computer Science 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

Recently, model-based agents have achieved better performance than model-free ones using the same computational budget and training time in single-agent environments. However, due to the complexity of multi-agent systems, it is tough to…

Multiagent Systems · Computer Science 2022-12-08 Zhiwei Xu , Dapeng Li , Bin Zhang , Yuan Zhan , Yunpeng Bai , Guoliang Fan

Ranking is a fundamental and widely studied problem in scenarios such as search, advertising, and recommendation. However, joint optimization for multi-scenario ranking, which aims to improve the overall performance of several ranking…

Artificial Intelligence · Computer Science 2018-09-18 Jun Feng , Heng Li , Minlie Huang , Shichen Liu , Wenwu Ou , Zhirong Wang , Xiaoyan Zhu

Workers spend a significant amount of time learning how to make good decisions. Evaluating the efficacy of a given decision, however, can be complicated -- e.g., decision outcomes are often long-term and relate to the original decision in…

Machine Learning · Computer Science 2024-03-20 Hamsa Bastani , Osbert Bastani , Wichinpong Park Sinchaisri

In this paper we consider the problem of how a reinforcement learning agent that is tasked with solving a sequence of reinforcement learning problems (a sequence of Markov decision processes) can use knowledge acquired early in its lifetime…

Machine Learning · Computer Science 2019-02-05 Francisco M. Garcia , Philip S. Thomas

Recommending novel content, which expands user horizons by introducing them to new interests, has been shown to improve users' long-term experience on recommendation platforms \cite{chen2021values}. Users however are not constantly looking…

Information Retrieval · Computer Science 2023-06-05 Pan Li , Yuyan Wang , Ed H. Chi , Minmin Chen

In this work, we consider the problem of collaborative multi-user reinforcement learning. In this setting there are multiple users with the same state-action space and transition probabilities but with different rewards. Under the…

Machine Learning · Computer Science 2023-05-23 Naman Agarwal , Prateek Jain , Suhas Kowshik , Dheeraj Nagaraj , Praneeth Netrapalli

One of the main challenges in recommender systems is data sparsity which leads to high variance. Several attempts have been made to improve the bias-variance trade-off using auxiliary information. In particular, document modeling-based…

Information Retrieval · Computer Science 2021-09-14 Meysam Varasteh , Mehdi Soleiman Nejad , Hadi Moradi , Mohammad Amin Sadeghi , Ahmad Kalhor

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

Information Retrieval · Computer Science 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Online recommenders have attained growing interest and created great revenue for businesses. Given numerous users and items, incremental update becomes a mainstream paradigm for learning large-scale models in industrial scenarios, where…

Information Retrieval · Computer Science 2023-12-27 Chen Yang , Jin Chen , Qian Yu , Xiangdong Wu , Kui Ma , Zihao Zhao , Zhiwei Fang , Wenlong Chen , Chaosheng Fan , Jie He , Changping Peng , Zhangang Lin , Jingping Shao

Potential-based reward shaping is commonly used to incorporate prior knowledge of how to solve the task into reinforcement learning because it can formally guarantee policy invariance. As such, the optimal policy and the ordering of…

Machine Learning · Computer Science 2025-02-04 Henrik Müller , Daniel Kudenko

Recurrent neural networks for session-based recommendation have attracted a lot of attention recently because of their promising performance. repeat consumption is a common phenomenon in many recommendation scenarios (e.g., e-commerce,…

Information Retrieval · Computer Science 2018-12-07 Pengjie Ren , Zhumin Chen , Jing Li , Zhaochun Ren , Jun Ma , Maarten de Rijke

In our previous work, we proposed a systematic cross-layer framework for dynamic multimedia systems, which allows each layer to make autonomous and foresighted decisions that maximize the system's long-term performance, while meeting the…

Machine Learning · Computer Science 2013-06-06 Nicholas Mastronarde , Mihaela van der Schaar

Recommender systems (RSs) have become an inseparable part of our everyday lives. They help us find our favorite items to purchase, our friends on social networks, and our favorite movies to watch. Traditionally, the recommendation problem…

Information Retrieval · Computer Science 2022-06-09 M. Mehdi Afsar , Trafford Crump , Behrouz Far