English
Related papers

Related papers: Revisiting Fairness-aware Interactive Recommendati…

200 papers

Machine learning systems are often deployed for making critical decisions like credit lending, hiring, etc. While making decisions, such systems often encode the user's demographic information (like gender, age) in their intermediate…

Machine Learning · Computer Science 2023-01-24 Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

Search advertising is essential for merchants to reach the target users on short video platforms. Short video ads aligned with user search intents are displayed through relevance matching and bid ranking mechanisms. This paper focuses on…

Information Retrieval · Computer Science 2025-02-11 Guobing Gan , Kaiming Gao , Li Wang , Shen Jiang , Peng Jiang

Many continuous control tasks have easily formulated objectives, yet using them directly as a reward in reinforcement learning (RL) leads to suboptimal policies. Therefore, many classical control tasks guide RL training using complex…

Machine Learning · Computer Science 2019-05-21 Aleksandra Faust , Anthony Francis , Dar Mehta

We create a novel benchmark for evaluating a Deployable Lifelong Learning system for Visual Reinforcement Learning (RL) that is pretrained on a curated dataset, and propose a novel Scalable Lifelong Learning system capable of retaining…

Machine Learning · Computer Science 2023-12-19 Kiran Lekkala , Eshan Bhargava , Yunhao Ge , Laurent Itti

Traditional ranking systems optimize offline proxy objectives that rely on oversimplified assumptions about user behavior, often neglecting factors such as position bias and item diversity. Consequently, these models fail to improve true…

Information Retrieval · Computer Science 2025-10-21 Gaurav Bhatt , Kiran Koshy Thekumparampil , Tanmay Gangwani , Tesi Xiao , Leonid Sigal

The options framework in Hierarchical Reinforcement Learning breaks down overall goals into a combination of options or simpler tasks and associated policies, allowing for abstraction in the action space. Ideally, these options can be…

Machine Learning · Computer Science 2022-06-14 Kushal Chauhan , Soumya Chatterjee , Akash Reddy , Balaraman Ravindran , Pradeep Shenoy

While standard IR models are mainly designed to optimize relevance, real-world search often needs to balance additional objectives such as diversity and fairness. These objectives depend on inter-document interactions and are commonly…

Information Retrieval · Computer Science 2025-05-26 Nilanjan Sinhababu , Andrew Parry , Debasis Ganguly , Pabitra Mitra

Reinforcement Learning (RL) in various decision-making tasks of machine learning provides effective results with an agent learning from a stand-alone reward function. However, it presents unique challenges with large amounts of environment…

Machine Learning · Computer Science 2020-03-10 Neda Navidi

The rapid proliferation of short videos on social media platforms presents unique challenges and opportunities for recommendation systems. Users exhibit diverse preferences, and the responses resulting from different strategies often…

Information Retrieval · Computer Science 2025-12-02 Chenhao Zhai , Chang Meng , Xueliang Wang , Shuchang Liu , Xiaolong Hu , Shisong Tang , Xiaoqiang Feng , Xiu Li

In-context learning is a promising approach for offline reinforcement learning (RL) to handle online tasks, which can be achieved by providing task prompts. Recent works demonstrated that in-context RL could emerge with self-improvement in…

Machine Learning · Computer Science 2024-06-03 Sili Huang , Jifeng Hu , Hechang Chen , Lichao Sun , Bo Yang

This study develops and evaluates a deep reinforcement learning framework for dynamic portfolio allocation across global equity markets. The Soft Actor-Critic algorithm is used to learn continuous portfolio weights within a Markov Decision…

Portfolio Management · Quantitative Finance 2026-05-19 Kamil Kashif , Robert Ślepaczuk

Recent advances in deep reinforcement learning (RL) have demonstrated its potential to learn complex robotic manipulation tasks. However, RL still requires the robot to collect a large amount of real-world experience. To address this…

Robotics · Computer Science 2020-03-12 Bohan Wu , Feng Xu , Zhanpeng He , Abhi Gupta , Peter K. Allen

Reinforcement learning (RL) is a framework for solving sequential decision-making problems. In this work, we demonstrate that, surprisingly, RL emerges during the inference time of large language models (LLMs), a phenomenon we term…

Machine Learning · Computer Science 2026-04-28 Kefan Song , Amir Moeini , Peng Wang , Lei Gong , Rohan Chandra , Shangtong Zhang , Yanjun Qi

Many modern commercial sites employ recommender systems to propose relevant content to users. While most systems are focused on maximizing the immediate gain (clicks, purchases or ratings), a better notion of success would be the lifetime…

Machine Learning · Statistics 2017-02-24 Assaf Hallak , Yishay Mansour , Elad Yom-Tov

Web applications where users are presented with a limited selection of items have long employed ranking models to put the most relevant results first. Any feedback received from users is typically assumed to reflect a relative judgement on…

Information Retrieval · Computer Science 2023-06-12 Maarten Buyl , Paul Missault , Pierre-Antoine Sondag

With the growing popularity of deep reinforcement learning (DRL), human-in-the-loop (HITL) approach has the potential to revolutionize the way we approach decision-making problems and create new opportunities for human-AI collaboration. In…

In continual RL we want agents capable of never-ending learning, and yet our evaluation methodologies do not reflect this. The standard practice in RL is to assume unfettered access to the deployment environment for the full lifetime of the…

Machine Learning · Computer Science 2025-08-11 Golnaz Mesbahi , Parham Mohammad Panahi , Olya Mastikhina , Steven Tang , Martha White , Adam White

Fairness in classification tasks has traditionally focused on bias removal from neural representations, but recent trends favor algorithmic methods that embed fairness into the training process. These methods steer models towards fair…

Machine Learning · Computer Science 2024-07-16 Leon Eshuijs , Shihan Wang , Antske Fokkens

Short video applications have attracted billions of users in recent years, fulfilling their various needs with diverse content. Users usually watch short videos on many topics on mobile devices in a short period of time, and give explicit…

Information Retrieval · Computer Science 2022-11-09 Xudong Gong , Qinlin Feng , Yuan Zhang , Jiangling Qin , Weijie Ding , Biao Li , Peng Jiang , Kun Gai

Proactive Recommender Systems (PRSs) aim to guide user preference shift toward target items by generating paths of intermediate recommendations. Reinforcement learning (RL) provides a principled framework for optimizing such sequential…

Machine Learning · Computer Science 2026-05-29 Hongru Hou , Tiehua Mei , Denghui Geng , Jinhui Huang , Ao Xu , Hengrui Chen , Jiaqing Liang , Deqing Yang