English
Related papers

Related papers: Multi-Task Off-Policy Learning from Bandit Feedbac…

200 papers

A key goal in stochastic contextual linear bandits is to efficiently learn a near-optimal policy. Prior algorithms for this problem learn a policy by strategically sampling actions but naively (passively) sampling contexts from the…

Machine Learning · Computer Science 2026-05-26 Emma Brunskill , Ishani Karmarkar , Zhaoqi Li

On-policy reinforcement learning (RL) algorithms have high sample complexity while off-policy algorithms are difficult to tune. Merging the two holds the promise to develop efficient algorithms that generalize across diverse environments.…

Machine Learning · Computer Science 2019-07-17 Rasool Fakoor , Pratik Chaudhari , Alexander J. Smola

In this paper we consider the adversarial contextual bandit problem in metric spaces. The paper "Nearest neighbour with bandit feedback" tackled this problem but when there are many contexts near the decision boundary of the comparator…

Machine Learning · Computer Science 2023-12-18 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis

We study joint learning of network topology and a mixed opinion dynamics, in which agents may have different update rules. Such a model captures the diversity of real individual interactions. We propose a learning algorithm based on…

Social and Information Networks · Computer Science 2023-06-29 Yu Xing , Xudong Sun , Karl H. Johansson

We develop a normative framework for hierarchical model-based policy optimization based on applying second-order methods in the space of all possible state-action paths. The resulting natural path gradient performs policy updates in a…

Machine Learning · Computer Science 2020-01-03 Daniel McNamee

This work explores adaptations of successful multi-armed bandits policies to the online contextual bandits scenario with binary rewards using binary classification algorithms such as logistic regression as black-box oracles. Some of these…

Machine Learning · Computer Science 2019-11-26 David Cortes

Compared to on-policy counterparts, off-policy model-free deep reinforcement learning can improve data efficiency by repeatedly using the previously gathered data. However, off-policy learning becomes challenging when the discrepancy…

Machine Learning · Computer Science 2023-09-27 Baturay Saglam , Dogan C. Cicek , Furkan B. Mutlu , Suleyman S. Kozat

Mean rewards of actions are often correlated. The form of these correlations may be complex and unknown a priori, such as the preferences of a user for recommended products and their categories. To maximize statistical efficiency, it is…

Machine Learning · Computer Science 2022-02-04 Joey Hong , Branislav Kveton , Sumeet Katariya , Manzil Zaheer , Mohammad Ghavamzadeh

We address the problem of learning hierarchical deep neural network policies for reinforcement learning. In contrast to methods that explicitly restrict or cripple lower layers of a hierarchy to force them to use higher-level modulating…

Machine Learning · Computer Science 2018-09-05 Tuomas Haarnoja , Kristian Hartikainen , Pieter Abbeel , Sergey Levine

Lately, there has been a resurgence of interest in using supervised learning to solve reinforcement learning problems. Recent work in this area has largely focused on learning command-conditioned policies. We investigate the potential of…

Machine Learning · Computer Science 2022-05-11 Dylan R. Ashley , Kai Arulkumaran , Jürgen Schmidhuber , Rupesh Kumar Srivastava

We develop a metalearning approach for learning hierarchically structured policies, improving sample efficiency on unseen tasks through the use of shared primitives---policies that are executed for large numbers of timesteps. Specifically,…

Machine Learning · Computer Science 2017-10-27 Kevin Frans , Jonathan Ho , Xi Chen , Pieter Abbeel , John Schulman

Reinforcement learning from human feedback (RLHF) is a promising solution to align large language models (LLMs) more closely with human values. Off-policy preference optimization, where the preference data is obtained from other models, is…

Computation and Language · Computer Science 2024-10-07 Wenxuan Zhou , Ravi Agrawal , Shujian Zhang , Sathish Reddy Indurthi , Sanqiang Zhao , Kaiqiang Song , Silei Xu , Chenguang Zhu

Accurately evaluating new policies (e.g. ad-placement models, ranking functions, recommendation functions) is one of the key prerequisites for improving interactive systems. While the conventional approach to evaluation relies on online A/B…

Machine Learning · Computer Science 2017-06-27 Aman Agarwal , Soumya Basu , Tobias Schnabel , Thorsten Joachims

Experience replay enables reinforcement learning agents to memorize and reuse past experiences, just as humans replay memories for the situation at hand. Contemporary off-policy algorithms either replay past experiences uniformly or utilize…

Machine Learning · Computer Science 2019-06-21 Daochen Zha , Kwei-Herng Lai , Kaixiong Zhou , Xia Hu

Off-policy evaluation is a key component of reinforcement learning which evaluates a target policy with offline data collected from behavior policies. It is a crucial step towards safe reinforcement learning and has been used in…

Machine Learning · Computer Science 2020-12-01 Jinlin Lai , Lixin Zou , Jiaxing Song

Algorithmic decision-making in high-stakes domains often involves assigning decisions to agents with incentives to strategically modify their input to the algorithm. In addition to dealing with incentives, in many domains of interest (e.g.…

Computer Science and Game Theory · Computer Science 2023-10-31 Keegan Harris , Chara Podimata , Zhiwei Steven Wu

We study the problem of off-policy evaluation from batched contextual bandit data with multidimensional actions, often termed slates. The problem is common to recommender systems and user-interface optimization, and it is particularly…

Machine Learning · Computer Science 2021-11-04 Nikos Vlassis , Ashok Chandrashekar , Fernando Amat Gil , Nathan Kallus

Adapting machine translation systems in the real world is a difficult problem. In contrast to offline training, users cannot provide the type of fine-grained feedback (such as correct translations) typically used for improving the system.…

Computation and Language · Computer Science 2020-09-03 Jason Naradowsky , Xuan Zhang , Kevin Duh

Offline reinforcement learning endeavors to leverage offline datasets to craft effective agent policy without online interaction, which imposes proper conservative constraints with the support of behavior policies to tackle the…

Machine Learning · Computer Science 2024-11-12 Yunpeng Qing , Shunyu liu , Jingyuan Cong , Kaixuan Chen , Yihe Zhou , Mingli Song

Contextual bandit algorithms are ubiquitous tools for active sequential experimentation in healthcare and the tech industry. They involve online learning algorithms that adaptively learn policies over time to map observed contexts $X_t$ to…

Methodology · Statistics 2024-08-19 Ian Waudby-Smith , Lili Wu , Aaditya Ramdas , Nikos Karampatziakis , Paul Mineiro