中文
相关论文

相关论文: Off-Policy Selection for Initiating Human-Centric …

200 篇论文

In reinforcement learning, an agent attempts to learn high-performing behaviors through interacting with the environment, such behaviors are often quantified in the form of a reward function. However some aspects of behavior-such as ones…

机器学习 · 计算机科学 2020-10-27 Yiming Zhang , Quan Vuong , Keith W. Ross

Potential-based reward shaping (PBRS) is an effective and popular technique to speed up reinforcement learning by leveraging domain knowledge. While PBRS is proven to always preserve optimal policies, its effect on learning speed is…

人工智能 · 计算机科学 2015-03-24 Anna Harutyunyan , Tim Brys , Peter Vrancx , Ann Nowe

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

机器学习 · 计算机科学 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

Federated Learning (FL) has been considered as an appealing framework to tackle data privacy issues of mobile devices compared to conventional Machine Learning (ML). Using Edge Servers (ESs) as intermediaries to perform model aggregation in…

机器学习 · 计算机科学 2021-12-06 Zhe Qu , Rui Duan , Lixing Chen , Jie Xu , Zhuo Lu , Yao Liu

The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the…

Online selection of dynamic features has attracted intensive interest in recent years. However, existing online feature selection methods evaluate features individually and ignore the underlying structure of feature stream. For instance, in…

计算机视觉与模式识别 · 计算机科学 2016-08-23 Jing Wang , Meng Wang , Peipei Li , Luoqi Liu , Zhongqiu Zhao , Xuegang Hu , Xindong Wu

We seek to understand what facilitates sample-efficient learning from historical datasets for sequential decision-making, a problem that is popularly known as offline reinforcement learning (RL). Further, we are interested in algorithms…

机器学习 · 计算机科学 2024-02-07 Thanh Nguyen-Tang , Raman Arora

How to select between policies and value functions produced by different training algorithms in offline reinforcement learning (RL) -- which is crucial for hyperpa-rameter tuning -- is an important open question. Existing approaches based…

机器学习 · 计算机科学 2021-11-04 Siyuan Zhang , Nan Jiang

We address the problem of policy selection in contextual stochastic optimization (CSO), where covariates are available as contextual information and decisions must satisfy hard feasibility constraints. In many CSO settings, multiple…

机器学习 · 计算机科学 2026-05-29 Caio de Prospero Iglesias , Kimberly Villalobos Carballo , Dimitris Bertsimas

Reinforcement learning (RL) in low-data and risk-sensitive domains requires performant and flexible deployment policies that can readily incorporate constraints during deployment. One such class of policies are the semi-parametric H-step…

机器学习 · 计算机科学 2021-10-07 Harshit Sikchi , Wenxuan Zhou , David Held

Off-policy learning enables training policies from logged interaction data. Most prior work considers the batch setting, where a policy is learned from data generated by a single behavior policy. In real systems, however, policies are…

机器学习 · 统计学 2026-05-13 Maxime Haddouche , Otmane Sakhi

Sample efficiency and exploration remain major challenges in online reinforcement learning (RL). A powerful approach that can be applied to address these issues is the inclusion of offline data, such as prior trajectories from a human…

机器学习 · 计算机科学 2023-06-01 Philip J. Ball , Laura Smith , Ilya Kostrikov , Sergey Levine

A recently popular approach to solving reinforcement learning is with data from human preferences. In fact, human preference data are now used with classic reinforcement learning algorithms such as actor-critic methods, which involve…

机器学习 · 计算机科学 2024-02-28 Zihao Li , Xiang Ji , Minshuo Chen , Mengdi Wang

While reinforcement learning (RL) enables robots to acquire skills autonomously, its real-world deployment is severely limited by inefficient and unsafe exploration. Human-in-the-loop interventions offer a practical solution, yet existing…

机器人学 · 计算机科学 2026-05-26 Yunyang Mo , Jian Li , Qiwei Wu , Yihang Kang , Renjing Xu

Efficient exploration is a crucial challenge in deep reinforcement learning. Several methods, such as behavioral priors, are able to leverage offline data in order to efficiently accelerate reinforcement learning on complex tasks. However,…

机器学习 · 计算机科学 2022-09-01 Marco Bagatella , Sammy Christen , Otmar Hilliges

Offline reinforcement learning (RL) aims to learn a policy that maximizes the expected return using a given static dataset of transitions. However, offline RL faces the distribution shift problem. The policy constraint offline RL method is…

机器学习 · 计算机科学 2025-12-24 Yuanhao Chen , Qi Liu , Pengbin Chen , Zhongjian Qiao , Yanjie Li

Evaluating a policy by deploying it in the real world can be risky and costly. Off-policy policy evaluation (OPE) algorithms use historical data collected from running a previous policy to evaluate a new policy, which provides a means for…

人工智能 · 计算机科学 2017-12-07 Zhaohan Daniel Guo , Philip S. Thomas , Emma Brunskill

The world currently offers an abundance of data in multiple domains, from which we can learn reinforcement learning (RL) policies without further interaction with the environment. RL agents learning offline from such data is possible but…

机器学习 · 计算机科学 2022-12-19 Hager Radi , Josiah P. Hanna , Peter Stone , Matthew E. Taylor

This work studies the problem of batch off-policy evaluation for Reinforcement Learning in partially observable environments. Off-policy evaluation under partial observability is inherently prone to bias, with risk of arbitrarily large…

机器学习 · 计算机科学 2019-11-26 Guy Tennenholtz , Shie Mannor , Uri Shalit

Off-policy learning is a framework for evaluating and optimizing policies without deploying them, from data collected by another policy. Real-world environments are typically non-stationary and the offline learned policies should adapt to…

机器学习 · 计算机科学 2021-04-06 Joey Hong , Branislav Kveton , Manzil Zaheer , Yinlam Chow , Amr Ahmed