English
Related papers

Related papers: Structured Difference-of-Q via Orthogonal Learning

200 papers

We propose methods to strengthen the invariance properties of representations obtained by contrastive learning. While existing approaches implicitly induce a degree of invariance as representations are learned, we look to more directly…

Machine Learning · Computer Science 2021-03-23 Adam Foster , Rattana Pukdee , Tom Rainforth

Classical machine learners are designed only to tackle one task without capability of adopting new emerging tasks or classes whereas such capacity is more practical and human-like in the real world. To address this shortcoming, continual…

Machine Learning · Computer Science 2021-12-06 Xuejun Han , Yuhong Guo

Offline Goal-Conditioned Reinforcement Learning seeks to train agents to reach specified goals from previously collected trajectories. Scaling that promises to long-horizon tasks remains challenging, notably due to compounding…

Machine Learning · Computer Science 2026-02-02 Anthony Kobanda , Waris Radji , Mathieu Petitbois , Odalric-Ambrym Maillard , Rémy Portelas

In imitation learning, it is common to learn a behavior policy to match an unknown target policy via max-likelihood training on a collected set of target demonstrations. In this work, we consider using offline experience datasets -…

Machine Learning · Computer Science 2021-10-11 Ofir Nachum , Mengjiao Yang

Reinforcement learning usually makes use of numerical rewards, which have nice properties but also come with drawbacks and difficulties. Using rewards on an ordinal scale (ordinal rewards) is an alternative to numerical rewards that has…

Machine Learning · Computer Science 2020-12-09 Alexander Zap , Tobias Joppen , Johannes Fürnkranz

Learning efficiently a causal model of the environment is a key challenge of model-based RL agents operating in POMDPs. We consider here a scenario where the learning agent has the ability to collect online experiences through direct…

Machine Learning · Computer Science 2021-06-29 Maxime Gasse , Damien Grasset , Guillaume Gaudron , Pierre-Yves Oudeyer

Cross-domain offline reinforcement learning leverages source domain data with diverse transition dynamics to alleviate the data requirement for the target domain. However, simply merging the data of two domains leads to performance…

Machine Learning · Computer Science 2024-05-13 Xiaoyu Wen , Chenjia Bai , Kang Xu , Xudong Yu , Yang Zhang , Xuelong Li , Zhen Wang

Improving the sample efficiency of reinforcement learning algorithms requires effective exploration. Following the principle of $\textit{optimism in the face of uncertainty}$ (OFU), we train a separate exploration policy to maximize the…

Machine Learning · Computer Science 2022-11-23 Jiachen Li , Shuo Cheng , Zhenyu Liao , Huayan Wang , William Yang Wang , Qinxun Bai

Offline-to-online Reinforcement Learning (O2O RL) aims to improve the performance of offline pretrained policy using only a few online samples. Built on offline RL algorithms, most O2O methods focus on the balance between RL objective and…

Machine Learning · Computer Science 2023-12-14 Yinmin Zhang , Jie Liu , Chuming Li , Yazhe Niu , Yaodong Yang , Yu Liu , Wanli Ouyang

Q-Learning is a fundamental off-policy reinforcement learning (RL) algorithm that has the objective of approximating action-value functions in order to learn optimal policies. Nonetheless, it has difficulties in reconciling bias with…

Machine Learning · Computer Science 2024-11-22 Mahammad Humayoo

We study finite-horizon offline reinforcement learning (RL) with function approximation for both policy evaluation and policy optimization. Prior work established that statistically efficient learning is impossible for either of these…

Machine Learning · Computer Science 2025-10-07 Volodymyr Tkachuk , Csaba Szepesvári , Xiaoqi Tan

We propose an optimal algorithm for estimating conditional average treatment effects (CATEs) when response functions lie in a reproducing kernel Hilbert space (RKHS). We study settings in which the contrast function is structurally simpler…

Methodology · Statistics 2026-02-25 Seok-Jin Kim

This paper provides estimation and inference methods for a conditional average treatment effects (CATE) characterized by a high-dimensional parameter in both homogeneous cross-sectional and unit-heterogeneous dynamic panel data settings. In…

Machine Learning · Statistics 2022-12-13 Vira Semenova , Matt Goldman , Victor Chernozhukov , Matt Taddy

Off-policy learning ability is an important feature of reinforcement learning (RL) for practical applications. However, even one of the most elementary RL algorithms, temporal-difference (TD) learning, is known to suffer form divergence…

Machine Learning · Computer Science 2025-04-21 Han-Dong Lim , Donghwan Lee

We show that the popular reinforcement learning (RL) strategy of estimating the state-action value (Q-function) by minimizing the mean squared Bellman error leads to a regression problem with confounding, the inputs and output noise being…

Machine Learning · Computer Science 2022-12-01 Yutian Chen , Liyuan Xu , Caglar Gulcehre , Tom Le Paine , Arthur Gretton , Nando de Freitas , Arnaud Doucet

The objective of offline RL is to learn optimal policies when a fixed exploratory demonstrations data-set is available and sampling additional observations is impossible (typically if this operation is either costly or rises ethical…

Machine Learning · Computer Science 2021-06-10 Firas Jarboui , Vianney Perchet

The dominant framework for off-policy multi-goal reinforcement learning involves estimating goal conditioned Q-value function. When learning to achieve multiple goals, data efficiency is intimately connected with the generalization of the…

Artificial Intelligence · Computer Science 2023-06-28 Zhang-Wei Hong , Ge Yang , Pulkit Agrawal

Off-policy learning plays a pivotal role in optimizing and evaluating policies prior to the online deployment. However, during the real-time serving, we observe varieties of interventions and constraints that cause inconsistency between the…

Machine Learning · Computer Science 2022-03-01 Da Xu , Yuting Ye , Chuanwei Ruan , Bo Yang

This paper studies the statistical theory of batch data reinforcement learning with function approximation. Consider the off-policy evaluation problem, which is to estimate the cumulative value of a new target policy from logged history…

Machine Learning · Computer Science 2020-02-25 Yaqi Duan , Mengdi Wang

In the past few years, off-policy reinforcement learning methods have shown promising results in their application for robot control. Deep Q-learning, however, still suffers from poor data-efficiency and is susceptible to stochasticity in…

Machine Learning · Computer Science 2020-08-17 Gabriel Kalweit , Maria Huegle , Joschka Boedecker