中文
相关论文

相关论文: IV-Posterior: Inverse Value Estimation for Interpr…

200 篇论文

Policy networks are a central feature of deep reinforcement learning (RL) algorithms for continuous control, enabling the estimation and sampling of high-value actions. From the variational inference perspective on RL, policy networks, when…

机器学习 · 计算机科学 2021-10-26 Joseph Marino , Alexandre Piché , Alessandro Davide Ialongo , Yisong Yue

The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can…

机器学习 · 计算机科学 2024-02-12 Somjit Nath , Rushiv Arora , Samira Ebrahimi Kahou

Robotic manipulation policies are commonly initialized through imitation learning, but their performance is limited by the scarcity and narrow coverage of expert data. Reinforcement learning can refine polices to alleviate this limitation,…

机器人学 · 计算机科学 2026-03-23 Zhennan Jiang , Kai Liu , Yuxin Qin , Shuai Tian , Yupeng Zheng , Mingcai Zhou , Chao Yu , Haoran Li , Dongbin Zhao

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

机器学习 · 计算机科学 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

Inverse reinforcement learning (IRL) is used to infer the reward function from the actions of an expert running a Markov Decision Process (MDP). A novel approach using variational inference for learning the reward function is proposed in…

机器学习 · 计算机科学 2019-10-03 Arpan Kusari

Consider learning an imitation policy on the basis of demonstrated behavior from multiple environments, with an eye towards deployment in an unseen environment. Since the observable features from each setting may be different, directly…

机器学习 · 统计学 2023-11-06 Ioana Bica , Daniel Jarrett , Mihaela van der Schaar

Inverse Reinforcement Learning (IRL) has demonstrated effectiveness in a variety of imitation tasks. In this paper, we introduce an IRL framework designed to extract rewarding features from expert trajectories affected by delayed…

机器学习 · 计算机科学 2024-12-05 Simon Sinong Zhan , Qingyuan Wu , Zhian Ruan , Frank Yang , Philip Wang , Yixuan Wang , Ruochen Jiao , Chao Huang , Qi Zhu

Reinforcement Learning (RL) has shown exceptional performance across various applications, enabling autonomous agents to learn optimal policies through interaction with their environments. However, traditional RL frameworks often face…

机器学习 · 计算机科学 2025-09-03 Rui Liu , Anish Gupta , Erfaun Noorani , Pratap Tokekar

When learning to behave in a stochastic environment where safety is critical, such as driving a vehicle in traffic, it is natural for human drivers to plan fallback strategies as a backup to use if ever there is an unexpected change in the…

机器学习 · 计算机科学 2022-04-12 Ugo Lecerf , Christelle Yemdji-Tchassi , Sébastien Aubert , Pietro Michiardi

Imitation learning has emerged as an effective approach for bootstrapping sequential decision-making in robotics, achieving strong performance even in high-dimensional dexterous manipulation tasks. Recent behavior cloning methods further…

机器人学 · 计算机科学 2026-02-06 Entong Su , Tyler Westenbroek , Anusha Nagabandi , Abhishek Gupta

Reinforcement Learning (RL) bears the promise of being a game-changer in many applications. However, since most of the literature in the field is currently focused on opaque models, the use of RL in high-stakes scenarios, where…

机器学习 · 计算机科学 2025-01-22 Leonardo Lucio Custode , Giovanni Iacca

A reinforcement learning agent that needs to pursue different goals across episodes requires a goal-conditional policy. In addition to their potential to generalize desirable behavior to unseen goals, such policies may also enable…

机器学习 · 计算机科学 2019-02-21 Paulo Rauber , Avinash Ummadisingu , Filipe Mutz , Juergen Schmidhuber

Reinforcement learning with verifiable rewards (RLVR) for Large Reasoning Models hinges on baseline estimation for variance reduction, but existing approaches pay a heavy price: PPO requires a policy-model scale critic, while GRPO needs…

机器学习 · 计算机科学 2026-05-12 Yunho Choi , Jongwon Lim , Woojin Ahn , Minjae Oh , Jeonghoon Shim , Yohan Jo

We present an algorithm for Inverse Reinforcement Learning (IRL) from expert state observations only. Our approach decouples reward modelling from policy learning, unlike state-of-the-art adversarial methods which require updating the…

机器学习 · 计算机科学 2022-05-20 Wei-Di Chang , Juan Camilo Gamboa Higuera , Scott Fujimoto , David Meger , Gregory Dudek

Reinforcement learning (RL) presents a promising framework to learn policies through environment interaction, but often requires an infeasible amount of interaction data to solve complex tasks from sparse rewards. One direction includes…

机器学习 · 计算机科学 2024-05-07 Stone Tao , Arth Shukla , Tse-kai Chan , Hao Su

Inverse reinforcement learning methods aim to retrieve the reward function of a Markov decision process based on a dataset of expert demonstrations. The commonplace scarcity and heterogeneous sources of such demonstrations can lead to the…

机器学习 · 计算机科学 2024-09-13 Ivan Ovinnikov , Eugene Bykovets , Joachim M. Buhmann

This paper focuses on reinforcement learning (RL) with limited prior knowledge. In the domain of swarm robotics for instance, the expert can hardly design a reward function or demonstrate the target behavior, forbidding the use of both…

机器学习 · 计算机科学 2012-08-07 Riad Akrour , Marc Schoenauer , Michèle Sebag

Can we use reinforcement learning to learn general-purpose policies that can perform a wide range of different tasks, resulting in flexible and reusable skills? Contextual policies provide this capability in principle, but the…

机器学习 · 计算机科学 2021-04-26 Soroush Nasiriany , Vitchyr H. Pong , Ashvin Nair , Alexander Khazatsky , Glen Berseth , Sergey Levine

Deep Reinforcement Learning (RL) is mainly studied in a setting where the training and the testing environments are similar. But in many practical applications, these environments may differ. For instance, in control systems, the robot(s)…

机器学习 · 计算机科学 2022-10-25 Jean-Baptiste Gaya , Laure Soulier , Ludovic Denoyer

Care-giving and assistive robotics, driven by advancements in AI, offer promising solutions to meet the growing demand for care, particularly in the context of increasing numbers of individuals requiring assistance. This creates a pressing…

机器人学 · 计算机科学 2024-05-14 Andrii Tytarenko