English
Related papers

Related papers: Imitating Cost-Constrained Behaviors in Reinforcem…

200 papers

This article studies inverse reinforcement learning (IRL) for the stochastic linear-quadratic optimal control problem, where two agents are considered. A learner agent does not know the expert agent's performance cost function, but it…

Optimization and Control · Mathematics 2024-05-28 Zhongshi Sun , Guangyan Jia

Consider an imitation learning problem that the imitator and the expert have different dynamics models. Most of the current imitation learning methods fail because they focus on imitating actions. We propose a novel state alignment-based…

Machine Learning · Computer Science 2019-11-26 Fangchen Liu , Zhan Ling , Tongzhou Mu , Hao Su

Designing rewards for Reinforcement Learning (RL) is challenging because it needs to convey the desired task, be efficient to optimize, and be easy to compute. The latter is particularly problematic when applying RL to robotics, where…

Machine Learning · Computer Science 2020-05-28 Yiming Ding , Carlos Florensa , Mariano Phielipp , Pieter Abbeel

Reinforcement learning can greatly benefit from the use of options as a way of encoding recurring behaviours and to foster exploration. An important open problem is how can an agent autonomously learn useful options when solving particular…

Machine Learning · Computer Science 2020-01-07 Manuel Del Verme , Bruno Castro da Silva , Gianluca Baldassarre

When deploying artificial agents in real-world environments where they interact with humans, it is crucial that their behavior is aligned with the values, social norms or other requirements of that environment. However, many environments…

Machine Learning · Computer Science 2023-05-05 Mattijs Baert , Pietro Mazzaglia , Sam Leroux , Pieter Simoens

Reinforcement learning methods require careful design involving a reward function to obtain the desired action policy for a given task. In the absence of hand-crafted reward functions, prior work on the topic has proposed several methods…

Machine Learning · Computer Science 2018-10-16 Daiki Kimura , Subhajit Chaudhury , Ryuki Tachibana , Sakyasingha Dasgupta

We study the problem of imitating an expert demonstrator in a discrete-time, continuous state-and-action control system. We show that, even if the dynamics satisfy a control-theoretic property called exponential stability (i.e. the effects…

Machine Learning · Computer Science 2025-07-29 Max Simchowitz , Daniel Pfrommer , Ali Jadbabaie

Although recent model-free reinforcement learning algorithms have been shown to be capable of mastering complicated decision-making tasks, the sample complexity of these methods has remained a hurdle to utilizing them in many real-world…

Machine Learning · Computer Science 2020-04-21 Saeed Moazami , Peggy Doerschuk

Critical sectors of human society are progressing toward the adoption of powerful artificial intelligence (AI) agents, which are trained individually on behalf of self-interested principals but deployed in a shared environment. Short of…

Multiagent Systems · Computer Science 2021-12-22 Jiachen Yang , Ethan Wang , Rakshit Trivedi , Tuo Zhao , Hongyuan Zha

This work handles the inverse reinforcement learning (IRL) problem where only a small number of demonstrations are available from a demonstrator for each high-dimensional task, insufficient to estimate an accurate reward function. Observing…

Artificial Intelligence · Computer Science 2017-10-16 Kun Li , Joel W. Burdick

Imitation learning has proven effective for training robots to perform complex tasks from expert human demonstrations. However, it remains limited by its reliance on high-quality, task-specific data, restricting adaptability to the diverse…

Active learning agents typically employ a query selection algorithm which solely considers the agent's learning objectives. However, this may be insufficient in more realistic human domains. This work uses imitation learning to enable an…

Machine Learning · Computer Science 2019-07-02 Kalesha Bullard , Yannick Schroecker , Sonia Chernova

Imitation learning enables robots to learn from demonstrations. Previous imitation learning algorithms usually assume access to optimal expert demonstrations. However, in many real-world applications, this assumption is limiting. Most…

Machine Learning · Computer Science 2021-03-11 Zhangjie Cao , Dorsa Sadigh

Recently, motion generation by machine learning has been actively researched to automate various tasks. Imitation learning is one such method that learns motions from data collected in advance. However, executing long-term tasks remains…

Robotics · Computer Science 2022-03-17 Kazuki Hayashi , Sho Sakaino , Toshiaki Tsuji

Many machine learning systems are built to solve the hardest examples of a particular task, which often makes them large and expensive to run---especially with respect to the easier examples, which might require much less computation. For…

Machine Learning · Computer Science 2022-11-09 Jessica B. Hamrick , Andrew J. Ballard , Razvan Pascanu , Oriol Vinyals , Nicolas Heess , Peter W. Battaglia

Inverse reinforcement learning methods aim to retrieve the reward function of a Markov decision process based on a dataset of expert demonstrations. The commonplace scarcity and heterogeneous sources of such demonstrations can lead to the…

Machine Learning · Computer Science 2024-09-13 Ivan Ovinnikov , Eugene Bykovets , Joachim M. Buhmann

This paper presents an interpretable reward design framework for reinforcement learning based constrained optimal control problems with state and terminal constraints. The problem is formalized within a standard partially observable Markov…

Systems and Control · Electrical Eng. & Systems 2025-03-05 Jingjie Ni , Fangfei Li , Xin Jin , Xianlun Peng , Yang Tang

Imitation learning (IL) has achieved considerable success in solving complex sequential decision-making problems. However, current IL methods mainly assume that the environment for learning policies is the same as the environment for…

Machine Learning · Computer Science 2023-10-24 Siyuan Li , Xun Wang , Rongchang Zuo , Kewu Sun , Lingfei Cui , Jishiyu Ding , Peng Liu , Zhe Ma

We consider the problem of imitation learning under misspecification: settings where the learner is fundamentally unable to replicate expert behavior everywhere. This is often true in practice due to differences in observation space and…

Machine Learning · Computer Science 2025-04-03 Nicolas Espinosa-Dice , Sanjiban Choudhury , Wen Sun , Gokul Swamy

Model-based reinforcement learning (MBRL) aims to learn a dynamic model to reduce the number of interactions with real-world environments. However, due to estimation error, rollouts in the learned model, especially those of long horizons,…

Machine Learning · Computer Science 2020-03-17 Yueh-Hua Wu , Ting-Han Fan , Peter J. Ramadge , Hao Su
‹ Prev 1 4 5 6 7 8 10 Next ›