English
Related papers

Related papers: Situated GAIL: Multitask imitation using task-cond…

200 papers

Many robotic tasks are composed of a lot of temporally correlated sub-tasks in a highly complex environment. It is important to discover situational intentions and proper actions by deliberating on temporal abstractions to solve problems…

Machine Learning · Computer Science 2022-07-26 Se-Wook Yoo , Seung-Woo Seo

Reinforcement learning faces significant challenges when applied to tasks characterized by sparse reward structures. Although imitation learning, within the domain of supervised learning, offers faster convergence, it relies heavily on…

Machine Learning · Computer Science 2025-09-04 Zeqiang Zhang , Fabian Wurzberger , Gerrit Schmid , Sebastian Gottwald , Daniel A. Braun

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

Machine Learning · Computer Science 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song

Developing agents capable of autonomously interacting with complex and dynamic environments, where task structures may change over time and prior knowledge cannot be relied upon, is a key prerequisite for deploying artificial systems in…

Robotics · Computer Science 2025-06-24 Alejandro Romero , Gianluca Baldassarre , Richard J. Duro , Vieri Giuliano Santucci

Decision-making in long-tail scenarios is pivotal to autonomous-driving development, and realistic and challenging simulations play a crucial role in testing safety-critical situations. However, existing open-source datasets lack systematic…

Robotics · Computer Science 2025-09-09 Chuancheng Zhang , Zhenhao Wang , Jiangcheng Wang , Kun Su , Qiang Lv , Bin Jiang , Kunkun Hao , Wenyu Wang

Reinforcement learning has seen increasing applications in real-world contexts over the past few years. However, physical environments are often imperfect and policies that perform well in simulation might not achieve the same performance…

Machine Learning · Computer Science 2022-11-15 Carlos Purves , Pietro Liò , Cătălina Cangea

Generalizable object manipulation skills are critical for intelligent and multi-functional robots to work in real-world complex scenes. Despite the recent progress in reinforcement learning, it is still very challenging to learn a…

Robotics · Computer Science 2022-09-14 Hao Shen , Weikang Wan , He Wang

Explicit engineering of reward functions for given environments has been a major hindrance to reinforcement learning methods. While Inverse Reinforcement Learning (IRL) is a solution to recover reward functions from demonstrations only,…

Machine Learning · Computer Science 2020-02-24 David Venuto , Jhelum Chakravorty , Leonard Boussioux , Junhao Wang , Gavin McCracken , Doina Precup

We demonstrate the first large-scale application of model-based generative adversarial imitation learning (MGAIL) to the task of dense urban self-driving. We augment standard MGAIL using a hierarchical model to enable generalization to…

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model…

Robotics · Computer Science 2020-06-01 Takazumi Matsumoto , Jun Tani

This paper presents a novel framework for automatic learning of complex strategies in human decision making. The task that we are interested in is to better facilitate long term planning for complex, multi-step events. We observe temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-05-15 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Imitation learning aims to solve the problem of defining reward functions in real-world decision-making tasks. The current popular approach is the Adversarial Imitation Learning (AIL) framework, which matches expert state-action occupancy…

Machine Learning · Computer Science 2023-12-13 Bingzheng Wang , Guoqiang Wu , Teng Pang , Yan Zhang , Yilong Yin

Curriculum learning has emerged as a promising approach for training complex robotics tasks, yet current applications predominantly rely on manually designed curricula, which demand significant engineering effort and can suffer from…

Robotics · Computer Science 2025-08-06 Linji Wang , Zifan Xu , Peter Stone , Xuesu Xiao

Providing a suitable reward function to reinforcement learning can be difficult in many real world applications. While inverse reinforcement learning (IRL) holds promise for automatically learning reward functions from demonstrations,…

Machine Learning · Computer Science 2019-10-29 Lantao Yu , Tianhe Yu , Chelsea Finn , Stefano Ermon

It is of significance for an agent to learn a widely applicable and general-purpose policy that can achieve diverse goals including images and text descriptions. Considering such perceptually-specific goals, the frontier of deep…

Machine Learning · Computer Science 2021-12-14 Jinxin Liu , Donglin Wang , Qiangxing Tian , Zhengyu Chen

Analyzing the handwriting generation process is an important issue and has been tackled by various generation models, such as kinematics based models and stochastic models. In this study, we use a reinforcement learning (RL) framework to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Keisuke Kanda , Brian Kenji Iwana , Seiichi Uchida

Human beings are able to understand objectives and learn by simply observing others perform a task. Imitation learning methods aim to replicate such capabilities, however, they generally depend on access to a full set of optimal states and…

Machine Learning · Computer Science 2021-03-10 Edoardo Cetin , Oya Celiktutan

Generative Adversarial Imitation Learning (GAIL) stands as a cornerstone approach in imitation learning. This paper investigates the gradient explosion in two types of GAIL: GAIL with deterministic policy (DE-GAIL) and GAIL with stochastic…

Machine Learning · Computer Science 2023-12-19 Wanying Wang , Yichen Zhu , Yirui Zhou , Chaomin Shen , Jian Tang , Zhiyuan Xu , Yaxin Peng , Yangchun Zhang

Adversarial Imitation Learning (AIL) is a class of algorithms in Reinforcement learning (RL), which tries to imitate an expert without taking any reward from the environment and does not provide expert behavior directly to the policy…

Machine Learning · Computer Science 2020-05-05 Samin Yeasar Arnob

Goal-conditioned reinforcement learning endows an agent with a large variety of skills, but it often struggles to solve tasks that require more temporally extended reasoning. In this work, we propose to incorporate imagined subgoals into…

Machine Learning · Computer Science 2021-07-02 Elliot Chane-Sane , Cordelia Schmid , Ivan Laptev