English
Related papers

Related papers: Information-Theoretic Policy Learning from Partial…

200 papers

Imitation learning has emerged as a powerful paradigm in robot manipulation, yet its generalization capability remains constrained by object-specific dependencies in limited expert demonstrations. To address this challenge, we propose…

Robotics · Computer Science 2025-06-27 Zhuochen Miao , Jun Lv , Hongjie Fang , Yang Jin , Cewu Lu

Imitation learning (IL) enables agents to acquire skills by observing and replicating the behavior of one or multiple experts. In recent years, advances in deep learning have significantly expanded the capabilities and scalability of…

Machine Learning · Computer Science 2025-11-06 Iason Chrysomallis , Georgios Chalkiadakis

We develop a methodology to learn finitely generated random iterated function systems from time-series of partial observations using delay embeddings. We obtain a minimal model representation for the observed dynamics, using a hidden…

Dynamical Systems · Mathematics 2025-08-20 Emilia Gibson , Jeroen S. W. Lamb

Recent work has demonstrated that problems-- particularly imitation learning and structured prediction-- where a learner's predictions influence the input-distribution it is tested on can be naturally addressed by an interactive approach…

Machine Learning · Computer Science 2014-06-24 Stephane Ross , J. Andrew Bagnell

Imitation learning enables robots to learn and replicate human behavior from training data. Recent advances in machine learning enable end-to-end learning approaches that directly process high-dimensional observation data, such as images.…

Robotics · Computer Science 2024-01-22 Koki Yamane , Sho Sakaino , Toshiaki Tsuji

Imitation learning trains a policy by mimicking expert demonstrations. Various imitation methods were proposed and empirically evaluated, meanwhile, their theoretical understanding needs further studies. In this paper, we firstly analyze…

Machine Learning · Computer Science 2020-10-23 Tian Xu , Ziniu Li , Yang Yu

A major bottleneck in imitation learning is the requirement of a large number of expert demonstrations, which can be expensive or inaccessible. Learning from supplementary demonstrations without strict quality requirements has emerged as a…

Machine Learning · Computer Science 2024-12-31 Jiangdong Fan , Hongcai He , Paul Weng , Hui Xu , Jie Shao

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

This study proposes an imitation learning method based on force and position information. Force information is required for precise object manipulation but is difficult to obtain because the acting and reaction forces cannnot be separated.…

Robotics · Computer Science 2018-11-29 Tsuyoshi Adachi , Kazuki Fujimoto , Sho Sakaino , Toshiaki Tsuji

Imitation Learning is a promising paradigm for learning complex robot manipulation skills by reproducing behavior from human demonstrations. However, manipulation tasks often contain bottleneck regions that require a sequence of precise…

Robotics · Computer Science 2020-12-15 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Yuke Zhu , Li Fei-Fei , Silvio Savarese

The problem of statistical learning is to construct a predictor of a random variable $Y$ as a function of a related random variable $X$ on the basis of an i.i.d. training sample from the joint distribution of $(X,Y)$. Allowable predictors…

Information Theory · Computer Science 2016-11-15 Maxim Raginsky

We present an algorithm for Inverse Reinforcement Learning (IRL) from expert state observations only. Our approach decouples reward modelling from policy learning, unlike state-of-the-art adversarial methods which require updating the…

Machine Learning · Computer Science 2022-05-20 Wei-Di Chang , Juan Camilo Gamboa Higuera , Scott Fujimoto , David Meger , Gregory Dudek

Imitation learning is a data-driven approach to acquiring skills that relies on expert demonstrations to learn a policy that maps observations to actions. When performing demonstrations, experts are not always consistent and might…

Machine Learning · Computer Science 2021-01-05 Sagar Gubbi Venkatesh , Nihesh Rathod , Shishir Kolathaya , Bharadwaj Amrutur

Building models of human decision-making from observed behaviour is critical to better understand, diagnose and support real-world policies such as clinical care. As established policy learning approaches remain focused on imitation…

Machine Learning · Computer Science 2022-10-03 Alizée Pace , Alex J. Chan , Mihaela van der Schaar

We examine the problem of transferring a policy learned in a source environment to a target environment with different dynamics, particularly in the case where it is critical to reduce the amount of interaction with the target environment…

Artificial Intelligence · Computer Science 2021-01-26 Siddharth Desai , Ishan Durugkar , Haresh Karnan , Garrett Warnell , Josiah Hanna , Peter Stone

Humans achieve efficient learning by relying on prior knowledge about the structure of naturally occurring tasks. There is considerable interest in designing reinforcement learning (RL) algorithms with similar properties. This includes…

Machine Learning · Computer Science 2019-10-23 Jan Humplik , Alexandre Galashov , Leonard Hasenclever , Pedro A. Ortega , Yee Whye Teh , Nicolas Heess

Imitation learning has proven effective for training robots to perform complex tasks from expert human demonstrations. However, it remains limited by its reliance on high-quality, task-specific data, restricting adaptability to the diverse…

We are interested in enabling autonomous agents to learn and reason about systems with hidden states, such as locking mechanisms. We cast this problem as learning the parameters of a discrete Partially Observable Markov Decision Process…

Machine Learning · Computer Science 2026-02-04 Seiji Shaw , Travis Manderson , Chad Kessens , Nicholas Roy

Generative model-based imitation learning methods have recently achieved strong results in learning high-complexity motor skills from human demonstrations. However, imitation learning of interactive policies that coordinate with humans in…

Robotics · Computer Science 2025-11-18 Max M. Sun , Todd Murphey

This paper studies Learning from Observations (LfO) for imitation learning with access to state-only demonstrations. In contrast to Learning from Demonstration (LfD) that involves both action and state supervision, LfO is more practical in…

Machine Learning · Computer Science 2019-11-19 Chao Yang , Xiaojian Ma , Wenbing Huang , Fuchun Sun , Huaping Liu , Junzhou Huang , Chuang Gan