English
Related papers

Related papers: Learning Invariant Representations for Reinforceme…

200 papers

Teaching robots novel skills with demonstrations via human-in-the-loop data collection techniques like kinesthetic teaching or teleoperation puts a heavy burden on human supervisors. In contrast to this paradigm, it is often significantly…

Robotics · Computer Science 2024-04-24 Daniel Yang , Davin Tjia , Jacob Berg , Dima Damen , Pulkit Agrawal , Abhishek Gupta

Humans learn quickly even in tasks that contain complex visual information. This is due in part to the efficient formation of compressed representations of visual information, allowing for better generalization and robustness. However,…

Artificial Intelligence · Computer Science 2025-05-16 Tailia Malloy , Miao Liu , Matthew D. Riemer , Tim Klinger , Gerald Tesauro , Chris R. Sims

We propose learning via retracing, a novel self-supervised approach for learning the state representation (and the associated dynamics model) for reinforcement learning tasks. In addition to the predictive (reconstruction) supervision in…

Machine Learning · Computer Science 2022-09-26 Changmin Yu , Dong Li , Jianye Hao , Jun Wang , Neil Burgess

We present a new approach for representing and reconstructing multidimensional magnetic resonance imaging (MRI) data. Our method builds on a novel, learned feature-based image representation that disentangles different types of features,…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Ruiyang Zhao , Fan Lam

Imitation can be viewed as a means of enhancing learning in multiagent environments. It augments an agent's ability to learn useful behaviors by making intelligent use of the knowledge implicit in behaviors demonstrated by cooperative…

Machine Learning · Computer Science 2011-06-06 C. Boutilier , B. Price

Practitioners often face the challenge of deploying prediction models in new environments with shifted distributions of covariates and responses. With observational data, such shifts are often driven by unobserved confounding, and can in…

Machine Learning · Computer Science 2026-04-02 Kulunu Dharmakeerthi , YoonHaeng Hur , Tengyuan Liang

We consider the problem of using expert data with unobserved confounders for imitation and reinforcement learning. We begin by defining the problem of learning from confounded expert data in a contextual MDP setup. We analyze the…

Machine Learning · Computer Science 2021-10-14 Guy Tennenholtz , Assaf Hallak , Gal Dalal , Shie Mannor , Gal Chechik , Uri Shalit

Transfer reinforcement learning aims to improve the sample efficiency of solving unseen new tasks by leveraging experiences obtained from previous tasks. We consider the setting where all tasks (MDPs) share the same environment dynamic…

Machine Learning · Computer Science 2021-01-08 Kaige Yang

One of the key challenges in visual imitation learning is collecting large amounts of expert demonstrations for a given task. While methods for collecting human demonstrations are becoming easier with teleoperation methods and the use of…

Robotics · Computer Science 2021-07-20 Sarah Young , Jyothish Pari , Pieter Abbeel , Lerrel Pinto

Image-based Reinforcement Learning is a practical yet challenging task. A major hurdle lies in extracting control-centric representations while disregarding irrelevant information. While approaches that follow the bisimulation principle…

Machine Learning · Computer Science 2023-10-30 Chen Liu , Hongyu Zang , Xin Li , Yong Heng , Yifei Wang , Zhen Fang , Yisen Wang , Mingzhong Wang

Model-free Reinforcement Learning (RL) algorithms such as Q-learning [Watkins, Dayan 92] have been widely used in practice and can achieve human level performance in applications such as video games [Mnih et al. 15]. Recently, equipped with…

Machine Learning · Computer Science 2019-05-03 Zhao Song , Wen Sun

Augmenting reinforcement learning with imitation learning is often hailed as a method by which to improve upon learning from scratch. However, most existing methods for integrating these two techniques are subject to several strong…

Machine Learning · Computer Science 2020-07-23 Brahma S. Pavse , Faraz Torabi , Josiah P. Hanna , Garrett Warnell , Peter Stone

The problem of Learning from Demonstration is targeted at learning to perform tasks based on observed examples. One approach to Learning from Demonstration is Inverse Reinforcement Learning, in which actions are observed to infer rewards.…

Neural and Evolutionary Computing · Computer Science 2016-08-11 Karan K. Budhraja , Tim Oates

Operating directly from raw high dimensional sensory inputs like images is still a challenge for robotic control. Recently, Reinforcement Learning methods have been proposed to solve specific tasks end-to-end, from pixels to torques.…

Machine Learning · Computer Science 2019-01-07 Carlos Florensa , Jonas Degrave , Nicolas Heess , Jost Tobias Springenberg , Martin Riedmiller

Teaching an anthropomorphic robot from human example offers the opportunity to impart humanlike qualities on its movement. In this work we present a reinforcement learning based method for teaching a real world bipedal robot to perform…

In the present paper, we propose a decoder-free extension of Dreamer, a leading model-based reinforcement learning (MBRL) method from pixels. Dreamer is a sample- and cost-efficient solution to robot learning, as it is used to train latent…

Machine Learning · Computer Science 2021-03-15 Masashi Okada , Tadahiro Taniguchi

Traditional model-based reinforcement learning (RL) methods generate forward rollout traces using the learnt dynamics model to reduce interactions with the real environment. The recent model-based RL method considers the way to learn a…

Machine Learning · Computer Science 2022-08-05 Yuxin Pan , Fangzhen Lin

Extracting and predicting object structure and dynamics from videos without supervision is a major challenge in machine learning. To address this challenge, we adopt a keypoint-based image representation and learn a stochastic dynamics…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Matthias Minderer , Chen Sun , Ruben Villegas , Forrester Cole , Kevin Murphy , Honglak Lee

This work introduces a hierarchical strategy for terrain-aware bipedal locomotion that integrates reduced-dimensional perceptual representations to enhance reinforcement learning (RL)-based high-level (HL) policies for real-time gait…

Robotics · Computer Science 2025-12-16 Guillermo A. Castillo , Himanshu Lodha , Ayonga Hereid

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee