English
Related papers

Related papers: Unsupervised Domain Adaptation with Dynamics-Aware…

200 papers

Reinforcement learning provides a general framework for learning robotic skills while minimizing engineering effort. However, most reinforcement learning algorithms assume that a well-designed reward function is provided, and learn a single…

Robotics · Computer Science 2020-04-28 Archit Sharma , Michael Ahn , Sergey Levine , Vikash Kumar , Karol Hausman , Shixiang Gu

Deep reinforcement learning (RL) can acquire complex behaviors from low-level inputs, such as images. However, real-world applications of such methods require generalizing to the vast variability of the real world. Deep networks are known…

Machine Learning · Computer Science 2017-03-13 Chelsea Finn , Tianhe Yu , Justin Fu , Pieter Abbeel , Sergey Levine

Representation learning and unsupervised skill discovery can allow robots to acquire diverse and reusable behaviors without the need for task-specific rewards. In this work, we use unsupervised reinforcement learning to learn a latent…

In reinforcement learning, unsupervised skill discovery aims to learn diverse skills without extrinsic rewards. Previous methods discover skills by maximizing the mutual information (MI) between states and skills. However, such an MI…

Machine Learning · Computer Science 2023-05-09 Rushuai Yang , Chenjia Bai , Hongyi Guo , Siyuan Li , Bin Zhao , Zhen Wang , Peng Liu , Xuelong Li

Unsupervised skill discovery carries the promise that an intelligent agent can learn reusable skills through autonomous, reward-free environment interaction. Existing unsupervised skill discovery methods learn skills by encouraging…

Machine Learning · Computer Science 2024-10-25 Zizhao Wang , Jiaheng Hu , Caleb Chuck , Stephen Chen , Roberto Martín-Martín , Amy Zhang , Scott Niekum , Peter Stone

Machine learning is driven by data, yet while their availability is constantly increasing, training data require laborious, time consuming and error-prone labelling or ground truth acquisition, which in some cases is very difficult or even…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Vasileios Gkitsas , Antonis Karakottas , Nikolaos Zioulis , Dimitrios Zarpalas , Petros Daras

A generalist robot must be able to complete a variety of tasks in its environment. One appealing way to specify each task is in terms of a goal observation. However, learning goal-reaching policies with reinforcement learning remains a…

Machine Learning · Computer Science 2021-01-01 Stephen Tian , Suraj Nair , Frederik Ebert , Sudeep Dasari , Benjamin Eysenbach , Chelsea Finn , Sergey Levine

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

In principle, meta-reinforcement learning algorithms leverage experience across many tasks to learn fast reinforcement learning (RL) strategies that transfer to similar tasks. However, current meta-RL approaches rely on manually-defined…

Artificial Intelligence · Computer Science 2019-12-10 Allan Jabri , Kyle Hsu , Ben Eysenbach , Abhishek Gupta , Sergey Levine , Chelsea Finn

Unsupervised reinforcement learning aims to train agents to learn a handful of policies or skills in environments without external reward. These pre-trained policies can accelerate learning when endowed with external reward, and can also be…

Machine Learning · Computer Science 2021-10-18 Shuncheng He , Yuhang Jiang , Hongchang Zhang , Jianzhun Shao , Xiangyang Ji

Recent work has shown that deep reinforcement-learning agents can learn to follow language-like instructions from infrequent environment rewards. However, this places on environment designers the onus of designing language-conditional…

Artificial Intelligence · Computer Science 2019-12-24 Dzmitry Bahdanau , Felix Hill , Jan Leike , Edward Hughes , Arian Hosseini , Pushmeet Kohli , Edward Grefenstette

Visual navigation is a task of training an embodied agent by intelligently navigating to a target object (e.g., television) using only visual observations. A key challenge for current deep reinforcement learning models lies in the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Juncheng Li , Xin Wang , Siliang Tang , Haizhou Shi , Fei Wu , Yueting Zhuang , William Yang Wang

Continuous Domain Adaptation (CDA) effectively bridges significant domain shifts by progressively adapting from the source domain through intermediate domains to the target domain. However, selecting intermediate domains without explicit…

Machine Learning · Computer Science 2025-10-14 Hanbing Liu , Huaze Tang , Yanru Wu , Yang Li , Xiao-Ping Zhang

To successfully tackle challenging manipulation tasks, autonomous agents must learn a diverse set of skills and how to combine them. Recently, self-supervised agents that set their own abstract goals by exploiting the discovered structure…

Machine Learning · Computer Science 2022-02-01 Andrii Zadaianchuk , Georg Martius , Fanny Yang

We consider the problem of learning useful robotic skills from previously collected offline data without access to manually specified rewards or additional online exploration, a setting that is becoming increasingly important for scaling…

Offline reinforcement learning algorithms promise to be applicable in settings where a fixed dataset is available and no new experience can be acquired. However, such formulation is inevitably offline-data-hungry and, in practice,…

Machine Learning · Computer Science 2022-03-15 Jinxin Liu , Hongyin Zhang , Donglin Wang

Unsupervised domain adaptation studies the problem of utilizing a relevant source domain with abundant labels to build predictive modeling for an unannotated target domain. Recent work observe that the popular adversarial approach of…

Machine Learning · Statistics 2020-01-06 Shen Yan , Huan Song , Nanxiang Li , Lincan Zou , Liu Ren

It is vital to learn effective policies that can be transferred to different domains with dynamics discrepancies in reinforcement learning (RL). In this paper, we consider dynamics adaptation settings where there exists dynamics mismatch…

Machine Learning · Computer Science 2024-05-27 Jiafei Lyu , Chenjia Bai , Jingwen Yang , Zongqing Lu , Xiu Li

Can artificial agents learn to assist others in achieving their goals without knowing what those goals are? Generic reinforcement learning agents could be trained to behave altruistically towards others by rewarding them for altruistic…

Artificial Intelligence · Computer Science 2022-03-22 Tim Franzmeyer , Mateusz Malinowski , João F. Henriques

In complex real-world tasks such as robotic manipulation and autonomous driving, collecting expert demonstrations is often more straightforward than specifying precise learning objectives and task descriptions. Learning from expert data can…

Robotics · Computer Science 2025-05-05 Daulet Baimukashev , Gokhan Alcan , Kevin Sebastian Luck , Ville Kyrki