English
Related papers

Related papers: EUCLID: Towards Efficient Unsupervised Reinforceme…

200 papers

Reinforcement learning (RL) is a powerful tool for optimal control that has found great success in Atari games, the game of Go, robotic control, and building optimization. RL is also very brittle; agents often overfit to their training…

Machine Learning · Computer Science 2023-12-19 Doseok Jang , Larry Yan , Lucas Spangher , Costas Spanos

Unsupervised reinforcement learning (RL) studies how to leverage environment statistics to learn useful behaviors without the cost of reward engineering. However, a central challenge in unsupervised RL is to extract behaviors that…

What data or environments to use for training to improve downstream performance is a longstanding and very topical question in reinforcement learning. In particular, Unsupervised Environment Design (UED) methods have gained recent attention…

Machine Learning · Computer Science 2024-10-31 Alexander Rutherford , Michael Beukman , Timon Willi , Bruno Lacerda , Nick Hawes , Jakob Foerster

Unsupervised reinforcement learning aims to acquire skills without prior goal representations, where an agent automatically explores an open-ended environment to represent goals and learn the goal-conditioned policy. However, this procedure…

Machine Learning · Computer Science 2021-10-27 Jinxin Liu , Hao Shen , Donglin Wang , Yachen Kang , Qiangxing Tian

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many tasks, whether used…

Computation and Language · Computer Science 2018-11-02 Shao-Yen Tseng , Brian Baucom , Panayiotis Georgiou

A central goal of unsupervised learning is to acquire representations from unlabeled data or experience that can be used for more effective learning of downstream tasks from modest amounts of labeled data. Many prior unsupervised learning…

Machine Learning · Computer Science 2019-03-25 Kyle Hsu , Sergey Levine , Chelsea Finn

To further improve the learning efficiency and performance of reinforcement learning (RL), in this paper we propose a novel uncertainty-aware model-based RL (UA-MBRL) framework, and then implement and validate it in autonomous driving under…

Robotics · Computer Science 2021-07-06 Jingda Wu , Zhiyu Huang , Chen Lv

In this work, we evaluate the effectiveness of representation learning approaches for decision making in visually complex environments. Representation learning is essential for effective reinforcement learning (RL) from high-dimensional…

Machine Learning · Computer Science 2022-04-26 Jun Yamada , Karl Pertsch , Anisha Gunjal , Joseph J. Lim

Recently, unsupervised representation learning (URL) has improved the sample efficiency of Reinforcement Learning (RL) by pretraining a model from a large unlabeled dataset. The underlying principle of these methods is to learn temporally…

Machine Learning · Computer Science 2023-06-12 Hojoon Lee , Koanho Lee , Dongyoon Hwang , Hyunho Lee , Byungkun Lee , Jaegul Choo

Unsupervised skill discovery carries the promise that an intelligent agent can learn reusable skills through autonomous, reward-free environment interaction. Existing unsupervised skill discovery methods learn skills by encouraging…

Machine Learning · Computer Science 2024-10-25 Zizhao Wang , Jiaheng Hu , Caleb Chuck , Stephen Chen , Roberto Martín-Martín , Amy Zhang , Scott Niekum , Peter Stone

Few-shot unsupervised domain adaptation (FS-UDA) leverages a limited amount of labeled data from a source domain to enable accurate classification in an unlabeled target domain. Despite recent advancements, current approaches of FS-UDA…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Wanqi Yang , Haoran Wang , Lei Wang , Ge Song , Ming Yang , Yang Gao

Embodied vision-based real-world systems, such as mobile robots, require a careful balance between energy consumption, compute latency, and safety constraints to optimize operation across dynamic tasks and contexts. As local computation…

We apply reinforcement learning (RL) to robotics tasks. One of the drawbacks of traditional RL algorithms has been their poor sample efficiency. One approach to improve the sample efficiency is model-based RL. In our model-based RL…

Machine Learning · Computer Science 2023-05-16 Adithya Ramesh , Balaraman Ravindran

Meta-learning algorithms use past experience to learn to quickly solve new tasks. In the context of reinforcement learning, meta-learning algorithms acquire reinforcement learning procedures to solve new problems more efficiently by…

Machine Learning · Computer Science 2020-05-01 Abhishek Gupta , Benjamin Eysenbach , Chelsea Finn , Sergey Levine

Designing generalizable agents capable of adapting to diverse embodiments has achieved significant attention in Reinforcement Learning (RL), which is critical for deploying RL agents in various real-world applications. Previous…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Zhongkai Hao , Xinning Zhou , Xuezhou Xu , Hang Su , Xingxing Zhang , Jun Zhu

Effective planning in model-based reinforcement learning (MBRL) and model-predictive control (MPC) relies on the accuracy of the learned dynamics model. In many instances of MBRL and MPC, this model is assumed to be stationary and is…

Machine Learning · Computer Science 2026-05-27 Yizhou Huang , Kevin Xie , Homanga Bharadhwaj , Florian Shkurti

We propose an automated computational algorithm for simultaneous model selection and parameter identification for the hyperelastic mechanical characterization of human brain tissue. Following the motive of the recently proposed…

Quantitative Methods · Quantitative Biology 2024-04-17 Moritz Flaschel , Huitian Yu , Nina Reiter , Jan Hinrichsen , Silvia Budday , Paul Steinmann , Siddhant Kumar , Laura De Lorenzis

Unsupervised pretraining, which learns a useful representation using a large amount of unlabeled data to facilitate the learning of downstream tasks, is a critical component of modern large-scale machine learning systems. Despite its…

Machine Learning · Statistics 2023-03-06 Jiawei Ge , Shange Tang , Jianqing Fan , Chi Jin

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Unsupervised skill discovery seeks to acquire different useful skills…

Machine Learning · Computer Science 2025-02-25 Xin Liu , Yaran Chen , Dongbin Zhao

In real-world tasks, reinforcement learning (RL) agents frequently encounter situations that are not present during training time. To ensure reliable performance, the RL agents need to exhibit robustness against worst-case situations. The…

Machine Learning · Computer Science 2021-03-19 Sebastian Curi , Ilija Bogunovic , Andreas Krause