English
Related papers

Related papers: Grounding Aleatoric Uncertainty for Unsupervised E…

200 papers

What data or environments to use for training to improve downstream performance is a longstanding and very topical question in reinforcement learning. In particular, Unsupervised Environment Design (UED) methods have gained recent attention…

Machine Learning · Computer Science 2024-10-31 Alexander Rutherford , Michael Beukman , Timon Willi , Bruno Lacerda , Nick Hawes , Jakob Foerster

Reinforcement Learning (RL) algorithms are often known for sample inefficiency and difficult generalization. Recently, Unsupervised Environment Design (UED) emerged as a new paradigm for zero-shot generalization by simultaneously learning a…

Machine Learning · Computer Science 2024-03-18 Abdus Salam Azad , Izzeddin Gur , Jasper Emhoff , Nathaniel Alexis , Aleksandra Faust , Pieter Abbeel , Ion Stoica

Deep reinforcement learning (RL) provides powerful methods for training optimal sequential decision-making agents. As collecting real-world interactions can entail additional costs and safety risks, the common paradigm of sim2real conducts…

Artificial Intelligence · Computer Science 2023-12-11 Minqi Jiang

Deep reinforcement learning (RL) agents may successfully generalize to new settings if trained on an appropriately diverse set of environment and task configurations. Unsupervised Environment Design (UED) is a promising self-supervised RL…

Machine Learning · Computer Science 2022-01-17 Minqi Jiang , Michael Dennis , Jack Parker-Holder , Jakob Foerster , Edward Grefenstette , Tim Rocktäschel

A wide range of reinforcement learning (RL) problems - including robustness, transfer learning, unsupervised RL, and emergent complexity - require specifying a distribution of tasks or environments in which a policy will be trained.…

Machine Learning · Computer Science 2021-02-05 Michael Dennis , Natasha Jaques , Eugene Vinitsky , Alexandre Bayen , Stuart Russell , Andrew Critch , Sergey Levine

Unsupervised Environment Design (UED) offers a promising paradigm for improving reinforcement learning generalization by adaptively shaping training environments, but it requires reliable environment evaluation to remain effective. However,…

Machine Learning · Computer Science 2026-05-05 Fang Yuan , Quanjun Yin , Siqi Shen , Yuxiang Xie , Junqiang Yang , Long Qin , Junjie Zeng , Qinglun Li

Generalizing deep reinforcement learning agents to unseen environments remains a significant challenge. One promising solution is Unsupervised Environment Design (UED), a co-evolutionary framework in which a teacher adaptively generates…

Machine Learning · Computer Science 2026-03-17 Geonwoo Cho , Jaegyun Im , Jihwan Lee , Hojun Yi , Sejin Kim , Sundong Kim

Learning-based techniques have become popular in both model predictive control (MPC) and reinforcement learning (RL). Probabilistic ensemble (PE) models offer a promising approach for modelling system dynamics, showcasing the ability to…

Machine Learning · Computer Science 2024-05-07 Yuan Zhang , Jasper Hoffmann , Joschka Boedecker

A pervasive challenge in Reinforcement Learning (RL) is the "curse of dimensionality" which is the exponential growth in the state-action space when optimizing a high-dimensional target task. The framework of curriculum learning trains the…

Machine Learning · Computer Science 2025-03-24 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

The past decade has seen vast progress in deep reinforcement learning (RL) on the back of algorithms manually designed by human researchers. Recently, it has been shown that it is possible to meta-learn update rules, with the hope of…

Reinforcement learning (RL) has demonstrated considerable potential for enhancing reasoning in large language models (LLMs). However, existing methods suffer from Gradient Starvation and Policy Degradation when training directly on samples…

Machine Learning · Computer Science 2025-11-13 Renda Li , Hailang Huang , Fei Wei , Feng Xiong , Yong Wang , Xiangxiang Chu

This study is aimed at addressing the problem of fault tolerance of quadruped robots to actuator failure, which is critical for robots operating in remote or extreme environments. In particular, an adaptive curriculum reinforcement learning…

Robotics · Computer Science 2024-10-28 Wataru Okamoto , Hiroshi Kera , Kazuhiko Kawamoto

Reinforcement learning (RL) is a powerful tool for optimal control that has found great success in Atari games, the game of Go, robotic control, and building optimization. RL is also very brittle; agents often overfit to their training…

Machine Learning · Computer Science 2023-12-19 Doseok Jang , Larry Yan , Lucas Spangher , Costas Spanos

Unsupervised recalibration (URC) is a general way to improve the accuracy of an already trained probabilistic classification or regression model upon encountering new data while deployed in the field. URC does not require any ground truth…

Machine Learning · Statistics 2020-10-20 Albert Ziegler , Paweł Czyż

Model-Free Reinforcement Learning (RL) algorithms either learn how to map states to expected rewards or search for policies that can maximize a certain performance function. Model-Based algorithms instead, aim to learn an approximation of…

Machine Learning · Computer Science 2024-11-19 Juan Cardenas-Cartagena , Massimiliano Falzari , Marco Zullich , Matthia Sabatelli

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

We investigate reinforcement learning (RL) in the presence of distributional mismatch between training and deployment, where policies trained in simulators often underperform in practice due to mismatches between training and deployment…

Machine Learning · Computer Science 2025-11-12 Debamita Ghosh , George K. Atia , Yue Wang

Robust reinforcement learning (Robust RL) seeks to handle epistemic uncertainty in environment dynamics, but existing approaches often rely on nested min--max optimization, which is computationally expensive and yields overly conservative…

Machine Learning · Computer Science 2025-10-15 Chenliang Li , Junyu Leng , Jiaxiang Li , Youbang Sun , Shixiang Chen , Shahin Shahrampour , Alfredo Garcia

At the boundary between the known and the unknown, an agent inevitably confronts the dilemma of whether to explore or to exploit. Epistemic uncertainty reflects such boundaries, representing systematic uncertainty due to limited knowledge.…

Machine Learning · Computer Science 2026-03-03 Jianfei Ma , Wee Sun Lee

Gradient-based meta-learners such as Model-Agnostic Meta-Learning (MAML) have shown strong few-shot performance in supervised and reinforcement learning settings. However, specifically in the case of meta-reinforcement learning (meta-RL),…

Machine Learning · Computer Science 2020-02-20 Bhairav Mehta , Tristan Deleu , Sharath Chandra Raparthy , Chris J. Pal , Liam Paull
‹ Prev 1 2 3 10 Next ›