English
Related papers

Related papers: Enhancing the Hierarchical Environment Design via …

200 papers

Reinforcement Learning (RL) algorithms are often known for sample inefficiency and difficult generalization. Recently, Unsupervised Environment Design (UED) emerged as a new paradigm for zero-shot generalization by simultaneously learning a…

Machine Learning · Computer Science 2024-03-18 Abdus Salam Azad , Izzeddin Gur , Jasper Emhoff , Nathaniel Alexis , Aleksandra Faust , Pieter Abbeel , Ion Stoica

We propose Unified Distributed Environment (UDE), an environment virtualization toolkit for reinforcement learning research. UDE is designed to integrate environments built on any simulation platform such as Gazebo, Unity, Unreal, and…

Machine Learning · Computer Science 2022-05-17 Woong Gyu La , Sunil Muralidhara , Lingjie Kong , Pratik Nichat

Reinforcement learning (RL) is a powerful tool for optimal control that has found great success in Atari games, the game of Go, robotic control, and building optimization. RL is also very brittle; agents often overfit to their training…

Machine Learning · Computer Science 2023-12-19 Doseok Jang , Larry Yan , Lucas Spangher , Costas Spanos

An open problem in Machine Learning is how to avoid models to exploit spurious correlations in the data; a famous example is the background-label shortcut in the Waterbirds dataset. A common remedy is to train a model across multiple…

Machine Learning · Statistics 2025-10-15 Madi Matymov , Ba-Hien Tran , Maurizio Filippone

Nonprehensile manipulation, such as pushing objects across cluttered environments, presents a challenging control problem due to complex contact dynamics and long-horizon planning requirements. In this work, we propose HeRD, a hierarchical…

Robotics · Computer Science 2025-12-12 Steven Caro , Stephen L. Smith

A key limitation preventing the wider adoption of autonomous agents trained via deep reinforcement learning (RL) is their limited ability to generalise to new environments, even when these share similar characteristics with environments…

Machine Learning · Computer Science 2023-12-12 Samuel Garcin , James Doran , Shangmin Guo , Christopher G. Lucas , Stefano V. Albrecht

Unsupervised pre-training can equip reinforcement learning agents with prior knowledge and accelerate learning in downstream tasks. A promising direction, grounded in human development, investigates agents that learn by setting and pursuing…

Machine Learning · Computer Science 2026-01-28 Octavio Pappalardo

We propose a hierarchical learning architecture for predictive control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different…

Systems and Control · Electrical Eng. & Systems 2020-07-16 Charlott Vallon , Francesco Borrelli

Long-horizon decision-making tasks present significant challenges for LLM-based agents due to the need for extensive planning over multiple steps. In this paper, we propose a hierarchical framework that decomposes complex tasks into…

Machine Learning · Computer Science 2024-10-07 Qi Zhao , Haotian Fu , Chen Sun , George Konidaris

Training a model-free reinforcement learning agent requires allowing the agent to sufficiently explore the environment to search for an optimal policy. In safety-constrained environments, utilizing unsupervised exploration or a non-optimal…

Artificial Intelligence · Computer Science 2024-08-05 Erfan Entezami , Mahsa Sahebdel , Dhawal Gupta

Creating large-scale interactive 3D environments is essential for the development of Robotics and Embodied AI research. Current methods, including manual design, procedural generation, diffusion-based scene generation, and large language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yian Wang , Xiaowen Qiu , Jiageng Liu , Zhehuan Chen , Jiting Cai , Yufei Wang , Tsun-Hsuan Wang , Zhou Xian , Chuang Gan

Training agents to operate under strict constraints during deployment, such as limited resource budgets or stringent safety requirements, presents significant challenges, especially when these constraints render the task complex. In this…

Machine Learning · Computer Science 2025-11-05 Georgios Tzannetos , Parameswaran Kamalaruban , Adish Singla

Unsupervised environment design (UED) is a form of automatic curriculum learning for training robust decision-making agents to zero-shot transfer into unseen environments. Such autocurricula have received much interest from the RL…

Machine Learning · Computer Science 2024-08-27 Minqi Jiang , Michael Dennis , Edward Grefenstette , Tim Rocktäschel

Following the pivotal success of learning strategies to win at tasks, solely by interacting with an environment without any supervision, agents have gained the ability to make sequential decisions in complex MDPs. Yet, reinforcement…

Machine Learning · Computer Science 2026-03-18 Ezgi Korkmaz

State of the art reinforcement learning has enabled training agents on tasks of ever increasing complexity. However, the current paradigm tends to favor training agents from scratch on every new task or on collections of tasks with a view…

Machine Learning · Computer Science 2023-02-09 Jacob Walker , Eszter Vértes , Yazhe Li , Gabriel Dulac-Arnold , Ankesh Anand , Théophane Weber , Jessica B. Hamrick

Advancements in reinforcement learning (RL) have demonstrated superhuman performance in complex tasks such as Starcraft, Go, Chess etc. However, knowledge transfer from Artificial "Experts" to humans remain a significant challenge. A…

Artificial Intelligence · Computer Science 2023-06-23 Sidney Tio , Pradeep Varakantham

World models are increasingly pivotal in interpreting and simulating the rules and actions of complex environments. Genie, a recent model, excels at learning from visually diverse environments but relies on costly human-collected data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Naser Kazemi , Nedko Savov , Danda Paudel , Luc Van Gool

Recent advances in agent development have focused on scaling model size and raw interaction data, mirroring successes in large language models. However, for complex, long-horizon multi-agent tasks such as robotic soccer, this end-to-end…

Artificial Intelligence · Computer Science 2025-11-05 Brennen Hill

Goal-directed Reinforcement Learning (RL) traditionally considers an agent interacting with an environment, prescribing a real-valued reward to an agent proportional to the completion of some goal. Goal-directed RL has seen large gains in…

Machine Learning · Computer Science 2020-10-28 Sharath Chandra Raparthy , Bhairav Mehta , Florian Golemo , Liam Paull

This paper presents a novel paradigm in simulation-based engineering sciences by introducing a new framework called Generative Parametric Design (GPD). The GPD framework enables the generation of new designs along with their corresponding…

Computational Engineering, Finance, and Science · Computer Science 2025-12-15 Mohammed El Fallaki Idrissi , Jad Mounayer , Sebastian Rodriguez , Fodil Meraghni , Francisco Chinesta